Skip to content

praxis-proxy/ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

800 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Praxis AI

Tests Coverage: ≥95% MSRV: 1.96 License: MIT

Praxis AI is a programmable gateway for AI traffic. It extends Praxis with provider-aware filters, agentic protocols, response storage, guardrails, and observability—all configured at the proxy layer.

Use it to route requests by model or API format, translate between provider protocols, enrich prompts, manage OpenAI Responses state, broker MCP and A2A traffic, and expose token usage without coupling those concerns to every application.

What can it do?

  • Route AI traffic by model, provider format, tool composition, or other facts extracted from a request.
  • Bridge provider APIs with support for OpenAI Responses and Conversations, Anthropic Messages, and streaming event translation.
  • Support agentic workloads through MCP and A2A classification, brokering, and routing.
  • Add gateway capabilities such as credential injection, prompt enrichment, external guardrails, token accounting, and SQLite or PostgreSQL response storage.
  • Stay extensible with custom Rust filters built on Praxis's HttpFilter interface.

See the complete feature overview and filter reference for the full list.

Architecture

Clients keep their provider-native protocols while Praxis AI classifies, transforms, and routes traffic through one policy-driven gateway.

Praxis AI architecture

Quick start

Build and start the gateway with its built-in configuration:

make release
./target/release/praxis-ai

Then check that it is running:

curl http://127.0.0.1:8080/
{"status": "ok", "server": "praxis-ai"}

Ready to connect a backend? Follow the quickstart, or choose from the example configurations for OpenAI, Anthropic, MCP, A2A, routing, guardrails, token usage, and more.

Learn your way around

If you want to… Start here
Run Praxis AI locally Quickstart
Browse supported capabilities Feature overview
Configure a filter Filter reference
Understand the design Architecture docs
Build or test the workspace Development guide
Add a new filter Adding filters

Praxis AI handles the AI-specific layer. For listeners, TLS, load balancing, rate limiting, health checks, and other core proxy features, visit the Praxis repository.

Important

Praxis AI is alpha software. APIs, configuration, and operational behavior may change before v1.0.0. See the security policy for the supported release line.

Released container images are available from ghcr.io/praxis-proxy/ai. Source builds and local development instructions are in the development guide.

docker pull ghcr.io/praxis-proxy/ai:0.1

Podman can pull the same OCI image. See the quickstart for a source build and the release documentation for image contents and tagging.

Contributing

Contributions are welcome, from bug reports and documentation fixes to new filters and protocol support. Before opening a pull request, please read the contributing guide and development setup.

For larger changes, start a discussion and follow the proposal process so we can shape the idea together.

Open an issue · Start a discussion · Open a pull request

About

AI features and capabilities for Praxis

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages