Back to browse
GitHub Repository

Production Rust libraries for AI agents and financial systems — zero panics, typed errors, aerospace-grade test coverage

8 stars

Rust primitives for AI agents, LLM infrastructure, and financial data

by Shmungus·Mar 7, 2026·1 point·0 comments

AI Analysis

●●SolidBig BrainWizardry

Impressive Rust substrate layer, but crate collection without proof of integration or adoption.

Strengths
  • Zero-panic enforcement, typed errors (thiserror), and extensive test coverage demonstrate production rigor
  • Thoughtful primitives: episodic/semantic memory with Ebbinghaus decay, CRDT sync for distributed fleets, financial orderbook handling 100K+ ticks/second
  • Independent composability + orchestrator design signals real system architecture thinking
Weaknesses
  • Published as git dependencies only (no crates.io releases); unclear maturity or versioning stability
  • No documentation of how crates integrate, no demo app or reference architecture showing real-world composition
Target Audience

Rust systems engineers building distributed AI agents, quantitative trading platforms, edge computing systems

Similar To

tokio ecosystem · actix-web · Tauri (for distribution)

Post Description

I've been building the substrate layer for production AI systems in Rust. This is the index repo for 10 crates I shipped this week. The AI side covers agent memory (episodic, semantic, working with decay and multi-agent bus), cost governance with hard budget enforcement and automatic model downgrade cascade, CRDT state sync for distributed agent fleets, output versioning with full lineage tracking, a knowledge graph on top of agent memory, LLM inference primitives for WASM and edge runtimes, and a complete ReAct loop that runs inside a Cloudflare Worker. The financial side covers market primitives (orderbook, OHLCV, indicators, position, risk) and a streaming ingestion pipeline handling 100K+ ticks/second across 4 exchanges.

Everything is zero-panic enforced at the lint level, typed errors with thiserror throughout, no unnecessary dependencies. The crates are designed to compose, the orchestrator runs the agents, memory stores what they know, the graph understands relationships between what they know, the budget governs what they spend, sync keeps 24 agents consistent without locks.

The orchestration engine that coordinates all of this is tokio-prompt-orchestrator, which I've been running with 24 simultaneous Claude Code agents.

https://github.com/Mattbusel/rust-crates

Similar Projects