Back to browse
GitHub Repository

Rivers is an orchestration platform for data and ML pipelines, written in Rust for native performance with a Python-first development experience.

80 starsRust

Rivers – a Rust/Python orchestrator with native OIDC and forward auth

by ion-elgreco·Jul 25, 2026·2 points·0 comments

AI Analysis

●●SolidBig BrainSolve My Problem

Rust core handles planning while Python defines assets, unlike Airflow's Python-heavy scheduler.

Strengths
  • Graph resolution and partition logic run in compiled Rust for sub-millisecond planning.
  • Single-binary dev mode boots embedded SurrealDB, scheduler, and UI instantly.
  • Native OIDC and forward auth support without requiring enterprise paywalls.
Weaknesses
  • Early stage with only 80 stars and limited third-party integrations compared to Airflow.
  • Kubernetes operator adds complexity for teams not already running K8s clusters.
Target Audience

Data engineers and ML platform teams

Similar To

Airflow · Dagster · Prefect

Post Description

I've been building Rivers for the past 7 months, an asset-based orchestrator. The core components such as planning, scheduling etc are in Rust and the user facing API is in Python.

My most recent release adds OIDC and forward auth support. Security shouldn't be paywalled :)

Similar Projects

Infrastructure●●●Banger

Sayiir – A simple durable workflow engine (Rust core, Python/Node.js)

Checkpoint-based recovery beats determinism constraints; embed without separate server, unlike Temporal/Airflow.

Big BrainDark HorseSolve My Problem
ybsoft
104mo ago
Developer Tools●●Solid

BustAPI Back

Python syntax on Rust Actix core reaches 20k RPS, but Mojo and uv already address Python speed.

WizardryBig Brain
ZOROX
204mo ago
Security●●Solid

Auth intermediary that cannot authorize. By design

Auth layer with zero authority—can't sign or decide, only relay hashed requests.

Big BrainWizardry
sbw70
204mo ago
AI/ML●●●Banger

I applied Lyapunov stability theory to detect when LLM agents spiral

Lyapunov stability theory for LLM loops beats hard budget caps any day.

Big BrainSolve My ProblemShip It
visha1v
511mo ago