AI/ML●Mid
Private Corporate AI – self-hosted LLM and RAG, no cloud
Another self-hosted RAG stack competing with Ollama, AnythingLLM, and Dify.
Niche Gem
neckgoes
313mo ago
Back to browse
GitHub Repository
Self-host the modern LLM stack.
46 starsGo
Self hosting a modern LLM stack
by sleepynoodle·Jun 29, 2026·5 points·1 comment
AI Analysis
●●SolidShip ItSolve My Problem
Single-command LLM stack with LangGraph agents, but AnythingLLM and Dify already do this.
Strengths
- •Go CLI orchestrating Python agent layer shows thoughtful architecture separation.
- •Bundles observability and caching layers most self-hosted options skip.
- •Apache 2.0 license enables enterprise adoption without licensing concerns.
Weaknesses
- •Alpha status with 35 commits means production readiness is unproven.
- •No clear differentiation from Dify, LocalAI, or Open WebUI.
Category
Target Audience
Teams needing private, self-hosted LLM infrastructure without third-party APIs
Similar To
Dify · LocalAI · AnythingLLM
Similar Projects
Developer Tools●●Solid
Logmera – Self-hosted LLM observability for AI apps
LLM logging dashboard, but Langsmith and Llamaindex already do this.
Solve My Problem
Thilakkumar
123mo ago
Developer Tools●●Solid
I built a desktop app for building and debugging MCP tools
MCP debugging UI for Spring AI when LangChain UI exists for Python.
Niche Gem
hjm1980
102mo ago
AI/ML●●Solid
Docker AI Stack, self-hosted LLM/STT/TTS/MCP in one compose file
One-command local AI stack bundling Ollama, Whisper, and MCP Gateway.
Ship ItCozy
hwdsl2
101mo ago
Infrastructure●Mid
Mantis, A self-hosted LLM gateway
Another LLM gateway when LiteLLM and Portkey already dominate the space.
Ship It
rizsyed1
503d ago
Developer Tools●●Solid
Torrix, self hosted, LLM Observability,(no Postgres, no Redis)
Single Docker container with SQLite beats LangSmith's heavy Postgres dependency.
Solve My ProblemCozy
AdarshRao23
7441mo ago