Back to browse
GitHub Repository

Self-hosted LLM + RAG stack for organizations that can't use cloud AI. No data leaves your server. EU AI Act compliant

3 starsShell

Private Corporate AI – self-hosted LLM and RAG, no cloud

by neckgoes·Mar 24, 2026·3 points·1 comment

AI Analysis

MidNiche Gem

Another self-hosted RAG stack competing with Ollama, AnythingLLM, and Dify.

Strengths
  • Docker Compose setup simplifies deployment for IT teams without Kubernetes.
  • EU AI Act compliance documentation addresses real regulatory concerns.
Weaknesses
  • v0.2.0 with 2 stars indicates early stage compared to mature alternatives.
  • No unique architecture—wraps existing LLM and vector database tools.
Category
Target Audience

Enterprises with data privacy requirements, EU companies

Similar To

Ollama · AnythingLLM · Dify

Similar Projects

AI/ML●●Solid

Docker AI Stack, self-hosted LLM/STT/TTS/MCP in one compose file

One-command local AI stack bundling Ollama, Whisper, and MCP Gateway.

Ship ItCozy
hwdsl2
1028d ago
AI/MLMid

Docker AI Stack – Deploy 8 self-hosted AI services with one command

Yet another one-command AI stack when Ollama and Jan already exist.

Ship It
hwdsl2
1021d ago