Infrastructure●●Solid
Piqc – GPU waste scanner for LLM inference clusters
Read-only GPU waste scanner finds 20-40% cluster spend waste without agents or sidecars.
Solve My ProblemSlick
paralleliq
3011d ago
Back to browse
Costly – Open-source SDK that audits your LLM API costs
by itsdannyt·Mar 14, 2026·4 points·1 comment
AI Analysis
●●SolidSolve My ProblemSlick
Seven automated detectors flag wasted tokens and suggest specific fixes like prompt caching.
Strengths
- •Detectors flag anti-patterns like repeated system prompts instead of raw usage logs.
- •One-command install instruments code without manual wrapper changes or extra configuration.
- •Audit advice suggests concrete fixes like enabling prompt caching to cut costs.
Weaknesses
- •Competes with Helicone and LangSmith, which already track API costs thoroughly.
- •Dashboard requires waiting 48 hours for data, delaying immediate value verification.
Category
Target Audience
AI engineers and CTOs managing high LLM API bills
Similar To
Helicone · LangSmith · Portkey
Similar Projects
Developer Tools●●●Banger
Spendtrace, Feature-level AWS cost attribution (found a 17× gap))
One decorator reveals which feature burned $2,800 instead of two-day forensics.
Solve My ProblemShip It
joshyi_ba
233mo ago
AI/ML●●Solid
Piqc – An open-source GPU waste scanner for LLM inference clusters
One-command GPU waste scanner when Kubecost requires full Prometheus setup.
Solve My ProblemNiche Gem
samhoss93
118d ago
Developer Tools●●Solid
Caliper – Auto Instrumented LLM Observability with Custom Metadata
Zero-code instrumentation via monkey-patching, but Langsmith, Helicone, and Arize already do this.
Solve My ProblemShip It
OliverGuy
203mo ago
AI/ML●●●Banger
A Claude Code skill that tells Claude when not to use Claude
Traffic-light audit system beats vague 'optimize your LLM spend' advice from competitors.
Big BrainSolve My Problem
metravod
1027d ago
Developer Tools●Mid
An open-source Go CLI to generate local AWS cost reports
Adds PDF report generation to AWS cost CLI, but cost tools are crowded.
Ship It
elC0mpa
312mo ago