Back to browse
GitHub Repository
2 starsPython

UATC-Closed-loop VRAM control and dynamic data pruning for LLM training

by L_u_u_6·Jul 13, 2026·1 point·0 comments

AI Analysis

●●●BangerWizardryBig BrainSolve My Problem

Kalman filter and PID loop prevent OOM crashes where DeepSpeed static baselines fail.

Strengths
  • Industrial control theory (PID, Smith predictor) applied to VRAM management is a genuinely novel approach.
  • Recovers from 18 forced OOM events and prunes 86% of redundant samples without fatal crashes.
  • Paradigm-aware adaptation works across full fine-tuning, LoRA, and QLoRA without code changes.
Weaknesses
  • Evaluation limited to a single 1.5B model on a T4; scalability to larger models unproven.
  • High complexity barrier; integrating control theory stacks may deter casual adopters.
Category
Target Audience

ML engineers fine-tuning models on consumer hardware or resource-constrained clusters

Similar To

DeepSpeed · PyTorch FSDP · Accelerate

Similar Projects

AI/ML●●Solid

BNNR – a closed-loop pipeline for improving vision models

XAI-driven model improvement loop, but Weights & Biases already tracks experiments better.

Big BrainNiche Gem
dominka
103mo ago