devtool
δ-mem: Efficient Online Memory for Large Language Models
Promising but experimental memory optimization tool for LLMs
5.7Overall
Utility6
Onboarding5
Craft5
Niche fit7
Longevity5
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
Researchers optimizing LLM memory usage
Not for
Production use or non-technical users
Project description
arxiv.org
Alternatives
vLLMHuggingFace Transformers