model
Bonsai 1-bit GPU
Experimental 1-bit quantized model, currently research-only
4.6Overall
Utility4
Onboarding5
Craft5
Niche fit6
Longevity3
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
LLM quantization researchers or developers exploring cutting-edge techniques
Not for
Production use cases requiring stable inference
Project description
Run 1-bit Bonsai LLMs on GPUs
Alternatives
GPTQAWQbitsandbytes