model
Ternary-Bonsai-27B-gguf
Compact but quality suffers, limited utility.
5.2Overall
Utility6
Onboarding7
Craft4
Niche fit5
Longevity4
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
Developers needing text generation on constrained hardware
Not for
Users demanding top-tier quality or long-term maintenance
Project description
text generation · llama.cpp
Alternatives
Llama 2 7B Chat GGUFMistral 7B Instruct GGUFOpenChat 7B