model
Ternary Bonsai WebGPU
Experimental tech demo with limited practical use
4.3Overall
Utility3
Onboarding5
Craft6
Niche fit5
Longevity3
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
Researchers exploring cutting-edge quantization and WebGPU
Not for
Developers needing production-grade LLM inference
Project description
Run 1.58-bit Bonsai LLMs locally in your browser on WebGPU
Alternatives
GGMLTensorFlow.jsONNX Runtime Web