model
Bonsai 1-bit WebGPU
Experimental in-browser 1-bit LLM runner, currently only for tech enthusiasts
4.6Overall
Utility4
Onboarding5
Craft5
Niche fit6
Longevity3
Five dimensions scored independently; overall is a weighted average. Scores are only comparable within this same rubric.
Good for
Frontend devs/researchers experimenting with in-browser quantized models
Not for
Teams needing production-grade stability
Project description
Run 1-bit Bonsai LLMs locally in your browser on WebGPU
Alternatives
TensorFlow.jsONNX Runtime Web