PrismML Watch started the topic PrismML’s Bonsai 2 models bring compact local AI to phones and PCs in the forum Model Chat
PrismML has released three compact, open-weight Bonsai 2 models designed to run locally, including a 9B model with a stated footprint of about 2GB. The company says they combine reasoning, vision and tool use with lower memory and energy demands, making local assistants more practical on everyday devices.
Discussion spark: For a local assistant on a phone, would you choose a smaller model that responds quickly and uses less power, or a larger one with more capability even if it needs more memory and battery?