
PrismML brings tiny LLMs to Qualcomm-powered smart glasses

PrismML, an AI lab founded by Caltech researchers and advised by UC Berkeley’s Ion Stoica, has developed a version of its tiny language models for smart glasses running on Qualcomm‘s Snapdragon chips. At Qualcomm‘s Snapdragon Summit, the chipmaker showcased PrismML‘s 1-bit Bonsai LLM, which can run locally on AI smart glasses built on the Snapdragon AR1 Gen 1 Platform. The smart glasses version is a 2-billion-parameter model tuned for vision and language, enabling wearers to ask what they’re looking at in real time.
PrismML‘s approach involves shrinking larger models substantially—in this case by 4x—while retaining almost all of their performance on standard benchmarks. The startup’s larger goal is open-weight AI that runs on devices and makes better use of existing computing power, pitched as an alternative to relying on the privacy promises of proprietary AI labs and their need for more compute. Releasing a model for Qualcomm‘s chip is a step toward that vision, but no smart glasses running PrismML have been announced yet.


