GitHub - cactus-compute/needle: 14MB foundation model for tiny devices; phones, wearables, smart home, and robots.
From the source
github.comPublisher’s summary
14MB foundation model for tiny devices; phones, wearables, smart home, and robots. - cactus-compute/needle
The whole model is a single 14MB binary that runs a full session in about 28MB of RAM.