Qwen 3.5 running locally on a iPhone 17 Pro. On par with models 4 times its size and offers the flexibility to enable or disable reasoning. The 2B 6-bit version running on the iPhone utilizes MLX optimization for Apple Silicon. The developer is working on an update of the app to make it available for the rest of us. This app has some really interesting features, especially the voice mode which works also complete offline.
https://locallyai.app/ #privacy #freedomtech #localai #localllm