Tagged "apple-silicon-optimization"
6 articles tagged apple-silicon-optimization, 1 April 2026 to 18 October 2026. Newest first.
-
Ollama v0.40.7 Release: OpenAI API Improvements and MLX Enhancements
Latest Ollama release adds OpenAI-compatible API features for non-thinking models and improves MLX support, enhancing compatibility and performance for local inference deployments.
-
Running AI Models Locally on M4 Processors with 24GB Memory
A technical guide explores deploying language models on Apple M4 devices with 24GB unified memory, demonstrating Apple Silicon's capabilities for local inference. The approach leverages frameworks optimized for ARM architecture and unified memory access.
-
Google's Gemma 4 Brings Powerful AI Capabilities to Phones and Laptops
Google announces Gemma 4, a model family designed specifically for on-device inference on consumer hardware including smartphones and laptops without requiring cloud connectivity.
-
AIYO Wisper: Local Voice-to-Text for macOS Using WhisperKit
A new open-source macOS application brings Whisper-based speech recognition to Apple Silicon without cloud dependencies. AIYO Wisper demonstrates practical local inference for voice-to-text workflows on consumer hardware.
-
Kokoro TTS Achieves 20× Realtime Speed on CPU-Only On-Device Inference
A developer has successfully deployed Kokoro text-to-speech with 20× realtime performance using only CPU inference via MLX Swift on iOS, enabling high-quality, low-latency speech synthesis entirely on-device.
-
Ollama Adopts Apple's MLX Framework for Faster Local AI on Mac
Ollama now leverages Apple's MLX framework to significantly improve inference speed on Apple silicon Macs through unified memory optimization. This integration makes running large language models locally more efficient and accessible for Mac users.