Tagged "production-inference"
5 articles tagged production-inference, 18 February 2026 to 11 October 2026. Newest first.
-
How to Run vLLM Natively on Windows
Practical guide to running vLLM directly on Windows systems without WSL or containers, enabling native local LLM inference on consumer Windows machines.
-
Ollama v0.34.3: Model Thinking Controls and Expanded Apple Silicon Support
Ollama releases v0.34.3 with new thinking level controls for models and expanded Apple Silicon support, including Nemotron H vision models on Mac hardware.
-
Local AI Isn't Just Ollama—Here's the Ecosystem That Actually Makes It Useful
A comprehensive overview of the diverse tools, frameworks, and services that comprise the modern local AI ecosystem beyond Ollama. This guide helps practitioners understand the full landscape of options available for deploying and running LLMs locally.
-
Unsloth Studio Beta Ships 50+ New Features for Local Model Training and Inference
The Unsloth Studio project released substantial updates including pre-compiled llama.cpp and mamba_ssm binaries, expanding capabilities for local model fine-tuning and inference workflows. The rapid feature velocity demonstrates active development in the local LLM toolkit ecosystem.
-
Ask HN: How Do You Debug Multi-Step AI Workflows When the Output Is Wrong?
A community discussion on debugging strategies for complex multi-step AI workflows running locally, covering techniques for identifying failures and improving inference reliability.