Tagged "model-selection"
27 articles tagged model-selection, 28 March 2026 to 13 October 2026. Newest first.
-
How to Choose the Best Local LLM Based on MacBook RAM Size
A practical guide matching LLM model sizes to MacBook specifications, providing evidence-based recommendations for running local models across the full range of Apple Silicon configurations.
-
Practical Guide: Running Local LLMs on Your Mac - What Fits, What's Free
A comprehensive guide exploring which local LLMs run efficiently on Mac hardware, including free options and performance tradeoffs between commercial and open-source models. Covers model selection, quantization options, and realistic expectations.
-
Picking a Local LLM for Coding: What Fits on Your Machine and What Still Needs an API
Practical guidance on selecting appropriate local LLM models for coding tasks based on hardware constraints, helping developers understand model-to-machine matching.
-
Indian Companies Look to Chinese LLMs as AI Costs Bite
Cost-conscious companies are increasingly adopting smaller, cheaper LLM alternatives, including Chinese models. This trend demonstrates growing viability of non-frontier models for production workloads and may drive local deployment adoption.
-
Ask HN: Which AI Model Do You Use for What?
A community discussion thread where developers share their practical choices of AI models for specific local deployment scenarios, providing real-world insights into model selection and performance tradeoffs.
-
How to Choose Between Small and Frontier Models
A comprehensive guide comparing trade-offs between small quantized local models and large frontier models, helping practitioners make informed deployment decisions based on latency, cost, and accuracy requirements.
-
LLM Checker Tool Helps Identify Models for Your PC
A new free tool called LLM Checker helps users identify which local language models can run effectively on their specific hardware, simplifying the model selection process for local deployment.
-
Three Flavors of Coding with AI Agents
An analysis of different approaches to using AI agents for code generation and development, exploring various paradigms for integrating LLMs into development workflows.
-
The Anatomy of an LLM
A technical deep-dive into how large language models work internally, covering architecture, training, and inference fundamentals essential for understanding local deployment.
-
The Brain vs. Deep Learning Part I: Computational Complexity Analysis
A detailed analysis comparing computational complexity between biological brains and deep learning systems provides theoretical foundations for understanding efficiency trade-offs in model design and local deployment. This research is foundational for optimizing inference on resource-constrained devices.
-
Show HN: Find the best local LLM for your hardware, ranked by benchmarks
A new GitHub tool helps developers identify the optimal local LLM for their specific hardware constraints by ranking models across performance benchmarks. This addresses a key pain point in the local LLM ecosystem where choosing between dozens of models requires extensive manual testing.
-
I Stopped Paying for ChatGPT and Switched to a Local LLM That Runs on My Laptop
A user shares their experience transitioning from cloud-based AI services to a locally-hosted LLM on consumer hardware, highlighting cost savings and practical considerations for making the switch.
-
Dikaletus: Open-Source Meeting Recording and Transcription Using Mistral AI
A new open-source tool demonstrates practical local LLM deployment for meeting transcription using Mistral AI, showing real-world applications of on-device inference.
-
Improving Code Quality with Local Claude and Codex Models
Technical discussion on optimizing code generation quality when running Claude and Codex models locally, covering quantization, prompt engineering, and inference parameters. Practitioners share techniques for maximizing coding task performance on consumer hardware.
-
Google's Gemma 4 Could Put Powerful AI on Your Phone and Laptop
Google is advancing on-device AI capabilities with Gemma 4, a model family optimized for edge deployment on consumer devices. This release signals a major push toward bringing sophisticated language models to phones and laptops without cloud dependencies.
-
New Open-Source Tool Automatically Matches Local LLMs to Your PC Hardware
An open-source utility now automatically analyzes your hardware and recommends compatible local LLMs, eliminating guesswork from model selection and setup.
-
Picking Your First Local LLM Is Easier Than the Internet Makes It Sound
A comprehensive guide demystifies the process of selecting and deploying a local LLM for beginners, cutting through the complexity that often discourages newcomers from adopting local inference.
-
Stop Guessing: Open-Source Tool Predicts Which Local LLMs Run on Your PC
A new open-source diagnostic tool helps practitioners quickly determine which language models will run efficiently on their specific hardware without trial and error. This addresses a major pain point in local LLM adoption.
-
10GB VRAM Local LLM: The Complete Setup Guide (2026)
A comprehensive guide covering practical methods to run capable local LLMs with just 10GB of VRAM, including quantization techniques, model selection, and optimization strategies for resource-constrained systems.
-
Claude vs Local LLM: Real-World Prompt Comparison Reveals Trade-offs
A practitioner compares Claude's capabilities directly against local LLM alternatives on identical prompts, documenting performance trade-offs relevant to deployment decisions.
-
I Built a Local AI Stack with 5 Docker Containers, and Now I'll Never Pay for ChatGPT Again
A practical guide demonstrating how to assemble a complete local AI stack using five Docker containers, eliminating dependency on cloud API services. This showcases end-to-end self-hosted LLM infrastructure design.
-
Google's Gemma 4: The Most Practical Local LLM Despite Not Being The Smartest
An experienced practitioner explains why Gemma 4 has become their go-to local LLM model, prioritizing pragmatism, efficiency, and real-world usability over raw benchmark performance.
-
The Best Local AI Model for Home Assistant Isn't Always the Biggest One
A practical guide examining model selection for Home Assistant, revealing how optimal performance requires balancing model capability with hardware constraints rather than simply choosing the largest available model.
-
I Replaced My Local LLM With a Model Half Its Size and Got Better Results — and It Wasn't About the Parameters
A detailed account of how switching to a smaller, better-optimized model outperformed a larger predecessor on local hardware, challenging assumptions about model scaling and practical performance.
-
NVIDIA Accelerates Gemma 4 for Local Agentic AI on RTX GPUs
NVIDIA provides day-one optimizations for Google's Gemma 4 models across its RTX GPU lineup, enabling accelerated local inference for agentic AI workflows on consumer and enterprise graphics cards.
-
Google's TurboQuant Shows Memory Constraints Remain Critical for Local LLM Inference
Insights from KAIST researchers involved in Google's TurboQuant quantisation work highlight how memory demands continue to be the fundamental bottleneck limiting local LLM deployment at scale.
-
GLM-5.1 Model Weights Launching Early April for Local Deployment
Zhipu AI has announced the upcoming release of GLM-5.1 model weights on April 6-7, bringing a new open-weight option to the local LLM community. This release adds another competitive choice alongside Qwen and other open models for on-device inference.