Tagged "inference-pipeline"
4 articles tagged inference-pipeline, 5 May 2026 to 28 September 2026. Newest first.
-
A Wall That Listens: The Local-LLM Pipeline Behind an AI Party in Vilnius
A creative technical deep-dive into building a real-time, fully-local LLM inference pipeline for an interactive art installation using edge-deployed language models and voice I/O.
-
Transformers Library Now Runs llama.cpp Quantized Models
Hugging Face's Transformers library now supports inference with llama.cpp quantized models, significantly expanding compatibility for local LLM deployment. This integration makes it easier for practitioners to leverage highly optimized quantizations in standard Python workflows.
-
LM Studio 0.4 Introduces Headless Deployment for Local LLM APIs
LM Studio 0.4 adds headless mode enabling local LLM serving without the GUI, expanding deployment flexibility for production and edge scenarios.
-
Show HN: Memex, Claude Memory via Local RAG with MCP and Offline Embeddings
Memex enables persistent memory for Claude through local retrieval-augmented generation using offline embeddings and Model Context Protocol, eliminating cloud dependency for context management.