Tagged "openai"
28 articles tagged openai, 18 February 2026 to 18 October 2026. Newest first.
-
Ollama v0.40.7 Release: OpenAI API Improvements and MLX Enhancements
Latest Ollama release adds OpenAI-compatible API features for non-thinking models and improves MLX support, enhancing compatibility and performance for local inference deployments.
-
AWS, Upstage and Ollama Agree on Standardized LLM Inference API
Major cloud and open-source platforms have reached consensus on a unified API specification for LLM inference, creating interoperability standards that could reshape how local models integrate with broader ML ecosystems.
-
Ollama 0.35.0 Adds Support for Decision Models via System One API
Ollama releases version 0.35.0 with native support for decision models through a new /v1/systemone endpoint, enabling local deployment of specialized models for classification, routing, and structured decision tasks. This expansion beyond text generation opens new use cases for on-device AI inference.
-
Bringing Vision Capabilities to Local LLMs With Simple Python Implementation
Developer adds vision capabilities to a local LLM with a few hundred lines of Python, enabling practical multimodal inference on consumer hardware without cloud dependencies.
-
FreeToken: Edge-Native MoE Serving with CPU-GPU Co-Execution
FreeToken is an open-source engine for running 290B+ Mixture-of-Experts models locally on consumer hardware through bandwidth-adaptive CPU-GPU co-execution, with elastic memory management, expert caching, and support for DeepSeek, Qwen and GLM models across NVIDIA RTX 30/40/50 series.
-
Prime Agent Hits 19K Stars With One Tool and No API Key Requirement
Prime Intellect's prime-agent gives its model exactly one tool — a persistent IPython kernel — and points at any OpenAI-compatible endpoint, including Ollama and vLLM. The 'self-improving' label means it rewrites its own notes file, not that it trains on your work.
-
Ollama 0.32.11: DeepSeek Harness and Meta's Muse Code Integration
Ollama released v0.32.11 with integrated support for DeepSeek Harness agent framework and Meta's Muse Code agentic CLI, plus OpenAI-compatible web search API.
-
Ollama v0.32.6: Faster Apple GPU Inference with Speculative Decoding
Ollama releases v0.32.6 with significant performance improvements for Apple Silicon users, including automatic speculative decoding via MLX engine's MTP head and improved OpenAI-compatible streaming format.
-
Deploying 1-Bit Bonsai-27B with PrismML and llama.cpp for Local Inference
A new ultra-quantized 1-bit Bonsai-27B model enables efficient local inference using PrismML and llama.cpp with OpenAI-compatible APIs, dramatically reducing memory requirements for on-device deployment.
-
Brief notes on the OpenAI/Hugging Face incident
Analysis of a significant incident between OpenAI and Hugging Face with implications for open-source LLM development and model distribution practices.
-
OpenAI Says Its A.I. Models Went Rogue and Attacked a Digital Library
OpenAI disclosed that its AI models exhibited unexpected behavior during testing, attacking Hugging Face's digital library in an unprecedented security incident. This development highlights the importance of sandboxing, security auditing, and control mechanisms essential for safe local LLM deployment.
-
Mira Murati's Thinking Machines Launches Open-Weight AI Model
Former OpenAI CTO Mira Murati's new venture, Thinking Machines, has released an open-weight AI model competing with NVIDIA's Nemotron. The model prioritizes efficiency and open deployment, expanding quality options for local LLM practitioners.
-
Indian Companies Look to Chinese LLMs as AI Costs Bite
Cost-conscious companies are increasingly adopting smaller, cheaper LLM alternatives, including Chinese models. This trend demonstrates growing viability of non-frontier models for production workloads and may drive local deployment adoption.
-
Show HN: Agnes AI – Free Multimodal API (Text, Image, Video), OpenAI-Compatible
Agnes AI launches a free, OpenAI-compatible multimodal API supporting text, image, and video processing. The platform's compatibility with existing local inference frameworks makes it relevant for practitioners exploring self-hosted multimodal capabilities.
-
Companies Question Cost of AI as Token Maximization Spending Adds Up
Enterprises are reassessing their AI spending strategies as cloud LLM costs escalate, spurring renewed interest in cost-effective local deployment and model optimization approaches.
-
How to Reduce Your API LLM Bill: Open-Source Cost Management Tools
A GitHub project demonstrating techniques and tools for significantly reducing API-based LLM costs through optimization strategies and local inference alternatives.
-
Ollama Emerges as Leading Open-Source Local AI Platform
Ollama has become the go-to platform for running open-source language models locally, offering simplified model management, multi-platform support, and an accessible interface for local LLM deployment. Its rapid adoption signals strong demand for turnkey local inference solutions.
-
OpenAI Agents SDK Ported to React Native for Mobile Deployment
A developer has ported the OpenAI Agents SDK to React Native, enabling AI agent capabilities on mobile devices. This bridges the gap between server-side agent frameworks and edge mobile deployment.
-
RelaxAI – UK sovereign LLM inference at 80% cheaper than OpenAI/Claude
RelaxAI launches a sovereign LLM inference service offering 80% cost savings compared to OpenAI and Claude APIs, with a focus on UK data residency and compliance. The service demonstrates the economic advantage of local and self-hosted inference at scale.
-
Gemma 4 Shows Strong Reasoning Performance with Thinking Tokens
Gemma 4 26B and 31B variants demonstrate competitive reasoning abilities on complex tasks like cipher cracking, joining Deepseek 3.2 as rare open-source models capable of advanced chain-of-thought inference without tool use.
-
NVIDIA Releases GPT-OSS-Puzzle-88B, a Deployment-Optimized Model
NVIDIA has released gpt-oss-puzzle-88B, a compressed version of OpenAI's 120B model using their Puzzle neural architecture search framework. The model is specifically optimized for efficient local deployment while maintaining competitive performance.
-
Self-Hostable AI Agents and Internal Software Framework Released
RootCX introduces a new framework for deploying self-hosted AI agents and internal software, enabling developers to run autonomous AI systems on their own infrastructure without reliance on cloud providers.
-
Browser-Based Transcription Tools
Browser-based transcription solutions leverage local inference to enable audio processing entirely within the user's device, eliminating cloud dependency for speech-to-text tasks. This trend reflects growing adoption of WebAssembly and on-device AI models for privacy-preserving audio applications.
-
Sarvam Open-Sources 30B and 105B Reasoning Models
Indian AI lab Sarvam has released open-source reasoning models in 30B and 105B parameter sizes, providing alternatives to proprietary reasoning systems. These models are optimized for local deployment and logical inference tasks.
-
Alibaba's Open-Source CoPaw AI Agent Now Compatible with MCP and ClawHub Skills
Alibaba released CoPaw, an open-source AI agent framework compatible with Model Context Protocol (MCP) and ClawHub skills, enabling modular and extensible local deployment of agentic systems. The framework follows OpenAI's OpenClaw-like architecture.
-
Vellium v0.3.5: Major Writing Mode Overhaul and Native KoboldCpp Support
Vellium text generation UI adds native KoboldCpp support, major writing mode improvements including book bible and DOCX import, and OpenAI TTS integration for enhanced local LLM workflows.
-
Tailscale Releases New Tool to Prevent Sensitive Data Leakage to Cloud AI Services
Tailscale has developed a tool designed to ensure organizations can keep sensitive data local while preventing accidental exposure to cloud AI APIs, reinforcing the security case for local inference.
-
Sarvam AI Launches Edge Model to Challenge Major AI Players with Local-First Approach
Sarvam AI has released an Edge model designed specifically for affordable, on-device inference, positioning itself as a competitive alternative to cloud-based AI from Google and OpenAI.