Docker Model Runner Adds Anthropic-Compatible API Support
Latest update enables Claude-compatible endpoints for local LLM inference alongside existing OpenAI compatibility.
Docker Model Runner added Anthropic-compatible API support on February 1, enabling Claude-compatible endpoints for local LLM inference alongside existing OpenAI compatibility.
Dual API Support
Applications can now use OpenAI or Anthropic API formats to interact with locally-run models through Docker Model Runner. This allows testing with local models before deploying to cloud APIs, or running entirely self-hosted inference.
Cost Reduction
Local inference eliminates per-token API costs for organizations with sufficient GPU infrastructure. For high-volume applications, self-hosting can reduce inference costs by 90% or more compared to cloud APIs.
Privacy Benefits
Running models locally keeps sensitive data on-premises, addressing privacy concerns in regulated industries. Healthcare, finance, and legal organizations can use powerful LLMs without sending data to external services.
Developer Experience
Docker Model Runner simplifies local LLM deployment, handling model downloads, GPU configuration, and API serving. Developers can switch between local and cloud inference by changing an API endpoint URL.
Related Articles
GitHub Expands Developer Platform with Actions Artifacts v5 and Copilot Extensions GA
GitHub has shipped Actions Artifacts v5 with immutable storage and artifact attestation for tamper-proof build outputs, alongside the general availability of Copilot Extensions that let third-party tools integrate directly into the Copilot chat experience. The platform also expanded GitHub Models with seven new providers.
Docker Engine 29.3 Ships with Native gRPC Support and BuildKit v0.28
Docker Engine 29.3.0 introduces native gRPC support on listening sockets, BuildKit v0.28.0, and a new bind-create-src option for flexible volume mounting. The release lowers the minimum API version to v1.40 for broader backward compatibility and fixes DNS configuration corruption during daemon reloads.
GitHub Adds Dependabot Pre-Commit Support and 28 New Secret Scanning Detectors
GitHub has shipped two major supply chain security features: Dependabot now parses .pre-commit-config.yaml files and opens PRs to update hook versions, while secret scanning gains 28 new detectors from 15 providers including Snowflake, Supabase, and Vercel. Push protection is now enabled by default for 39 secret types.