A practical, ops-minded blueprint for running agentic workflows locally: LangGraph for durable state, MCP for standardized tool boundaries, and Ollama for local inference—plus the guardrails that keep it from becoming an unmaintainable demo.
Opus 4.6 is being positioned as stronger at coding and longer-running agentic tasks, with ‘agent teams’ entering preview. For platform leaders, the real story is operational: least privilege, audit trails, evals, and a clean boundary between propose vs execute.
The ‘LLM inference server’ is quickly becoming a standard platform component. vLLM and Ollama represent two distinct operating models—GPU-first throughput engineering vs developer-friendly packaging. Here’s how to pick based on tenancy, observability, and cost, not hype.
Gateway API is the direction of travel, but teams still need an implementation that can survive production traffic. Envoy Gateway is quietly becoming that default. Here’s what’s maturing, what’s still sharp, and how to adopt it without breaking every app team.
Dapr’s Conversation component abstracts LLM provider differences behind a runtime API, letting teams focus on prompts and tool calls while the sidecar handles retries, auth, and provider quirks. It’s an early blueprint for agentic, ops-friendly AI integration.
Argo CD 3.3.0 sharpens the line between old apply behaviors and server-side apply. If Argo CD manages itself, upgrades can fail unless you adopt the right sync options—making this a good time to audit GitOps bootstrapping patterns.
Kubernetes’ binary Node Ready signal is often too coarse for modern clusters. The new Node Readiness Controller proposes a declarative, taint-driven way to keep workloads off nodes until the platform-specific dependencies you care about are truly healthy.
Kubernetes’ new Node Readiness Controller tackles a long-standing problem: “Ready” is binary, but modern nodes fail in nuanced ways. What’s changing, why it matters, and how to roll it out.