Cloud Native

Gateway API v1.6 Goes GA, GKE Inference Gateway Cuts AI Latency 93%, and OpenShift 4.22 Adds EVPN

The Kubernetes ecosystem never stops moving, and the first week of August 2026 has delivered a flurry of meaningful updates across networking, AI infrastructure, and core project releases. From upstream Gateway API hitting a major maturity milestone to Google and Red Hat pushing enterprise-ready features into production, here is what matters right now.

Gateway API v1.6: Layer 4 Routing Goes GA

The biggest upstream story this week is the release of Gateway API v1.6.0, which graduates TCPRoute and UDPRoute to the Standard channel and the stable v1 API version. For workloads that speak raw TCP or UDP—databases, DNS servers, VoIP, gaming backends, IoT telemetry—this closes a long-standing portability gap. Until now, operators either fell back to basic Kubernetes Services or locked themselves into implementation-specific CRDs that do not travel between Gateway controllers.

With TCPRoute and UDPRoute now stable, teams can define raw Layer 4 routing declaratively using the same Gateway API patterns they already use for HTTP and TLS traffic. A Gateway listener accepts TCP or UDP traffic on a specific port; a Route resource attaches to that listener and forwards to backend endpoints. No Layer 7 awareness required. The previous v1alpha2 versions are deprecated and will be removed in a future release, so teams relying on experimental TCPRoute or UDPRoute should plan their migration paths now.

Version 1.6 also introduces cleaner boundaries between experimental and standard resources. New experimental resources now live in a dedicated gateway.networking.x-k8s.io API group and carry an X prefix—such as XBackend—making it immediately obvious what is production-grade and what is still incubating. When an experimental resource graduates, it drops the prefix and moves into the standard group. This is a small structural change that will save platform teams a lot of confusion.

The new XBackend experimental resource deserves a closer look. It is a general-purpose decorator for Service backends within Gateway API, and its first version supports ExternalHostname destinations. This is especially relevant for egress use cases, like routing cluster-hosted agentic workloads to external AI APIs, where confused deputy attacks make Service-based external name backends risky. Gateway API now gives operators a native way to handle these scenarios.

Google Doubles Down on AI-Optimized Kubernetes

Google Cloud has shipped two significant GKE features this week that directly target the cost and latency pressures of running generative AI in production.

GKE Inference Gateway with Prefix Caching

The GKE Inference Gateway, which intelligently routes LLM workloads based on real-time model server metrics, now leverages prefix caching to dramatically reduce inference latency. Instead of naive round-robin load balancing that triggers expensive accelerator recomputation, the gateway routes incoming requests to pods that already hold the relevant KV cache in memory.

This matters for real-world workloads. When a RAG pipeline grounds responses against enterprise documentation, the system prompt and document context are largely static across queries. With prefix caching, the model skips reprocessing those tokens entirely. Multi-turn chat applications see similar benefits: system personas and business rules stay cached while only the user’s new question gets computed.

An independent benchmark from Principled Technologies showed GKE Inference Gateway outperforming a standard managed Kubernetes service with round-robin HTTP load balancing by 15.7% higher throughput, 92.8% shorter time-to-first-token, and 62.6% lower inter-token latency on a Llama 3.1 8B shared-prefix workload. Snap reports achieving prefix cache hit rates of 75-80% in production using this architecture.

Agent Sandbox Hits General Availability

Also now generally available: GKE Agent Sandbox, a Kubernetes primitive built for running autonomous agents securely at scale. Unlike microVM-based isolation, which limits density due to guest OS overhead, Agent Sandbox uses gVisor’s user-space kernel for lightweight, secure container isolation. Google’s own tests showed the ability to run 88 OpenClaw agents on a single node before failure—a 44% increase over microVM baselines.

More importantly, when combined with GKE Pod Snapshots for suspend-and-resume, idle agents can be checkpointed to persistent storage, freeing CPU and memory. In cost-optimized configurations, Google demonstrated running 274 agents on the same node with startup times under five seconds—more than three times the baseline density and a 75% reduction in cost per agent. For latency-sensitive workloads, warm pools deliver sub-second startup while still supporting 133 agents per node.

Red Hat OpenShift 4.22 Brings EVPN to Kubernetes

Red Hat OpenShift 4.22 introduces support for ethernet VPN (EVPN), enabling direct integration between Kubernetes platforms and existing EVPN-VXLAN data center fabrics. This is a significant step for enterprises that have invested in standards-based networking fabrics and want Kubernetes clusters to participate natively rather than sitting behind translation layers.

By leveraging the EVPN control plane, OpenShift can integrate more naturally with existing production networks, enabling consistent Layer 2 and Layer 3 connectivity across cluster boundaries. For operators managing multi-cluster estates in on-premise or hybrid environments, this removes a common friction point: making Kubernetes networking speak the same language as the rest of the data center.

Separately, Red Hat was named a Leader in the 2026 Gartner Magic Quadrant for Cloud-Native Application Platforms for the third consecutive year, a recognition that reflects the maturity of OpenShift as a platform for VMs, containers, and AI workloads.

Core Tooling Updates: Helm, containerd, and etcd

On the tooling front, Helm v4.2.3 shipped on July 9 as the latest patch in the Helm 4.x line, which is now the actively maintained branch. Helm 4.3.0 and 3.22.0 are scheduled for September 9. Operators should note that Helm 3.x is still receiving patch releases in parallel, but new features are landing in 4.x.

containerd published a pre-release of its API v1.12.0-beta.0 on August 5, aligning with the upcoming containerd 2.4 release. Highlights include media type inclusion in content create events and expanded runc checkpoint options. The release also deprecates sandbox task API endpoints for non-runc runtimes, a change that may affect alternative runtime adopters.

etcd v3.7.1 arrived on July 23 with bug fixes and improvements. As always, operators should consult the upgrade guide before moving to a new minor version.

Networking at Scale: k0rdent and Cilium

Mirantis has been highlighting the integration between its k0rdent cluster lifecycle manager and Cilium as a validated approach for large-scale Kubernetes networking. Cilium’s eBPF-powered data plane replaces legacy kube-proxy, yielding shorter data paths and lower CPU overhead. When deployed through k0rdent’s template-driven provisioning, clusters across AWS, Azure, and bare metal initialize with identical Cilium configurations—eliminating snowflake cluster drift.

The combination also brings identity-based security policies that move with workloads rather than being tied to IP addresses, and Hubble-powered observability for real-time service maps across the fleet. For platform teams managing hundreds of clusters, this is a practical path to standardization.

What This Means for Platform Teams

This week’s announcements reinforce a few clear trends. First, Gateway API is becoming the universal standard for Kubernetes networking, and its expansion into Layer 4 means fewer reasons to rely on implementation-specific solutions. Second, AI workloads are driving significant innovation in Kubernetes scheduling and resource efficiency—prefix caching, agent sandboxing, and suspend-resume patterns are not niche features; they are becoming table stakes for production AI platforms. Third, enterprise networking integration remains a priority, with vendors like Red Hat and Mirantis investing heavily in making Kubernetes participate naturally in existing data center fabrics.

For operators, the action items are straightforward: audit any experimental TCPRoute or UDPRoute usage and plan a migration to v1; evaluate prefix-aware routing if you are serving LLMs in production; and if you are running agentic workloads, the cost savings from modern sandboxing and checkpointing primitives are becoming too significant to ignore.