Category

AI

AI

Grafana OpenLIT Operator Enables Zero-Code Observability for AI Workloads on Kubernetes

Grafana has released the OpenLIT Operator, a Kubernetes-native solution for monitoring AI workloads without requiring code changes. The integration with Grafana Clouds AI Observability suite promises automatic instrumentation of LLMs, vector databases, and agent frameworks—addressing a critical gap as AI infrastructure becomes standard in production environments. For organizations struggling to gain visibility into distributed AI […]

AI

vLLM v0.18.0 Ships gRPC Serving, GPU-Less Rendering, and Major KV Cache Improvements

The vLLM project has released version 0.18.0, a substantial update featuring 445 commits from 213 contributors including 61 new contributors. This release significantly expands deployment flexibility for production LLM serving with new protocol support, architectural improvements for multimodal workloads, and substantial enhancements to memory management that directly address operational pain points for large-scale inference deployments. […]

AI

Cloudflare Workers AI Now Runs Large Models: Kimi K2.5 Lands on the Edge

Cloudflare is officially entering the frontier model race with a significant announcement that expands its AI platform beyond small, efficient models into the territory of large-scale open-source LLMs. The company revealed that Workers AI now supports large frontier models, starting with Moonshot AIs Kimi K2.5. This marks a strategic pivot for Workers AI, which has […]