Cloud-native AI infrastructure · Kubernetes · LLM inference & KV cache
- Fluid (CNCF) — CacheRuntime, LLM KV cache orchestration (Mooncake), validation webhooks
- AIBrix — controllers and webhooks for GenAI inference infrastructure
- Kthena (Volcano) — model-serving router
- Kubeflow Trainer — distributed training on Kubernetes

