Enterprise AI platform · 2025 –

Three-Plane Enterprise Agent Platform

Senior AI Engineer, Platform

Challenge

The organization needed an enterprise-grade foundation for multi-tenant AI agents: marketplace and identity on one plane, LLM/RAG/memory on another, tool routing and workflow execution on a third. Planes had to stay decoupled so isolation, releases, and onboarding did not break.

Approach

• Designed a three-plane architecture: control plane (marketplace, identity, agent catalog), data plane (LLM gateway, RAG service, memory), execution plane (API gateway, MCP/tool routing, Temporal workflow workers, agent runtimes).
• Standardized delivery on GKE, Helm, and GitOps across environments.
• Defined MCP and gateway routing patterns so tools and agents compose without bypassing tenant or auth boundaries.

Tech stack

TypeScript · Fastify · Temporal · Prisma · MCP · Kubernetes · Helm · GitOps · GCP (GKE) · Postgres · OIDC/JWT

Outcomes

• Clear plane boundaries for independent scaling and safer releases
• Multi-tenant enterprise agents deployable on Kubernetes with environment promotion via GitOps
• Foundation for RAG, evaluation, and customer workflow programs on a single platform

Context

Internal platform serving multiple enterprise customer programs on shared infrastructure.