Principal AI Platform Engineer

Join our team as a Principal AI/ML Platform Engineer, where you will be responsible for building the infrastructure that connects AI systems with existing products. You will design, build, and maintain the core infrastructure layer supporting GenAI products, implement secure access controls, and develop observability and monitoring solutions. You will collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks and downstream applications. The ideal candidate will have extensive experience in building and maintaining AI platform infrastructure, Kubernetes, and container security, as well as expertise in observability and monitoring frameworks.

• Design, build, and maintain the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools.
• Implement secure access controls and authentication mechanisms integrated by default into the AI platform components, and develop and manage observability, monitoring, and logging solutions for GenAI workloads.
• Collaborate closely with product and engineering teams to integrate GenAI infrastructure with agent frameworks, and downstream applications, while optimizing infrastructure for scalability, high availability, and cost efficiency.
• Extensive experience building and maintain AI platform infrastructure, Kubernetes, and container security
• Demonstrated expertise in observability, and monitoring frameworks, with a focus on real-time performance (i.e: experience with OpenTelemetry, MLFlow)
• Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs
• Experience with CI/CD pipelines and automation for AI model deployment and platform operations
• Strong knowledge of authentication and authorization frameworks integrated into AI platforms
• Familiarity with vLLM, SGLang or similar framework to host LLM inference workloads