Senior Backend Engineer (AI Agents)

Join Level AI as a Senior Backend Engineer specializing in AI Agents. In this role, you will design and build scalable backend systems that power next-generation AI Agents in real-time enterprise environments. You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications, bringing agentic AI capabilities into production at scale. Your responsibilities will include developing agent orchestration frameworks, building systems for agent memory and context management, architecting low-latency inference pipelines, and implementing evaluation frameworks to measure agent performance. You will also collaborate closely with applied AI/ML teams, product and solutions teams, and drive best practices in observability, monitoring, safety, and guardrails for AI systems.

• Design and build scalable backend systems that power AI Agents, ensuring they operate in real-time enterprise environments.
• Develop agent orchestration frameworks, build systems for agent memory, context management, and state persistence across interactions.
• Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services, and implement evaluation frameworks to measure agent performance.
• Strong fundamentals in system design, concurrency, and performance optimization
• Experience designing systems for real-time processing, streaming, or event-driven architectures
• 5+ years of experience in backend engineering, distributed systems, or platform engineering
• Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
• Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
• Strong experience building high-scale, production-grade backend systems
• Strong understanding of API design (REST, gRPC) and microservices architectures
• Experience with real-time decisioning systems or workflow orchestration engines
• Understanding of prompting strategies, context windows, and model behavior optimization
• Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
• Experience building or integrating RAG pipelines, vector databases, or retrieval systems
• Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
• Experience working with LLMs, conversational AI, or AI-powered products in production