Staff Machine Learning Engineer

Join Suki, a company dedicated to reducing the administrative burden on doctors through innovative technology. As a Staff Machine Learning Engineer, you will leverage your NLP expertise to enhance our computational infrastructure, improve processes and algorithms, and collaborate with cross-functional teams to address NLP challenges. You will manage and curate large datasets, monitor system performance metrics, and stay updated on NLP advancements. Enjoy full healthcare benefits, unlimited vacation, team building activities, and a supportive work environment.

• Leveraging NLP expertise to enhance computational infrastructure and improve processes and algorithms.
• Managing and curating large datasets, ensuring data quality and relevance for training and evaluation.
• Monitoring and analyzing system performance metrics, identifying areas for optimization and implementing necessary improvements.
• Action oriented: You love to build. You like to ship fast, quickly iterate, and see amazement in users’ eyes
• Expertise: You know how to train models. You understand which models work best, and use LLMs only when necessary. You watch out for recall, accuracy, and precision. In other words, you’ve done this before
• Problem solving: you use data to help point you in the correct direction. You optimize relentlessly, and understand the impact you’re making on the business
• Creativity: You enjoy listening to user feedback and then building products in novel ways. You’re resourceful and enjoy finding alternate paths to success
• Communication: You are a clear communicator and demonstrated consensus-builder
• Confidence: You trust your abilities and you’re ready to push yourself to the next level
• Humility: You’re humble and love working in a team without ego to deliver products
• Adaptability: You thrive in a fast-moving organization that uses light-weight processes and cutting-edge technology to have a huge impact
• Hands-on experience designing and implementing evaluation frameworks for LLM-based systems, including automated evals, human feedback loops, regression testing, and benchmark design
• Strong working knowledge of LLMs, including prompting, orchestration, RAG, context and cost management
• Experience in building and maintaining distributed backend services for ML/AI applications
• Demonstrated end-to-end ownership of delivering at least one AI system to enterprise production, spanning the full workflow from problem framing, data pipelines, and model or agent development, through system integration, deployment, evaluation, monitoring, and continuous iteration
• Strong grasp of CS fundamentals including abstractions, algorithms, probability, data structures and system design
• We don’t necessarily expect to find a candidate that has done everything listed, but you should be able to make a credible case that you’ve done most of it and are ready for the challenge of adding new skills to your resume
• 7+ years in overall software experience, with at least 2+ years focused on shipping AI or machine learning systems to production