Senior Data Engineer

Join SpyCloud as a Senior Data Engineer, where you will lead the architectural transformation of our data systems. You will modernize our data platform, build and optimize data pipelines, and design systems for machine learning applications. This is a hands-on, strategic leadership role that will shape the future of data at SpyCloud.

• Redesign and modernize data architecture for scalability, performance, and AI-readiness.
• Build and optimize real-time and batch data pipelines using AWS tools (e.g, Lambda, S3, DynamoDB, ECS, EKS, Terraform).
• Guide and mentor data engineers, championing best practices and technical excellence.
• Practical experience using DynamoDB and other AWS-native data services at scale
• 8+ years of experience in data engineering or closely related disciplines
• 2+ years in a technical leadership or senior engineering role
• Strong development skills in Python, especially in building data-intensive systems
• Effective communication and collaboration across technical and non-technical stakeholders
• Experience building and managing large Elasticsearch/Opensearch data stores
• Hands-on experience preparing and managing data for machine learning and LLM workflows
• Proven ability to mentor and grow engineering talent and lead large-scale initiatives
• Experience building and operating Lakehouse, Databricks, or large-scale distributed data lake architectures in AWS
• Hands on experience building ETL scripts
• Knowledge of distributed systems as it pertains to data storage and computing
• Familiarity with AI/ML tools such as SageMaker, LangChain, or vector databases
• Understanding of data governance, privacy, and compliance in AI contexts
• Comfort working in fast-paced environments with evolving product and technical requirements
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related STEM field
• C programming language experience
• Go programming language experience
• Experience with password cracking tools