Spark Technical Lead

ervice provider (AWS, Azure, GCP) and familiarity with containerization technologies (Docker, Kubernetes)

• Concevoir de nouvelles fonctionnalités pour l'expérience d'ingénierie des données de Cloudera et diriger une équipe pour les livrer en production à grande échelle.
• Contribuer à Apache Spark et Livy, développer de nouvelles fonctionnalités en Scala/Java/Python sur des plateformes modernes.
• Acquérir une expertise dans le traitement des données distribuées, des planificateurs SQL et des formats de table comme Apache Parquet et Iceberg.
• Bsc/Msc in related field or equivalent experience
• Strong ability to research and solve problems independently without constant supervision
• Passionate about programming, clean coding habits, attention to detail, and focus on quality
• Experience leading and delivering complex product enhancements
• We use Java/Scala/Python in projects, you should have a strong understanding of at least one of the following languages: Java, Scala, Python. And interested to learn the languages we’re using
• Strong oral and written communication skills
• 6+ years professional software development
• Experience with systems design, development
• (Most importantly) Open-minded, desire to learn new things and build great products
• Experience with distributed systems
• Experience with SQL planners
• Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling
• Experience with using/developing Apache Spark, Livy or other related technologies
• Solid experience with at least one cloud s