Senior Data Platform Engineer

Join Craft, a company dedicated to building the future of Enterprise Intelligence. As a Senior Data Engineer, you will be part of the DISCoE team, responsible for defining and implementing data storage standards, optimizing data pipelines, and applying machine learning techniques. You will have the opportunity to work with modern tools and technologies, and enjoy benefits such as unlimited PTO, parental leave, and a flexible work environment.

• Concevoir et mettre en œuvre des normes pour le stockage des données dans Databricks en utilisant une architecture de médaillon.
• Construire et optimiser des pipelines de données (batch et streaming) et extraire, analyser et modéliser des ensembles de données riches et diversifiés.
• Travailler sur des systèmes de traitement des données extensibles qui permettent d'ajouter et de mettre à l'échelle des pipelines.
• CircleCI, GitHub, Terraform
• Python, PySpark, Pandas, SQL (PostgreSQL), Airflow, Docker
• Familiarity with at least some technologies in our current tech stack:
• Databricks & AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS)
• Self-starter, independent, likes to take initiative
• Familiar with infrastructure-as-code approach
• 4+ years of experience in Data Engineering
• 4+ years of experience with Python
• Knowledge of and experience with Amazon Web Services (AWS) and Databricks
• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing
• Strong problem solving and the ability to communicate ideas effectively
• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance and observability of data pipelines in a production environment
• Shows curiosity through asking questions, digging into new technologies, and always trying to grow
• Kind and empathetic with your teammates and others
• Don’t meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!