Senior Data Engineer

Join Windfall, a company on a mission to change how organizations perceive and use people data. As a Senior Data Engineer, you will build the core data asset that everything else at Windfall is built on. You will work closely with product, data science, and other engineering teams, and will be responsible for designing and building pipelines for massive datasets. You will use technologies such as GCP, Java, Python, Kotlin, BigQuery, Postgres, Scylla/Cassandra, Dataflow, Apache Spark, and Airflow. Benefits include medical, dental, and vision coverage, retirement benefits, commuter benefits, paid time off, paid sick and volunteer days, paid parental leave, floating holidays, stock options, a fully-stocked kitchen, a pet-friendly office, and remote work options.

• Construire des pipelines de données pour ingérer et fusionner des milliards d'entités individuelles dans l'actif de données central de Windfall.
• Collaborer étroitement avec l'équipe de science des données pour exécuter des modèles d'apprentissage automatique sur des milliards de points de données.
• Concevoir et construire des pipelines pour des ensembles de données massifs, en les menant de l'inception à l'exploration, à la production et à l'utilisation par les clients.
• Familiarity with different datastores, their differences, and appropriate usages
• Expert knowledge of distributed data processing
• Significant experience working with Apache Beam/Spark/Flink or MapReduce
• You are comfortable making trade-offs between quality, complexity, and speed-of-delivery
• You can simplify complex problems into simple solutions
• You communicate as well as you code
• Experience at a sub-200 person company
• You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
• Strong Object-oriented programming ability in a JVM language
• 4-8 years of professional data engineering experience
• Proven experience taking a large project from ideation to production
• Working knowledge of cloud-native data engineering infrastructure
• Experience leading greenfield projects