About The Role

Join our team as a Senior Platform Engineer, where you'll have the opportunity to build the metadata layer that powers the next generation of AI systems at massive scale. Your work will directly impact how thousands of organizations deploy AI, affecting millions of users worldwide. You'll lead the development of DataHub's ingestion framework, creating scalable and fault-tolerant systems for enterprise-scale metadata, clean APIs for our connector ecosystem, and event-driven architectures for real-time metadata processing. This is a remote-friendly position with a range of benefits, including parental leave, medical, dental, and vision insurance, equity, and a monthly co-working space budget.

Lead the development of DataHub's ingestion framework, connecting diverse data systems and powering metadata collection.
Design and implement scalable, fault-tolerant ingestion systems for enterprise-scale metadata, ensuring high performance and reliability.
Collaborate with cross-functional teams to create clean, intuitive APIs for the connector ecosystem and support event-driven architectures.
Advanced Python expertise with a focus on API design
A track record of solving complex technical challenges
Strong systems knowledge and distributed architecture experience
4+ years building production-grade distributed systems
Experience with high-scale data processing or integration frameworks
Early-stage startup experience
Open-source contributions
Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)

This is an external listing. JobSpring does not represent or verify the employer. Report this listing