Senior Software Engineer (Streaming)

Join Crusoe's Observability team as a Senior Streaming Software Engineer. In this role, you will design, build, and operate high-throughput streaming systems that process massive volumes of telemetry data. You will work on large-scale data pipelines and distributed systems that power observability across a rapidly scaling AI cloud environment. Your responsibilities will include implementing real-time data processing systems, scaling streaming infrastructure, ensuring system reliability, collaborating with SREs and platform teams, and participating in on-call rotations. You will also have the opportunity to contribute to technical design discussions and reviews for new streaming capabilities.

• Designing, building, and maintaining streaming services and pipelines that ingest and process observability data including logs, metrics, traces, and operational events.
• Implementing real-time data processing systems using technologies such as Kafka, Kinesis, Pub/Sub, Flink, or similar streaming platforms.
• Collaborating with SREs and platform teams to integrate streaming data into internal observability tools and operational workflows.
• Comfort debugging production issues across distributed systems
• Experience building observability platforms at cloud or data center scale
• Solid understanding of observability fundamentals including metrics, logging, tracing, and alerting
• Proficiency in backend languages such as Java, Scala, Go, or Python
• Experience working with bare-metal infrastructure or large-scale data center environments
• Strong collaboration skills and a pragmatic engineering mindset
• Experience operating services in cloud or large-scale infrastructure environments
• Familiarity with stream processing frameworks and delivery semantics
• Ability to own features end-to-end, from design through production operations
• Strong experience building and operating distributed systems, especially streaming or real-time data platforms
• Exposure to schema management, data contracts, or serialization formats
• Hands-on experience with Kafka or similar distributed streaming technologies
• Experience with Kubernetes and containerized infrastructure
• Interest in mentoring junior engineers