Mission Summary
We are seeking a Senior Engineer to join our ML Data Services team and help us build and improve data infrastructure for Autonomy ML teams. As a Senior Engineer, you will be responsible for building scalable microservices, APIs, and tooling to support Autonomy labeling needs. You will also help architect and implement scalable pipelines to process terabytes of data and deliver datasets for ML training and evaluation.
What you'll be doing:
- Design and implement Restful APIs and microservices for data labeling and annotations
- Architect, build and maintain scalable data processing pipelines with cloud ETL technology to deliver datasets for Autonomy teams
- Design and implement a data linter framework to monitor and improve data quality
- Work closely with leadership and stakeholders to define objectives, align timelines, agree on key deliverables, and build the execution plan
What we're looking for:
- 5+ years of software development experience with Python or Java
- 5+ years of web backend development experience with REST APIs and microservices
- 3+ years of AWS cloud experience (e.g., DynamoDB, API Gateway, EKS, Lambda, OpenSearch, Redshift, S3)
- 3+ years of data engineering experience with Airflow or AWS Step Functions
- Strong written and oral communication skills
- Experience working in cross-functional development teams
- Ability to mentor junior engineers
- BS or MS in Computer Science or related field
Bonus points (not required):
- Hands-on experience with using Ray or Spark in a large-scale environment
- Web backend development experience with .NET and C#
- Autonomous driving industry experience