- System Design
Upstart is founded on the notion that AI and alternative data can help drive better decision making in lending. As a data engineer, you will work on providing the infrastructure for data scientists and business stakeholders to leverage data to make good decisions. This is paramount to accomplishing our mission of enabling effortless credit based on true risk.
We're looking for curious and humble team members driven by a desire to move quickly and build robust systems that improve people's lives. In this role you will enjoy significant autonomy and will have a clear understanding of how your efforts are important to Upstart's continued success.
Python, Kafka, Avro, Spark, Kubernetes, Docker, Bash, AWS, Airflow
Design and implement streaming and batch ETL pipelines supporting both internal and external data sources.
Code for reliability by leveraging unit tests, integration tests, and robust alerting.
Build and maintain relationships with data scientists and other engineers to understand and meet their evolving data requirements.
Provide guidance/mentorship to junior data engineers via code reviews and during system design.
Provide production support for all DE processes.
Have 5+ year(s) of experience as a Data Engineer.
Are fluent with Python and OOP concepts.
Have experience writing unit tests.
Have experience with ETL for service-oriented architectures.
Have experience delivering on requirements in an agile environment.
Then we'd love to hear from you!