Data Engineer

Twitter - San Francisco, CA3.9

30+ days agoFull-timeEstimated: $130,000 - $160,000 a year
Skills
Who we are:
The Product Insights and Experimentation (PIE) team builds world-class data engineering products. We make user behavior visible and clear in order to enable great product decision making. The team’s most important roles are to enable fast, rigorous product experimentation and to provide automated tools to generate insights and understanding of our users.

Responsible for experimentation (A/B testing) methodology and implementation
Understanding user behavior with great visualization and analysis tools

Twitter has a very data-driven culture and experimentation is at the center of product decisions. PIE engineers regularly participate in discussions with the most senior leaders at Twitter to understand how experimentation can further increase the rate of innovation. PIE does its work with a combination of scalable open-source technologies including Hadoop, Presto, Spark just to name a few. We also like pie.

Who you are:
You want to be part of a community of the most talented, forward-thinking engineers in the industry. Learning, working with, and contributing to useful open-source projects excites you. Experience with Hadoop, Spark, Hive, Scalding, Parquet, or similar technologies is a strong asset. You have experience in front-end web technologies such as React, AngularJS and Javascript. You love to write code and have notable skill in Java, Scala, C++ or another major compiled language. You likely have experience in distributed systems, databases, networking fundamentals, or performance analysis.

You have the following skills and experience:
You’ve shipped a major project from inception to production
Experience debugging in a data-heavy environment (Hadoop, Spark, etc).
Building and maintaining testable, reliable products

You care about people:
You have fundamental respect for all people
You are in awe of the ability to understand and help 100s of millions of people
You are kind, collaborative, inclusive and self-aware

Bonus points:
Real-time data pipelines
Statistics background or experience with controlled experiments
Functional programming experience or interest
Experience with fullstack development in web applications (including front-end visualization)

Diverse Team:
Product Insights and Experimentation is diverse and we value that. We are not looking for people who fit some historical Silicon Valley mold. We want to maintain and increase our diversity so whoever you are and wherever you come from, if you are a great engineer we would be honored if you applied.

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.