Sr. Data Engineer

Capital One - McLean, VA4.0

McLean 2 (19052), United States of America, McLean, Virginia
At Capital One, we’re building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding.

Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good.

Sr. Data Engineer

As a Capital One Data Engineer, you will be responsible for building generic data pipelines & frameworks using open source tools on public Cloud platforms. The right candidate for this role is someone who is passionate about technology, interact with product owners and technical stakeholders, thrives under pressure, and is hyper-focused on delivering exceptional results with good teamwork skills. The candidate will have the opportunity to influence and interact with fellow technologists beyond his team, influence technology partners across the enterprise and mentors’ junior developers on the team. You’ll bring solid experience in emerging and cutting-edge technologies such as: Spark, Scala/Python, REST, Ansible, NoSQL databases, relational databases, Hadoop, Chef, Jenkins/Maven, and AWS/Cloud Infrastructure to name a few.


Hands-on senior developer with experience working in an Agile environment leveraging advanced engineering practices to deliver scalable solutions
Develop generic data frameworks and data products that maintain the highest availability, performance, and strive for simplicity
Knowledge, passion for and ability to implement data engineering solutions using: AWS, Spark, Scala, Python, Airflow, EMR, Redshift, Athena, Snowflake, ECS, DevOps Automation, Integration, Docker, Build and Deployment Tools
Ability to provide solution architecture to solve complex business problems
Bring a passion to stay on top of tech trends, experiment with and learn new technologies, participate in internal & external technology communities, and mentor other members of the engineering community
Lead the craftsmanship, availability, resilience, and scalability of your solutions
Should have at least 5 years of experience with programming and design of data pipelines using Scala or Python
Basic Qualifications

Bachelor's Degree or military experience
At least 4 years’ experience using Python
At least 4 years’ experience using SQL
At least 3 years of experience designing and implementing solutions using Amazon Web Services
At least 2 years’ experience using Amazon Web Services Elastic MapReduce to process data pipelines
At least 2 years’ experience using Spark to build data pipelines
At least 1 year experience using RedShift or at least 1 year experience using Snowflake
At least 3 years of experience leading software engineering teams in an Agile environment
At least 5 years of experience in data engineering, data management and architectural standards
Preferred Qualifications

Master's Degree
6+ years software development experience
2+ years of experience in Cloud Computing
AWS certification
Experience implementing data pipelines using Airflow
Experience using DMP (Data Management Platform such as Neustar, Adobe Audience Manager or LiveRamp
At this time, Capital One will not sponsor a new applicant for employment authorization for this position.