Top 4 Hadoop Jobs in Webster Ma

Data Engineer- Smithfield, RI
Photon —Smithfield, RI
- $37,000 - $130,000 a year
- Full-time
- Computer science
- 6 years
- Computer Science
- Paid holidays
- Health insurance
DATA AND ANALYTICS ARCHITECT
City of Worcester —Worcester, MA
- $93,232 - $122,661 a year
- Full-time
- Bilingual
- Azure
- Computer Science
6d
Technology Risk Principal Analyst- Data, AI and Emerging Technology
Citizens Financial Group —Johnston, RI
- $138,000 - $200,000 a year
- Full-time
- Background check
- 7 years
- Azure
- Health insurance
- Dental insurance

More jobs to discover

Find similar jobs that you might be interested in.

DATA AND ANALYTICS ARCHITECT
City of Worcester —Worcester, MA
Valid driver’s license and access to reliable transportation. The Data and Analytics Architect will design and implement data models, develop predictive…
$93,232 - $122,661 a year
6d
Data Architect
Vedant Technologies —Boston, MA
Design and develop comprehensive data architecture frameworks that support enterprise-wide data management and analytics initiatives.
$70 - $80 an hour
Quick Apply

Show more similar jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Data Engineer (AWS, Azure, GCP)
CapTech Consulting —Columbus, OH
Experience in the design and implementation of data architecture solutions. Learning & Development – Programs offering certification and tuition support,…
Quick Apply
Software Engineer
OCLC —Dublin, OH
Analyze, design, develop, and test software programs and systems with a focus on search technologies. Bachelor’s degree in Computer Science or a related field.

Show more jobs in cities nearby

I want to receive the latest job alert for hadoop in webster ma

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

hadoop jobs near webster ma

Data Engineer- Smithfield, RI

Photon -
Smithfield, RI

Apply Now

Job Details

Full-time
$37,000 - $130,000 a year

Benefits

Paid holidays
Health insurance
Dental insurance
401(k)
Paid time off
Vision insurance

Qualifications

Performance monitoring
Data integrity assurance
Data model design
Commercial use (data warehousing systems)
Computer science
Cloud analytics services
Server optimization
Data modeling
Data Integration (Data management)
6 years
Computer Science
Data validation techniques
Query plan analysis
Spark
Git
Apache Hive
Scalable systems
Schema design
Information security compliance
Reducing cloud infrastructure costs
ETL process automation
Spark implementation
Bachelor's degree
Data integrity process (data warehousing)
AWS Glue
Airflow
Version control systems
Query execution time improvement
AWS Step Functions
Scalability

Full Job Description

We are seeking a skilled and passionate Data Engineer to join our team and play a vital role in building and maintaining our data infrastructure. The ideal candidate will have extensive experience with AWS cloud services, particularly EMR, and strong proficiency in Spark and PySpark for data processing and transformation. This role will focus on designing, developing, and optimizing data pipelines to support our growing data needs.

Responsibilities:

AWS Data Services:
- Design, implement, and manage data solutions on AWS, leveraging services such as EMR, S3, Glue, and others.
- Optimize AWS data infrastructure for performance, scalability, and cost-effectiveness.
- Implement best practices for data security and compliance on AWS.
Apache Spark & PySpark:
- Develop and maintain scalable data pipelines using Apache Spark and PySpark.
- Perform data extraction, transformation, and loading (ETL/ELT) processes.
- Optimize Spark jobs for performance and efficiency.
- Develop and maintain data quality checks and validation processes.
Amazon EMR:
- Configure and manage EMR clusters for large-scale data processing.
- Troubleshoot and resolve EMR cluster issues.
- Optimize EMR cluster configurations for performance and cost.
- Deploy and monitor spark applications on EMR.
Data Pipeline Development:
- Design and implement robust and reliable data pipelines.
- Automate data ingestion, processing, and storage processes.
- Monitor data pipeline performance and troubleshoot issues.
- Work with various data sources, both structured and unstructured.
Collaboration and Communication:
- Collaborate with data scientists, analysts, and other engineers to understand data requirements.
- Document data pipelines and infrastructure.
- Communicate effectively with technical and non-technical stakeholders.
- Participate in code reviews.
Performance Optimization:
- Analyze query plans and optimize spark jobs.
- Monitor and tune data processing performance.
- Identify and resolve performance bottlenecks.

Qualifications:

Bachelor's degree in Computer Science, Data Science, or a related field (or equivalent experience).
Minimum 6-9 years of experience in a Data Engineering role.
Strong experience with Amazon Web Services (AWS) data services, particularly EMR.
Proficiency in Apache Spark and PySpark for data processing.
Experience with data warehousing and data lake concepts.
Strong SQL skills.
Experience with scripting languages (e.g., Python).
Understanding of data modeling and database design principles.
Experience with version control systems (e.g., Git).
Strong problem-solving and troubleshooting skills.
Excellent communication and collaboration skills.
Experience with other big data technologies (e.g., Hadoop, Hive, Kafka) is a plus.
Experience with data orchestration tools (ie airflow, step functions) is a plus.

Compensation, Benefits and Duration

Minimum Compensation: USD 37,000
Maximum Compensation: USD 130,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post

Apply Now

Refine Your Search

hadoop jobs in webster ma

Data Engineer- Smithfield, RI

DATA AND ANALYTICS ARCHITECT

Technology Risk Principal Analyst- Data, AI and Emerging Technology

More jobs to discover

Explore jobs in cities nearby

I want to receive the latest job alert for hadoop in webster ma

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected