Position Summary
Seeking a highly skilled Data Engineer / Architect III to support enterprise-scale data integration and platform optimization initiatives focused on the Cloudera ecosystem and Apache NiFi. This role is responsible for evaluating, optimizing, modernizing, and operationalizing existing NiFi-based data integration platforms while serving as both a hands-on engineer and a technical advisor.
The ideal candidate will possess strong experience with Apache NiFi, ETL/ELT pipelines, Python automation, Linux environments, and distributed systems.
Employment Type: W2 – Full Time
Location: Cincinnati, Ohio (Hybrid)
Contract Duration :12 Months
Visa Requirement: Permanent Residents Only (Green Card Holders)
Deadline to apply: June 4, 2026
Key Responsibilities
Apache NiFi Platform Engineering
-
Assess and optimize existing Apache NiFi and Cloudera environments.
-
Review:
-
Processor Configurations
-
Queue Management
-
Flow Prioritization
-
Back Pressure Settings
-
Clustering Strategies
-
Improve platform scalability, reliability, and operational efficiency.
-
Establish reusable design standards and governance practices.
ETL / ELT Pipeline Development
-
Design, develop, optimize, and support enterprise ETL/ELT pipelines.
-
Integrate data from:
-
Relational Databases
-
APIs
-
Streaming Platforms
-
Cloud Storage
-
Distributed File Systems
-
Support batch and real-time data ingestion.
-
Resolve:
-
Pipeline Failures
-
Data Latency Issues
-
Throughput Bottlenecks
-
Operational Instability
Python Automation
-
Develop Python-based automation and transformation scripts.
-
Build integrations between NiFi and external systems.
-
Automate deployment, validation, monitoring, and operational support processes.
-
Support custom orchestration and processing logic.
Governance & Security
-
Implement enterprise security standards including:
-
Authentication
-
Authorization
-
Encryption
-
RBAC Controls
-
Secure Data Movement
-
Support deployment procedures and operational runbooks.
-
Assist with version control and CI/CD processes.
Advisory & Collaboration
-
Serve as a technical advisor for platform modernization initiatives.
-
Document:
-
Architecture Recommendations
-
Operational Procedures
-
Knowledge Transfer Materials
-
Optimization Findings
-
Collaborate with:
-
Data Engineers
-
Architects
-
DevOps Teams
-
Infrastructure Teams
-
Analytics Teams
-
Application Teams
Technical Environment
Data Integration & Processing
-
Apache NiFi
-
ETL / ELT Pipelines
-
Data Integration Platforms
Programming
Infrastructure
-
Linux
-
Distributed Systems
Big Data & Cloudera
DevOps
Architecture
-
Cloud & Hybrid Environments
What Success Looks Like
-
Improve performance and reliability of enterprise NiFi environments.
-
Optimize large-scale ETL/ELT pipelines.
-
Reduce operational overhead through automation.
-
Establish reusable platform standards and governance practices.
-
Deliver scalable and maintainable data integration solutions.
-
Support long-term platform modernization initiatives.
Ideal Candidate Profile
The ideal candidate will:
-
Have strong hands-on Apache NiFi experience in enterprise production environments.
-
Be highly skilled in ETL/ELT architecture and optimization.
-
Possess advanced Python scripting expertise.
-
Have strong Linux and distributed systems knowledge.
-
Demonstrate excellent troubleshooting and root cause analysis capabilities.
-
Be comfortable working independently and advising technical teams.
-
Balance architecture strategy with operational execution.
Required Skills
-
Apache NiFi (Production Environment)
-
Cloudera Ecosystem
-
ETL / ELT Development
-
Python Scripting & Automation
-
Linux Administration
-
Distributed Systems
-
Data Pipeline Optimization
-
Data Integration
-
Monitoring & Operational Support
-
Root Cause Analysis
-
Secure Data Movement & Governance
Preferred Skills
-
Apache Kafka
-
Hive
-
HDFS
-
Iceberg
-
CI/CD Pipelines
-
Cloud & Hybrid Architectures
-
Enterprise Data Governance
-
Reusable Integration Frameworks
-
Distributed Systems Performance Tuning
Compensation & Benefits
-
Medical, Dental & Vision Insurance
-
401(k)
-
Paid Time Off
-
Professional Development Opportunities
-
Additional Benefits Package
Important Notes
✔ W2 Only
✔ Green Card Holders Only
✔ Hybrid Role – Cincinnati, OH
✔ Strong Apache NiFi Experience Required
✔ Python & Linux Expertise Required
✔ Data Engineering / Platform Optimization Focus
