Description:
The Data Engineer is responsible for designing, building, and maintaining the data pipelines, models, and storage systems that power analytics, reporting, and AI-driven solutions across the logistics lifecycle. This role ensures data from TMS, WMS, ERP, CRM, carrier integrations, and customer systems is accurate, accessible, well-structured, and ready for insight generation. The ideal candidate understands how logistics businesses operate and has hands-on experience building scalable data lake and data warehouse architectures.
Essential Duties and Responsibilities
Data Modeling & Data Architecture
-
Design, build, and maintain dimensional and relational data models optimized for logistics workflows (shipments, quotes, invoices, routings, tracking events, carrier performance, etc.)
-
Define data standards, naming conventions, and schema documentation to ensure consistency across the enterprise
-
Align data warehouse structures with operations, finance, sales, and compliance reporting needs
-
Work with outsourced development teams
Data Pipeline Development
-
Develop scalable ETL/ELT pipelines to ingest data from:
-
Transportation Management Systems (e.g., CargoWise, Magaya, MercuryGate, Descartes)
-
Warehouse systems, yard systems, and barcode/RFID sources
-
Carrier EDI/API feeds (air, ocean, LTL, TL, parcel)
-
Customer integrations (via API, FTP, SFTP, VAN, SCAC matching, etc.)
-
Implement automated workflows to ensure near-real-time visibility and reliable data refresh cycles
Data Lake & Data Warehouse Ownership
-
Manage cloud data lake storage layers (raw, refined, curated zones)
-
Design and optimize data warehouse schemas for analytics and BI consumption
-
Implement partitioning, indexing, compression, and performance tuning strategies
Data Quality & Governance
-
Develop automated data validation, error handling, audit, and reconciliation processes
-
Ensure data integrity and traceability across ingestion, transformation, and publishing layers
-
Work with compliance teams to align data handling with ITAR, CMMC, CTPAT, ITAR, SOC2, GDPR, and customer contractual requirements
Cross-Functional Collaboration
-
Partner with data analysts, BI developers, AI/ML engineers, and product teams to support dashboards, operational insights, and predictive analytics use cases
-
Work with business teams (operations, finance, sales, customer service) to translate business rules into data logic
-
Provide technical guidance on data availability, meaning, lineage, and usage best practices
Other duties as assigned
Requirements:
Qualifications & Skill Requirements
-
Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field
-
3+ years of direct experience building data pipelines in production environments within transportation, logistics, or supply chain industries
-
Strong experience with:
-
SQL, Python, and ETL/ELT frameworks
-
Cloud data platforms (AWS, Azure, or GCP)
-
Data warehouse technologies (Snowflake, Redshift, BigQuery, Synapse, or PostgreSQL)
-
Data lake architecture patterns (object storage, Delta/Iceberg/Hudi formats, metadata management)
-
Familiarity with logistics or supply chain systems and data structures
-
Preferred experience with:
-
TMS/WMS system databases (CargoWise, Magaya, WorldTrak, Descartes, MercuryGate, SAP TM, Manhattan, Blue Yonder, etc.)
-
integrating EDI (X12, EDIFACT), API-driven vendors, or telematics data
-
understanding of shipment lifecycle events, cost allocation, and carrier/payables workflows
-
Exposure to MDM, data cataloging, or data governance frameworks
-
Advanced skills with Microsoft Office products (with an emphasis on Word, PPT and Excel)
Key Competencies
-
Strong system thinking and architectural leadership
-
Strong Troubleshooting & Data Integrity Mindset
-
Continuous Improvement & Optimization Focus
-
Lead by example, a highly motivated team player with an outgoing and positive work attitude
-
Strong problem-solving, negotiation, and decision-making skills
-
Ability to work in a time-sensitive environment
-
Desire and drive to learn and grow
-
Well organized, able to plan and effectively set priorities for implementation
-
Ability to be flexible as priorities shift
-
Demonstrated ability to work in a client centric environment
-
Ability to relate to and successfully interact across a variety of settings and work well with a broad and diverse workforce throughout the organization
-
Outstanding communication skills - Excellent verbal and written with an emphasis on listening
-
Understanding and responsive to situations that require a sense of urgency
-
Consistent in follow-up and follow-through
-
Credible with a high level of personal integrity
-
Adaptive to ICAT’s core values
Supervisory Responsibilities: No direct supervision but lead project teams
Salary Range: $68,510 - $80,600
