The Analytical Systems Engineer will partner with a wide range of business leaders to design and build analytical applications that will drive great value, and make customers really happy. He or She will be responsible for collecting, storing, processing, analyzing large sets of data and building applications and solutions using the data. The primary focus will be on choosing/supporting optimal solutions to use for these purposes, then building, maintaining, implementing, and monitoring them. Also, responsible for assisting with integrating solutions with the architecture used across the company.
Duties and responsibilities
Modeling new data sets and crafting all new ELT workflows and pipelines.
Lead the orchestration of the workflows and contribute strongly to infrastructure decisions.
Leverage big data components to build large scale data processing systems
Maintaining a single version of truth for our data and working with others to implement continuous integration (CI) data quality tests.
Engage in POCs using cloud technologies with emphasis on AWS and/or Azure ecosystem and commonly deployed third-party tools.
Responsible for the hands-on development, deployment and maintenance of a variety of solutions, web service infrastructure and supporting technologies.
Contributes to the detailed analysis and development of data integration components such as software applications, data load processes, data design and database structures.
Assists in troubleshooting software application, data issues and business processes.
Good understanding of data and common metrics.
Troubleshoots technical issues and identify modifications needed in existing applications to meet changing user requirements.
Works closely with project managers, business analysts, and others to understand and translate functional requirements and processes into technical specifications.
Demonstrates accurate and complete understanding of system functionality and technical components.
Possesses strong database, requirements gathering, object-oriented design and development skills.
Produces and writes documentation for the applications including operations, user guide, system design and functional specifications etc.
Synthesizes complex or diverse information, collects and researches data, uses intuition and experience to complement data.
Identifies and resolves problems in a timely manner
Gathers and analyzes information skillfully with the ability to develop alternative solutions
Demonstrated ability to work in group problem solving situations
Bachelors degree is required
Masters degree is preferred
Hands on experience in Apache Spark and Hadoop
Experience in building data driven applications using a combination of Java/Scala and the Spark framework
Ability leveraging big data components (not limited to...Hive, HBASE, Oozie, Kafka etc) to build large scale data processing systems
Expertise in two or more of the programming languages (Java, Spark, Python, Node.js) GitHub is required
Good understanding of NoSQL databases especially DynamoDB & ElasticSearch
Experience scripting within AWS SDK and CLI
Must have strong PL/SQL skills.
Proficient in SQL, Stored Procedures, Functions, Views etc.
Strong understanding of relational database design and related concepts such as referential integrity and normalization
Excellent communication and documentation skills.
2+ years of proven experience working with Apache Spark framework, Hadoop, Java/Scala and AWS architecture.
2+ years of proven experience in Microsoft .Net technologies such as C#, VB.Net and experience in designing, developing and deploying Windows & Web applications
2+ years of experience in database development using PL/SQL and SQL Server 2012 or later or Aurora/Redshift
Experience with SAS, VBA Programming preferred
Experience in designing and developing Extract, Transform and Load (ETL) processes using SQL Server Integration Services (SSIS) or a comparable ETL tool, is desired.