Principal Data & Analytics Engineer

Microsoft - Redmond, WA4.2

Full-timeEstimated: $100,000 - $150,000 a year
Microsoft’s cloud business is growing exponentially, and it is the Cloud Supply Chain and Provisioning (CSCP) team that is responsible for enabling the infrastructure underlying this growth. Key responsibilities include demand forecasting, capacity planning, supply chain management, data center build-out, and deployment execution. To efficiently manage this scope at scale, analytics based on high quality, timely data flowing across business processes is essential. The engineering team within CSCP is in the midst of a digital transformation that will enable the business to efficiently scale to meet these needs. Ultimately, we envision inverting the man-machine initiative, whereby predictive and prescriptive analytics anticipate future states, take action, and humans review and oversee this work.

Within CSCP, the Common Platform Engineering Team owns a common data capability to aggregate, transform, and normalize data; provide descriptive and predictive analytics with actionable insights; and provide self-service analytics across the organization. The work involves building out an enterprise wide data warehouse, a data lake, a service bus with common events, data ingestion, data quality tracking, a data catalog, and the creation of predictive analytic models using Azure Machine Learning and other tools. It will require working closely with subject matter experts to understand their information needs, make data accessible with descriptive analytics, and work with them to pragmatically apply the power of predictive analytics.

We are looking for a principal software engineer passionate about transforming information to intelligence; who is experienced with a full range of data engineering skills; and has experience with predictive analytics and applied machine learning. You should have a good track record of working with information workers, understanding their information needs, and be able to implement pragmatic solutions using an iterative, agile approach. You should also have experience mentoring junior developers as a tech lead or dev lead on complex projects.


Build and apply machine learning models to business problems to produce new insights, manage risks, identify opportunities for process optimization, and identify leading indicators of process variations
Define and lead the implementation of a scalable, monitored data architecture for ingesting and transforming both events and data feeds
Design and build a data object learning engine used for automated predictions
Define and lead the implementation of an automated data quality framework and dashboard
Working with others, define enterprise wide data warehouse schemas using normalized, denormalized and multi-dimensional cubes
Extend a data lake which contains structured, unstructured, and semi-structured historical data used for analysis and feature extraction for machine learning
Extend data catalog that makes data sources accessible and used by engineers, analysts, planners and managers throughout the organization

BS in Computer Science or equivalent, MS preferred
7+ years of experience designing and developing software
5+ years of experience with data aggregation platforms such as SQL, Hadoop, Cosmos, etc.
Solid understanding and experience with SQL, relational modeling, and big data tools such as Hive, Scope or Spark - experience with Spark is a plus.
Proficient with C#, test-driven development, refactoring and object-oriented development
Experience designing and developing scalable data ingestion and transformation systems in batch and near real time environments
Experience applying machine learning methods on challenging business problems
Strong problem solving and communication skills
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check every two years.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.