Value of data in business, technology is exploding exponentially every day. Big data, small data, internal, external, experimental, observational — everywhere we look, information is being captured, quantified, and used to make business decisions, improving the products, train the machines. Microsoft is in forefront of this data revolution to make decisions, train the models and learn in all of its product portfolio. Every day, hundreds of millions of people around the world use Skype to make over a billion minutes of calls, Office to create documents, and Bing and Cortana to get answers. Transforming petabytes of data into rich insight would enable us to create smarter, more innovative products. We, Big Data platform team part of Microsoft AI & R Core group are proud to partner with and part of these team’s goals.
We are looking for a seasoned software engineer to join and work on cutting edge near-realtime big data stream processing at scale. Our pipelines interact with Kakfa and process multi-billion dollars of ads revenue with in-line ML feature generation and in-line machine learning for real-time fraud processing. The datasets enable complex ML feedback loops for ML training and online classification. Work on high scale distributed computing platform with 24x7x365 service availability and tight SLA. Understand what it takes to build a platform for distributed database systems. Build first class managed experience for creating and managing streaming data pipelines, plug data quality modules, provide feedback and detect anomalies.
We seek smart, highly innovative experienced engineers to forge the path ahead for big data applications, deep collaboration with Microsoft Research. With our startup-like environment, our engineers dream up new innovations, solve hard scale and engineering challenges, and work as a team to create incredible end-to-end experiences for our users. Our SDKs work on all major client, web, and service platforms. Our platform is modern and self-serve, and offer modern Web experiences. The way we work reflects our modern approach: we are agile and learn constantly. The team is looking for senior leaders with to lead the design and implementation efforts our distributed data application platforms.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.
Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.
Bachelor’s degree or higher in CS or related fields with 2 years of industry experience
industrial experience in designing and developing software systems with modern design principles
Passionate about technology and strong problem solving skills
Self-motivated and self-directed and be able to work constructively with a wide variety of personalities and changing business priorities
Expertise in C#, C++, Java, or equivalent
Experience in Big data processing (Spark, Flink, Kafka) is an added plus.
Experience with agile/scrum methodologies