Senior Software Engineer

We are seeking a Senior Software Engineer to join the Data and Insight team in Search Foundation organization. The team leverages open-source technology to process petabyte-scale data of Bing and MSN logs and provide comprehensive insight into experiments.

As a Senior Software Engineer, you will be responsible for building scalable data analytics/insights platforms with PiB level data processing every day. You will work on Bing mission-critical analytical data and support the grounding business, processing at big data scale and generating real-time insights.

Responsibilities:

• Design, build, and own the optimal data processing architecture and systems for new data and analytics pipelines, dashboards, and metrics leveraging Azure and open-source technologies
• Build core datasets as well as scalable and fault-tolerant pipelines
• Build data anomaly detection, data quality checks, and optimize pipelines for ideal compute and storage systems while guaranteeing high-quality and SLA datasets
• Understand data compliance and data governance
• Collaborate with cross-functional partners, including data scientists and product managers, to design and develop end-to-end data assets that help improve our products
• Hands-on experience with at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
• Hands-on experience with data storage technology like HDFS, Azure blob, etc.
• Leverage AI technology in coding/testing/data processing/data validation

Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• OR equivalent experience

Preferred Qualifications:

• 6+ years of experience in one or more coding languages (C#, C++, Java)
• Familiarity with at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
• Experience with cloud environment like Azure
• Experience with data storage technology like HDFS, Azure blob, etc.
• Experience in leveraging AI technology in coding or testing work
• Fluency in verbal and written English communication