Senior Software Engineer

We are seeking a Senior Software Engineer to join the Data and Insight team in Search Foundation organization. The team leverages open-source technology to process petabyte-scale data of Bing and MSN logs and provide comprehensive insight into experiments.

As a Senior Software Engineer, you will be responsible for building scalable data analytics/insights platforms with PiB level data processing every day. You will work on Bing mission-critical analytical data and support the grounding business, processing at big data scale and generating real-time insights.

Responsibilities:

• Design, build, and own the optimal data processing architecture and systems for new data and analytics pipelines, dashboards, and metrics leveraging Azure and open-source technologies.
• Build core datasets as well as scalable and fault-tolerant pipelines.
• Build data anomaly detection, data quality checks, and optimize pipelines for ideal compute and storage systems while guaranteeing high-quality and SLA datasets.
• Understand data compliance and data governance.
• Collaborate with cross-functional partners, including data scientists and product managers, to design and develop end-to-end data assets that help improve our products.
• Hands-on experience with at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub.
• Hands-on experience with data storage technology like HDFS, Azure blob, etc.
• Leverage AI technology in coding/testing/data processing/data validation.

Qualifications:

• Bachelor’s Degree in Computer Science or related technical field AND 4+ years of technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python.
• OR equivalent experience.

Preferred Qualifications:

• 6+ years of experience in one or more coding languages (C#, C++, Java).
• Familiarity with at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub.
• Experience with cloud environment like Azure.
• Experience with data storage technology like HDFS, Azure blob, etc.
• Experience in leveraging AI technology in coding or testing work.
• Fluency in verbal and written English communication.