Description
We are seeking a Software Engineer III to help build scalable data integration systems that power our data platform. In this role, you will develop web scraping solutions, API integrations, automated workflows, and microservices that enable efficient collection and processing of data from diverse external sources.
Responsibilities:
- Design, develop, and maintain web scraping applications using technologies such as Puppeteer, Playwright, and Selenium to collect data from external sources.
- Build and support API integration services that reliably retrieve and process data from third-party systems.
- Develop automated workflows for scheduling, monitoring, validation, and error handling of data ingestion processes.
- Design and implement scalable microservices that support data collection and routing within the platform.
- Develop robust backend services and APIs that enable secure and efficient integration with internal and external systems.
- Implement monitoring, logging, alerting, and operational tooling to maintain high service availability.
- Troubleshoot production issues and optimize application performance.
- Partner with product managers, engineers, and stakeholders to deliver effective technical solutions and contribute to code reviews, technical design discussions, documentation, and continuous improvement initiatives.
Requirements:
- Experience building production-grade backend applications, integration systems, or distributed services.
- Strong hands-on experience with Node.js and TypeScript with experience developing and maintaining web scraping solutions using tools such as Puppeteer, Playwright, or Selenium.
- Solid understanding of REST APIs, asynchronous programming, and integration patterns.
- Experience with microservices architecture, service communication, containerization, and deployment patterns.
- Knowledge of cloud platforms such as AWS, Azure, or GCP.
- Experience building automated workflows, scheduling systems, and reliable integration pipelines, Understanding of authentication mechanisms, rate limiting, API security, and error-handling strategies.
- Experience working with databases and data processing systems and Strong debugging, analytical, and problem-solving skills.
- Minimum 2 hours overlap with Pacific Time (PT) OR Minimum 4-5 hours overlap with India Standard Time (IST).
Nice to Have Skills:
- Experience working with diverse data formats such as JSON, XML, CSV, and third-party APIs.
- Knowledge of Infrastructure as Code (Terraform, CloudFormation).
- Experience with workflow orchestration and automation tools.
- Exposure to healthcare, clinical, or regulated data environments.
- Understanding of distributed systems and event-driven architectures.