Description
Joining Razer will place you on a global mission to revolutionize the way the world games. As a Senior Data Extraction Engineer, you will design, develop, and deploy web scraping solutions to collect specific datasets for AI training purposes. You will build robust and scalable web crawlers to extract structured and unstructured data from various online sources.
Responsibilities:
- Design, develop, and deploy web scraping solutions to collect specific datasets for AI training purposes.
- Build robust and scalable web crawlers to extract structured and unstructured data from various online sources.
- Ensure data accuracy, integrity, and compliance with relevant laws and regulations.
- Clean, preprocess, and organize scraped data for use in machine learning models.
- Monitor and optimize crawling performance to ensure efficiency and reliability.
- Collaborate with AI teams to define data requirements and ensure the relevance of collected data.
- Document crawling workflows, tools, and results for future reference.
Requirements:
- Bachelor's or master's degree in computer science, software engineering, or a related field.
- Strong experience with web scraping tools and frameworks (e.g., Scrapy, Selenium, BeautifulSoup).
- Proficiency in programming languages like Python, Java, or Node.js.
- Familiarity with HTTP protocols, HTML parsing, and JSON data formats.
- Knowledge of database systems (SQL, NoSQL) for data storage and management.
- Experience with cloud platforms (e.g., AWS, GCP) and containerization tools (e.g., Docker).
- Strong understanding of web crawling ethics, regulations, and best practices.
- Excellent analytical skills and attention to detail.
Preferred Qualifications:
- Experience with large-scale data scraping and handling distributed crawlers.
- Familiarity with AI and machine learning concepts, especially data preprocessing for AI models.
- Knowledge of browser automation and tools for rendering dynamic content.
- Ability to handle multilingual data and diverse data formats.
This listing is enriched and indexed by YubHub. To apply, use the employer's original posting:
https://razer.wd3.myworkdayjobs.com/en-US/Careers/job/Chengdu/Senior-Data-Extraction-Engineer_JR2025005755