Description
Samsara is seeking a Data Engineer to join its Data team, comprising Data Scientists, Data Analysts, and Data Engineers. The Data Engineer will design and maintain data pipelines using SparkSQL and PySpark within the central data lake. The pipelines will ingest and transform source data from IoT devices and software products into the core data model, facilitating statistical analysis, model training, and dashboard creation.
Responsibilities:
- Build and maintain highly reliable computed tables, incorporating data from various sources
- Access, manipulate, and integrate external datasets with internal data
- Deliver high-quality data with strong uptime and reliability requirements
- Collaborate closely with cross-functional teams such as Data Science & Analytics, AI/ML, and other Data Engineers
- Champion Samsara's cultural principles
Requirements:
- BA/MS degree in Computer Science, Statistics, or a related discipline
- 4+ years experience in a data engineering-focused role
- Demonstrated experience in designing data models at scale
- Proficiency in building ETL pipelines to handle large volumes of data
- Experience with Spark-based data platforms
- Strong command of SQL, Python, and working with REST APIs
- Familiarity with software engineering fundamentals and reading backend development code
- Experience with version control systems such as Git/GitHub
Nice to have:
- Familiarity with time series data and late-arriving data
- Knowledge of Databricks, Delta Lakes, and Dagster
- Previous experience working in a public cloud (e.g., AWS, GCP, Azure)
- Exposure working on a data model for a product's first-party data
- Exposure to complex data, including ML outputs and/or client-side signals