Description
At Ford Motor Company, we're looking for a skilled Full Stack Data Engineer to join our Global Data Insight & Analytics team. As a Full Stack Data Engineer, you will spearhead the design, development, and maintenance of scalable data ingestion and curation pipelines from diverse sources. You will ensure data is standardized, high-quality, and optimized for analytical use. You will leverage cutting-edge tools and technologies, including Python, SQL, and DBT/Dataform, to build robust and efficient data pipelines.
You will utilize your full-stack skills to contribute to seamless end-to-end development, ensuring smooth and reliable data flow from source to insight. You will leverage your deep expertise in GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.) to build and manage data platforms that not only meet but exceed business needs and expectations.
You will implement and manage robust data governance policies, access controls, and security best practices, fully utilizing GCP's native security features to protect sensitive data. You will employ Astronomer and Terraform for efficient data workflow management and cloud infrastructure provisioning, championing best practices in Infrastructure as Code (IaC).
You will continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions, ensuring optimal resource utilization and cost-effectiveness. You will collaborate effectively with data architects, application architects, service owners, and cross-functional teams to define and promote best practices, design patterns, and frameworks for cloud data engineering.
You will proactively automate data platform processes to enhance reliability, improve data quality, minimize manual intervention, and drive operational efficiency. You will clearly and transparently communicate complex technical decisions to both technical and non-technical stakeholders, fostering understanding and alignment.
You will stay ahead of the curve by continuously learning about industry trends and emerging technologies, proactively identifying opportunities to improve our data platform and enhance our capabilities. You will translate complex business requirements into optimized data asset designs and efficient code, ensuring that our data solutions directly contribute to business goals.
You will develop comprehensive documentation for data engineering processes, promoting knowledge sharing, facilitating collaboration, and ensuring long-term system maintainability.