Description
Visa's Data Platforms organization is responsible for the foundational data ecosystem that powers some of the company's most critical business capabilities. As a Senior Data Engineer, you will help design and build platforms that process and manage data at petabyte scale, ensuring it is accessible, reliable, secure, and optimized for a wide range of internal and customer-facing applications.
Key Responsibilities:
- Partner with product managers, architects, and business stakeholders to define requirements and translate business needs into scalable data platform solutions.
- Design, develop, and enhance distributed data processing systems that support Visa's critical payment, settlement, authorization, and analytics workloads.
- Build and maintain high-performance, reliable data pipelines that process and deliver large volumes of data across multiple platforms, products, and business domains.
- Contribute to the evolution of Visa's data platform architecture, data delivery capabilities, and Master Data Management solutions.
- Lead technical design discussions, architecture reviews, and engineering decision-making for complex initiatives.
- Develop clean, scalable, maintainable, and reusable code that adheres to engineering best practices and platform standards.
- Drive improvements in system reliability, observability, automation, performance, and operational excellence.
- Lead code reviews and mentor fellow engineers, fostering a culture of technical excellence and continuous learning.
- Troubleshoot and resolve complex production issues while identifying opportunities to automate manual processes and reduce operational risk.
- Develop comprehensive testing strategies and quality assurance practices to ensure robust and reliable data solutions.
- Collaborate closely with engineers, data scientists, architects, product managers, and platform teams to deliver business-critical capabilities.
- Identify, analyze, and proactively address data quality, performance, scalability, governance, and security challenges.
- Contribute to project planning, estimation, and delivery while balancing business priorities, technical debt, and long-term platform health.
Qualifications:
- 8+ years of relevant work experience with a Bachelor's degree, OR 5+ years of relevant work experience with an Advanced Degree (Master's, MBA, etc.), OR 2+ years of relevant work experience with a PhD. OR 11 years of relevant work experience
- Strong working knowledge of SQL, NoSQL, graph databases, and RESTful APIs.
- Expert-level experience with the Spark framework, Hive-based technologies, and broader Big Data development tools and platforms
- Extensive hands-on programming experience in Java, Scala, or Python, with the ability to quickly develop clean, production-quality prototypes and core application components.
- Demonstrated success leading large-scale, end-to-end projects that deliver measurable business impact, from initial concept through production delivery.
- Strong understanding of algorithms, data structures, and core computer science fundamentals.
- Practical experience with data modeling for both relational and non-relational database systems.
- Demonstrated leadership behaviors, including a positive mindset, quick learning ability, collaboration, courage in leadership, and strong customer obsession.