# Hadoop Engineer

**Company**: Visa
**Location**: Bengaluru, IN
**Work arrangement**: hybrid
**Experience**: senior
**Job type**: full-time
**Category**: Engineering
**Industry**: Technology

**Apply**: https://visa.wd5.myworkdayjobs.com/en-US/Visa/job/IN---Bengaluru-India/Sr-SW-Engineer_REF089082W?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply
**Canonical**: https://yubhub.co/jobs/job_4e136ca7-457

## Description

We are seeking a highly motivated Hadoop Engineer with strong programming skills and hands-on experience in Big Data platforms on cloud. The ideal candidate will be responsible for supporting, maintaining, automating, and enhancing large-scale Hadoop and cloud-based ecosystems and contributing to software development initiatives.

This Sr. Software Engineer role is for an individual with excellent software engineering with hands-on development experience and a strong foundation in computer science, full-stack development and AI/ML technologies. This role involves software initiatives, leveraging modern programming languages, cloud platforms, APIs and Generative AI to deliver scalable, high-quality business solutions.

Key responsibilities:

- Perform engineering and administration duties for Big Data platforms built on open-source technologies such as Hadoop, Spark, and HBase

- Design, develop, and implement automation solutions, tools and products to improve operational efficiency, platform reliability, and system scalability

- Managing AWS Big Data Cluster

- Write clean, efficient, and maintainable code based on business and technical requirements, and support the testing, deployment, and validation of software solutions

- Build and enhance front‑end applications using HTML, CSS, JavaScript, and SQL, applying strong UI/UX principles

- Develop and maintain back‑end services using Python, Java, and related technologies, including API design and integration

- Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation

- Collaborate with cross‑functional teams to translate business requirements into efficient technical solutions and tools

Qualifications:

- Bachelor's degree, 3+ years of relevant work experience

- 2+ year of experience with Big Data technologies (Hadoop, Spark) is required

- Expertise in one or more programming languages Python or Java required

Preferred Qualifications:

- Hands-on experience in software engineering with strong coding skills

- Experience with cloud platforms preferably AWS, GCP and Databricks

- AWS experience with big-data services such as AWS EMR plus cloud fundamentals (networking, IAM/security, observability)

- Experience cloud migration from on-prem to cloud would be strong plus

- Experience with AWS operational tooling (e.g.,CloudWatch/CloudTrail/SNS) and automation (e.g., CloudFormation) is a plus

- Solid foundation in computer science fundamentals and data structures

- Proficiency in programming languages such as Python or JAVA and relevant AI libraries such as TensorFlow, PyTorch, etc.

- Strong experience developing front-end (HTML, CSS, JavaScript) and back-end services

- Demonstrated use of Generative AI in development and testing workflows

- Experience with LLMs and frameworks such as LangChain or LangGraph

- Working knowledge of Linux fundamentals and system concepts (CPU, memory, storage, networking)

## Skills

### Required
- Hadoop
- Spark
- Python
- Java
- Big Data
- Cloud
- Generative AI

### Nice to have
- AWS
- GCP
- Databricks
- TensorFlow
- PyTorch
- LangChain
- LangGraph

---

Source: [Apply at visa.wd5.myworkdayjobs.com](https://visa.wd5.myworkdayjobs.com/en-US/Visa/job/IN---Bengaluru-India/Sr-SW-Engineer_REF089082W?utm_source=yubhub.co&utm_medium=jobs_feed&utm_campaign=apply)