Description
We are seeking a highly motivated Hadoop Engineer with strong programming skills and hands-on experience in Big Data platforms on cloud. The ideal candidate will be responsible for supporting, maintaining, automating, and enhancing large-scale Hadoop and cloud-based ecosystems and contributing to software development initiatives.
This Sr. Software Engineer role is for an individual with excellent software engineering with hands-on development experience and a strong foundation in computer science, full-stack development and AI/ML technologies. This role involves software initiatives, leveraging modern programming languages, cloud platforms, APIs and Generative AI to deliver scalable, high-quality business solutions.
Key responsibilities:
- Perform engineering and administration duties for Big Data platforms built on open-source technologies such as Hadoop, Spark, and HBase
- Design, develop, and implement automation solutions, tools and products to improve operational efficiency, platform reliability, and system scalability
- Managing AWS Big Data Cluster
- Write clean, efficient, and maintainable code based on business and technical requirements, and support the testing, deployment, and validation of software solutions
- Build and enhance front‑end applications using HTML, CSS, JavaScript, and SQL, applying strong UI/UX principles
- Develop and maintain back‑end services using Python, Java, and related technologies, including API design and integration
- Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation
- Collaborate with cross‑functional teams to translate business requirements into efficient technical solutions and tools
Qualifications:
- Bachelor's degree, 3+ years of relevant work experience
- 2+ year of experience with Big Data technologies (Hadoop, Spark) is required
- Expertise in one or more programming languages Python or Java required
Preferred Qualifications:
- Hands-on experience in software engineering with strong coding skills
- Experience with cloud platforms preferably AWS, GCP and Databricks
- AWS experience with big-data services such as AWS EMR plus cloud fundamentals (networking, IAM/security, observability)
- Experience cloud migration from on-prem to cloud would be strong plus
- Experience with AWS operational tooling (e.g.,CloudWatch/CloudTrail/SNS) and automation (e.g., CloudFormation) is a plus
- Solid foundation in computer science fundamentals and data structures
- Proficiency in programming languages such as Python or JAVA and relevant AI libraries such as TensorFlow, PyTorch, etc.
- Strong experience developing front-end (HTML, CSS, JavaScript) and back-end services
- Demonstrated use of Generative AI in development and testing workflows
- Experience with LLMs and frameworks such as LangChain or LangGraph
- Working knowledge of Linux fundamentals and system concepts (CPU, memory, storage, networking)