Description
Leidos has an exciting opportunity for an ETL Developer in our Intel Security Sector's Analysis Solutions Business Area.
We have an immediate need for an ETL developer to play a pivotal role in shaping and implementing cutting-edge data flow solutions centred around Apache NiFi. The successful candidate will provide technical expertise and support in the design, development, implementation, and testing of customer tools and applications in support of Extracting, Transforming, and Loading (ETL) of data into an enterprise Data Lake.
Primary Responsibilities:
- Building complex NiFi data pipeline design: Develop and implement enterprise-level ETL NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
- Performance optimisation and tuning: Optimise NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.
- Troubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.
- Integrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating familiarity in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS).
- Follow best practices and standards: Follow established best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.
- Documentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations.
- Collaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions.
Basic Qualifications:
- Direct experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.
- Experience in programming languages like Java and/or Python and scripting for automation.
- Experience writing and optimising complex queries, along with experience in interacting with relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
- Experience with real-time streaming, and API integration (REST) for seamless data connectivity.
- Experience with cloud platforms like AWS, Azure, or OCI and related data services.
- Ability to analyse complex data challenges, identify root causes, and implement effective solutions.
- Ability to collaborate effectively with cross-functional teams and articulate technical concepts clearly.
- Bachelor’s degree with 4 or more years of prior relevant experience or Master’s degree with 2 or more years of relevant experience. Will consider experience in lieu of a degree.
- To be considered must have an active TS/SCI with polygraph security clearance.
Benefits: Leidos offers competitive benefits, including Paid Time Off, 11 paid Holidays, 401K with a 6% company match and immediate vesting, Flexible Schedules, Discounted Stock Purchase Plans, Technical Upskilling, Education and Training Support, Parental Paid Leave, and much more.