Data Engineer - Expert

Dark Wolf is seeking an Expert Data Engineer to lead the architectural development, scaling, and governance of enterprise-grade data platforms.

You will be responsible for designing high-throughput data meshes, establishing automated data quality frameworks, optimizing distributed compute clusters, and ensuring high resilience across air-gapped and multi-cloud networks.

Key Responsibilities:

• Lead the architectural design and implementation of distributed, high-throughput batch and streaming data platforms.
• Optimize distributed execution engines (Spark, Trino/Presto) to handle petabyte-scale datasets under strict SLAs.
• Implement Infrastructure as Code (IaC) to provision data platform assets across multi-cloud infrastructure.
• Establish zero-trust security controls, data lineage tools, and automated compliance scanning for regulated data environments.
• Act as a Technical Pod Lead, driving Agile sprint deliverables, establishing technical standards, and mentoring data engineering staff.

Qualifications:

• Clearance: Must be a US Citizen holding an active TS/SCI security clearance with an active Full-Scope Polygraph.
• Education: Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field (Master’s degree preferred).
• Experience: 7-10+ years of data engineering experience.

Technical Competencies:

• Data Processing Frameworks: Expert-level mastery of Apache Spark, Flink, Kafka, Ray, and workflow orchestration engines.
• Database Systems: Deep understanding of distributed systems internals, LSM trees, column-family stores, and lakehouse storage formats (Delta Lake, Apache Iceberg, Apache Hudi).
• Data Modeling: Enterprise data strategy, conceptual-to-physical data modeling, and streaming data schema contracts.
• Programming & Scripting: Mastery of Python, Scala, SQL, and Go for high-performance data platform development.
• Containerization: Advanced Kubernetes cluster management, custom operators for data platforms, and service mesh integration.
• Agile Frameworks: Proven experience acting as a Technical Lead or Scrum Master directing engineering pods.
• Multi-Cloud Architecture: Advanced experience architecting multi-cloud and hybrid cloud data platform solutions (IaC via Terraform).
• Security Scanning Tooling: Deep understanding of DevSecOps pipelines, automated compliance testing, and secret rotation management.

Desired Qualifications:

• Advanced Certifications: AWS Certified Solutions Architect – Professional, CISSP, or Databricks Certified Professional Data Engineer.
• Proven track record architecting data solutions for deployment in air-gapped or high-assurance defense networks.

Target Salary Range: $165,000.00 – $200,000.00 (Commensurate with specialized expertise and technical skillset).