About this Data Engineer role at Clarity Innovations
Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.
Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.
We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.
Data Engineer
Mid/Senior Level
Position Overview
DANDIE (Data Acquisition Network for Delivery, Ingestion and Exploitation) is a new program that will serve as the strategic data platform designed to streamline the procurement, onboarding, consumption, and offboarding of CAI / PAI datasets as a reliable enabler of OCO missions. Built on OSS, COTS, and GOTS components and deployed on Kubernetes, DANDIE will support batch, streaming, and QiP cross-domain data workflows and gearing up to become the enterprise data hub for Cyber Command.
In this role, you will contribute directly to the success of the DANDIE platform by applying your expertise to a mission-critical problem space. You will work alongside product, engineering, data, platform, and security teams to deliver scalable, secure capabilities aligned with mission priorities.
Key Responsibilities
- Design and build scalable, fault-tolerant pipelines to ingest data from diverse internal and external sources and transport it through multiple enclaves
- Implement schema validation, transformation, enrichment, and error handling mechanisms
- Collaborate with platform, data, security, DevSecOps and CDS engineers to ensure end-to-end data flow reliability
- Troubleshoot and resolve defects across distributed systems and ingestion pipelines
Minimum Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
- Professional data engineering experience in a real-world team environment. 4+ years for mid level and 7+ years for senior level.
- Strong experience with Spark and SQL.
- Experience with two other major data processing frameworks (e.g., Kafka, NiFi, Airflow, Trino etc.)
- Experience with lakehouse architecture
- TS/SCI clearance preferred; must be eligible to obtain TS/SCI with CI Poly within 6 months of hire. U.S. citizenship required
Nice to Have Skills
- Experience with Cross Domain Solutions (CDS) or secure data transfer patterns
- Experience working in Kubernetes environments
- Experience working with APIs, microservices, and distributed systems
- Experience supporting systems in regulated or DoD environments
Work Environment
- Government program environment
- Must be located in the DMV area (DC, MD, VA)
- Hybrid schedule with on-site support expected (minimum 2 days per week)
