About this Sr. Principal Mission Engineer role at Clarity Innovations
Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.
Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.
We are committed to delivering cutting-edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people-focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.
Senior Principal Mission Engineer (K8s & Cloud)
Position Overview
The position is for an on-site, cleared Senior Principal Mission Engineer as part of a team of software and platform engineers building a unified, multi-tenant control plane that abstracts away infrastructure differences across AWS, Azure, and on-premises environments. The platform allows application teams to provision secure, isolated Kubernetes clusters and workloads dynamically. The control plane runs Crossplane and Cluster API (CAPI).
As the primary on-site engineer, you will be dedicated to deploying, managing, updating and optimizing our platform’s environments within a classified cloud (e.g., AWS Top Secret Region). In this role, you will ensure the seamless operation of our cloud capabilities, Kubernetes clusters, and API gateway architectures.You will handle localized cloud infrastructure troubleshooting, deploy secure software updates, and provide direct technical consultation and training to the site’s mission users. You will bridge the gap between our remote engineering pipeline and the isolated, classified cloud infrastructure, handling everything from low-level troubleshooting to direct customer engagement and user training.
The ideal candidate is highly independent, capable of driving projects from inception to completion with minimal supervision.
Key Responsibilities
- Classified Cloud Management: Manage and monitor the platform’s cloud-native services, compute instances, virtual networks (VPCs/VNets), and identity policies inside the secure cloud enclave.
- Kubernetes & Workload Integration: Troubleshoot and maintain localized Kubernetes clusters (managed or CAPI-provisioned), ensuring proper integration with ingress API gateways, Cilium network fabrics, and local container registries.
- Updates & Software Delivery: Coordinate and execute complex software and platform updates within air-gapped or restricted-connectivity cloud environments, ensuring minimal disruption to active mission sets.
- Troubleshooting & Cloud Diagnostics: Rapidly isolate and resolve cloud-specific connectivity issues, routing failures, IAM permission deadlocks, and API rate-limiting blocks.
- Customer Engagement & Technical Liaison: Serve as the on-site cloud subject matter expert, guiding the customer through complex environment configurations and managing technical expectations.
- Mission Training & Onboarding: Provide hands-on training, workshops, and documentation to site application developers onboarding their workloads onto the cloud platform.
Qualifications
- Clearance: Active Top Secret / SCI
- Experience: 5+ years of systems engineering experience, with at least 2-3 years specifically focused on architecture and operations within government or classified cloud regions (AWS GovCloud/Secret/Top Secret or Azure Government/Secret).
- Container Orchestration: Solid understanding of Kubernetes architecture, cluster operations, and debugging cloud-native application stacks.
- Cloud Networking & Security: Practical knowledge of cloud routing, secure API gateways, security groups, IAM roles/policies, and cross-domain solution paths.
- Customer-Facing Skills: Strong verbal and written communication skills, with experience defending technical designs to government representatives and training technical end-users.
Preferred Qualifications
- Live-Production Incident Response: Hands-on experience managing incident response lifecycles and resolving critical control-plane or etcd failures within live, high-scale production systems.
- Telemetry-Driven Debugging: Advanced capability in utilizing telemetry, API server audit logs, distributed tracing, and metrics to perform root-cause analysis and resolve complex issues in live production environments.
Salary Range: $100,000 - $330,000