Über diese Staff Engineer, AI Operations & Governance, Workplace AI (R5428) Stelle bei Shieldai
Shieldai · Remote · Remote
Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
This is a deeply technical individual contributor role reporting to the Head of AI Operations & Governance (Enterprise AI). This person will own significant portions of the technical operating load for workplace AI: platform configuration, connector and integration management, observability wiring, secrets and access hygiene, model/prompt lifecycle mechanics, and hands-on changes in production.
At the same time, the role will help translate production realities into governance artifacts, risk assessments, status updates, and training/enablement support — giving the Head a force multiplier who can operate at both the technical and “softer” layers of AI operations and governance.
This role will also serve as a hands-on technical responder for workplace AI incidents and production issues. The Staff Engineer is expected to investigate failures, troubleshoot across platforms, integrations, prompts, configurations, and access paths, implement mitigations or fixes where appropriate, and help restore service quickly while documenting root cause, lessons learned, and prevention steps.
Key responsibilities:
· Implement and maintain AI platform configurations
Own day-to-day configuration of AI platforms and orchestration tools (models, routes, guardrails, tenants, policies, role mappings, prompt libraries, etc.), under the direction of the Head.
· Manage connectors, integrations, and data access paths
Design, configure, and maintain connectors and extensions into SaaS systems, data sources, and workflow tools; ensure connectivity is reliable, secure, and aligned with access policies.
· Own observability wiring for AI tools
Set up and maintain logging, metrics, and alerts for AI workflows and tools; make sure key signals (latency, errors, usage, drift indicators) are captured and visible to the team.
· Handle secrets and access hygiene
Implement secure storage and rotation for API keys, tokens, and credentials; maintain access control configurations and partner with Security/IT on reviews and remediation.
· Execute model and configuration changes in production
Implement model swaps, policy updates, prompt changes, version upgrades, and rollout plans based on decisions made by the Head; maintain detailed change records and rollback paths.
· Support technical evaluations and benchmarking
Run experiments and benchmarks on models, tools, and configurations; collect and summarize technical performance data to inform governance and roadmap decisions.
· Translate technical signals into governance and risk views
Help the Head interpret logs, metrics, and incidents into clear risk, reliability, and compliance narratives that can be shared with Security, Legal, HR, and business sponsors.
· Contribute to playbooks and training
Co-author technical sections of operational playbooks, runbooks, and training materials; occasionally participate in training or office hours to help users understand capabilities and guardrails.
· Coordinate and communicate on incidents and changes
Act as a technical point of contact in incidents: triage, investigate, propose mitigations, execute fixes, and document learnings; communicate clearly with non-technical stakeholders when needed.
Own day-to-day configuration of AI platforms and orchestration tools (models, routes, guardrails, tenants, policies, role mappings, prompt libraries, etc.), under the direction of the Head.
· Manage connectors, integrations, and data access paths
Design, configure, and maintain connectors and extensions into SaaS systems, data sources, and workflow tools; ensure connectivity is reliable, secure, and aligned with access policies.
· Own observability wiring for AI tools
Set up and maintain logging, metrics, and alerts for AI workflows and tools; make sure key signals (latency, errors, usage, drift indicators) are captured and visible to the team.
· Handle secrets and access hygiene
Implement secure storage and rotation for API keys, tokens, and credentials; maintain access control configurations and partner with Security/IT on reviews and remediation.
· Execute model and configuration changes in production
Implement model swaps, policy updates, prompt changes, version upgrades, and rollout plans based on decisions made by the Head; maintain detailed change records and rollback paths.
· Support technical evaluations and benchmarking
Run experiments and benchmarks on models, tools, and configurations; collect and summarize technical performance data to inform governance and roadmap decisions.
· Translate technical signals into governance and risk views
Help the Head interpret logs, metrics, and incidents into clear risk, reliability, and compliance narratives that can be shared with Security, Legal, HR, and business sponsors.
· Contribute to playbooks and training
Co-author technical sections of operational playbooks, runbooks, and training materials; occasionally participate in training or office hours to help users understand capabilities and guardrails.
· Coordinate and communicate on incidents and changes
Act as a technical point of contact in incidents: triage, investigate, propose mitigations, execute fixes, and document learnings; communicate clearly with non-technical stakeholders when needed.
Required qualifications:
· 4–7+ years in roles such as platform engineer, DevOps/SRE, ML/AI operations, or technical SaaS operations, with hands-on responsibility for production systems.
· Strong fluency in APIs, integrations, and infrastructure-as-config concepts; able to work in code/JSON/YAML configuration environments and with automation where appropriate.
· Hands-on experience with monitoring and observability tools (logs, metrics, alerts) and using them to diagnose issues and guide improvements.
· Practical experience working with at least one class of AI or automation platforms (LLM providers, AI productivity tools, RPA/workflow engines, or similar).
· Comfort with secure secrets management and access control practices (roles, permissions, key rotation, least-privilege patterns).
· Ability to document technical work and decisions clearly for both technical and non-technical audiences.
· Strong ownership mindset, bias to action, and comfort operating close to production in a high-stakes environment.
· Strong fluency in APIs, integrations, and infrastructure-as-config concepts; able to work in code/JSON/YAML configuration environments and with automation where appropriate.
· Hands-on experience with monitoring and observability tools (logs, metrics, alerts) and using them to diagnose issues and guide improvements.
· Practical experience working with at least one class of AI or automation platforms (LLM providers, AI productivity tools, RPA/workflow engines, or similar).
· Comfort with secure secrets management and access control practices (roles, permissions, key rotation, least-privilege patterns).
· Ability to document technical work and decisions clearly for both technical and non-technical audiences.
· Strong ownership mindset, bias to action, and comfort operating close to production in a high-stakes environment.
Preferred qualifications:
· Experience in ML/AI ops specifically (model deployment, evaluation, drift monitoring), even if not as a dedicated ML engineer.
· Familiarity with prompt engineering, policies/guardrails, and configuration patterns for LLM-based systems.
· Exposure to governance, compliance, or risk frameworks for data-driven or AI systems.
· Experience collaborating with Security, Legal, and business stakeholders on technical risk and mitigation.
· Prior involvement in incident response, change management, or on-call rotations for critical systems.
· Familiarity with prompt engineering, policies/guardrails, and configuration patterns for LLM-based systems.
· Exposure to governance, compliance, or risk frameworks for data-driven or AI systems.
· Experience collaborating with Security, Legal, and business stakeholders on technical risk and mitigation.
· Prior involvement in incident response, change management, or on-call rotations for critical systems.
#LI-KE1
#LC
Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
###
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.
Bereit, sich bei Shieldai zu bewerben?
Bei Shieldai bewerben
