Jobs Companies Togal AI AI QA Engineer / AI Test Architect

À propos de ce poste AI QA Engineer / AI Test Architect chez Togal AI

Togal AI · Télétravail · United States

We are an innovative technology company providing a cutting-edge, AI-powered cloud platform for the construction industry. Created by industry experts with deep estimating experience, our software dramatically streamlines the pre-construction process. Our solution uses advanced machine learning to automate traditionally time-consuming takeoff tasks, helping estimators work up to 80% faster while reducing costly errors.

Our collaborative platform enables real-time teamwork, instant drawing analysis, and features a revolutionary conversational AI interface that transforms how professionals interact with construction plans. Founded by construction industry veterans, our award-winning application automates the takeoff process, enabling estimators to analyze blueprints in seconds rather than hours or days.

What you’ll do

  • Own quality strategy end-to-end: define, implement, and continuously evolve testing standards across functional, non-functional, and AI-specific dimensions, ensuring quality is embedded from requirements through production.

  • Build and maintain non-functional test automation: design and run performance, load, and stress test suites (k6, JMeter, Gatling etc.) integrated directly into CI/CD pipelines, with quality gates that protect every release.

  • Design and operate (or contribute to) LLM/AI eval frameworks: establish evaluation pipelines (using tools such as DeepEval, Langfuse etc.) to assess AI feature quality across metrics including accuracy, hallucination rate, relevance, faithfulness, and safety.

  • Test AI features and agentic behaviours: validate non-deterministic outputs, prompt variability, model regression, guardrail enforcement, and multi-step agent task-completion rates as first-class quality concerns.

  • Champion shift-left and continuous testing: embed QA into planning, design review, and sprint ceremonies so defects are caught before they're coded, not after they ship.

  • Drive a quality engineering culture: act as a quality advocate across engineering, product, and AI teams; run blameless post-mortems, define quality metrics, and make test coverage and reliability visible to the whole organization.

  • Accelerate delivery through AI-assisted tooling: use AI coding assistants, self-healing automation, and intelligent test prioritization to increase the leverage of every hour spent on quality work.

  • Build observability into production: define and monitor post-release quality signals, model drift indicators, and SLO thresholds so the team can distinguish a regression from expected non-determinism.

What you bring

Must-Haves

  • Traditional QA foundations: solid understanding of deterministic testing: test planning, test case design, functional/regression/exploratory testing, defect lifecycle management, and quality metrics.

  • Test automation engineering: deep expertise in writing and maintaining automated test suites using modern frameworks (Playwright, Cypress, or similar) with at least one modern programming language, such as TypeScript (strongly preferred) or Python, specifically for building robust test libraries.

  • Non-functional test automation: hands-on experience designing and running performance, load, and stress tests with tools such as k6 or JMeter, including CI/CD integration and threshold-based quality gates.

  • AI/LLM testing literacy: practical understanding of what makes AI systems non-deterministic, and experience (or strong working knowledge) of testing LLM-based features for hallucination, consistency, safety, and latency.

  • Eval framework awareness: a working understanding of LLM evaluation concepts: scoring metrics (BLEU, ROUGE), LLM-as-judge patterns, and familiarity with at least one eval framework (DeepEval, RAGAS, etc.).

  • CI/CD and continuous testing: experience integrating test suites into pipelines (GitHub Actions, CircleCI, or equivalent) with a shift-left mindset that treats test failures as blocking signals, not background noise.

  • Quality ownership mentality: demonstrated ability to own quality outcomes, not just execute tasks; comfort setting standards, raising risk flags, and influencing cross-functional teams.

  • Solid understanding of architectural patterns, microservices, and API testing (REST, gRPC) using tools like Postman or custom frameworks.

  • Experience with containerization technologies (Docker) and orchestration (Kubernetes) as they relate to scalable testing environments.

Nice-to-Haves

  • Experience with agentic systems testing: validating goal-completion rates, guardrail enforcement, and multi-step reasoning chains in LLM agent workflows.

  • Familiarity with AIOps/MLOps/LLMOps concepts: prompt versioning, model monitoring, canary deployments, and drift detection.

  • Experience with accessibility or security testing as part of a broader non-functional quality practice.

  • Background in red teaming, adversarial input testing, or prompt injection validation.

  • Experience working in a startup or scale-up environment where processes are built from scratch rather than inherited.

Why Togal?

  • Join a dynamic team of AI-native engineering team.

  • AI-native from day one - you'll be building the quality discipline for a product that uses AI at its core, making every quality decision novel and impactful.

  • Be the quality voice, not a quality follower - this role has direct influence over how Togal defines and measures product excellence.

  • A culture of innovation, continuous learning, and high growth.

  • Comprehensive benefits

  • Competitive compensation package and flexible work arrangements.

We are an equal opportunity employer committed to building a diverse team. We welcome applications from candidates of all backgrounds who are passionate about using technology to transform the construction industry.

Join us in revolutionizing pre-construction estimating with the power of AI!

Prêt à postuler chez Togal AI ?
Postuler chez Togal AI

Emplois similaires

Anduril Industries
Senior Test & Evaluation Engineer, Imaging
Anduril Industries
⚡ Postuler tôt Boulder, Colorado, United Stat... Sur site $126,000–$167,000
● Nouveau 👁 Vu ✓ Postulé il y a 2 h
Epic Games
Senior QA Analyst
Epic Games
⚡ Postuler tôt Cary,North Carolina,United Sta... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 3 h
Anduril Industries
Test Site Asset Engineer - Air Defense
Anduril Industries
⚡ Postuler tôt Costa Mesa, California, United... Sur site $112,000–$149,000
● Nouveau 👁 Vu ✓ Postulé il y a 6 h
Popl Co
Quality Assurance Analyst
Popl Co
⚡ Postuler tôt United States · lieu restreint $70,000–$90,000
● Nouveau 👁 Vu ✓ Postulé il y a 6 h
Anduril Industries
Senior Project Engineer, Test and Evaluation
Anduril Industries
⚡ Postuler tôt Costa Mesa, California, United... Sur site $146,000–$194,000
● Nouveau 👁 Vu ✓ Postulé il y a 6 h
UC
Quality Assurance Engineer
US Conec, Ltd.
⚡ Postuler tôt Hickory, North Carolina, Unite... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 7 h
Roblox
Senior QA Engineer, Safety
Roblox
⚡ Postuler tôt San Mateo, CA, United States Sur site $187,780–$223,660
● Nouveau 👁 Vu ✓ Postulé il y a 7 h
Ōura
Senior Electrical Test Engineer
Ōura
⚡ Postuler tôt Hybrid - San Francisco, Califo... Hybride
● Nouveau 👁 Vu ✓ Postulé il y a 8 h
CarGurus
Quality Assurance Engineer II
CarGurus
⚡ Postuler tôt Boston, Massachusetts, United... Hybride $96,000–$120,000
● Nouveau 👁 Vu ✓ Postulé il y a 8 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Togal AI

Voir tous les emplois chez Togal AI →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit