The Mission

As Lead Software Engineer – AI Quality & Test Automation, you own the strategy and execution of a modern, AI-accelerated test automation program. You build and run the platforms, frameworks, and CI quality gates that keep releases reliable at high velocity — using AI to scale test creation, maintenance, and triage across teams. You don’t retrofit testing onto AI workflows; you engineer quality into them from the ground up, ensuring every stage of an AI-assisted pipeline is observable, trustworthy, and continuously improving.

Essential Duties & Responsibilities

Platform & Automation Leadership

• Own the automation platform: define and build scalable frameworks, standards, and governance (services, APIs, UI) that enable teams to produce robust, consistent coverage
• Set direction for test automation tooling and AI-assisted techniques that accelerate test design, authoring, maintenance, and triage
• Lead by example — write automation, set the quality bar, mentor engineers, and drive adoption of the practices you establish
• Own CI automation health: build and maintain test environments, pipelines, and tooling (including containers/CI), reduce flakiness, and shorten feedback loops
• Be a highly visible advocate for quality — lead cross-team discussions, drive alignment and decisions, and escalate risks and blockers immediately

AI-Native Test Engineering

• Lead the adoption of LLM-powered test generation: from natural language requirement ingestion to executable, maintainable test output
• Build and maintain a self-healing test infrastructure layer — leveraging AI to detect broken selectors, drifted APIs, or changed behaviors and propose or apply fixes autonomously
• Define prompt engineering standards, context injection patterns, and RAG architectures that ground test generation in real codebase context
• Implement guardrails to ensure AI-generated test output is verified, traceable, and safe to ship — including versioning, ownership attribution, and confidence scoring
• Own automated coverage and risk reporting (unit/integration/e2e) and use it to drive targeted gap closure and release readiness

Quality Gates & CI/CD

• Lead risk-based test strategy with product and engineering — define acceptance criteria and quality gates that support high delivery velocity without sacrificing customer-impacting quality
• Design adaptive quality gates for AI-accelerated CI/CD pipelines — gates that reason about risk, not just pass/fail thresholds
• Build risk-scoring models that adjust gate strictness based on change scope, code origin (human vs. AI-generated), historical failure patterns, and deployment context
• Architect the observability layer for automated pipelines: surface signals that indicate poor quality decisions in real time
• Establish rollback and circuit-breaker patterns for autonomous deployments triggered by quality signal degradation

AI Model & Agent Validation

• Build behavioral testing frameworks for validating AI agents and LLM-powered features in production — testing non-deterministic outputs with statistical rigor
• Design evaluation benchmarks for internal AI tooling: measuring task completion accuracy, hallucination rates, and decision quality over time
• Define adversarial and edge-case testing methodologies for AI features: prompt injection resistance, boundary condition handling, and graceful degradation
• Partner with ML platform and data science teams to establish quality acceptance criteria for every model and agent promoted to production

Required Skills & Experience

• 10+ years of software engineering experience with a strong emphasis on test automation (unit, integration, end-to-end) and quality engineering practices
• Strong programming skills in one or more languages: Python, TypeScript, Java, or C#
• Platform mindset — energized by building infrastructure and frameworks that enable product teams to move faster
• Experience building automation for APIs and distributed systems; UI automation experience is a plus
• Experience with CI/CD, test reporting/observability, and maintaining reliable pipelines (e.g., GitHub Actions, Jenkins, Azure DevOps)
• Proven ability to apply AI/LLM tools to scale automation (e.g., generate/refine tests, expand edge cases, refactor brittle suites, accelerate failure triage) while implementing guardrails so AI output is verified, traceable, and safe to ship
• Hands-on understanding of agentic AI patterns: tool use, multi-agent orchestration, planning loops, and human-in-the-loop design as applied to quality workflows
• Familiarity with LLM failure modes relevant to quality: hallucination, context loss, sycophancy, and over-confident assertions
• Excellent debugging and root-cause analysis skills across code, data, and infrastructure
• Strong communication skills; able to translate quality risks into clear tradeoffs and action plans
• Demonstrated technical leadership across teams — driving standards, roadmap execution, and stakeholder alignment
• Self-directed, comfortable with ambiguity, and biased toward action

Desired Skills & Experience

• Modern test frameworks (e.g., pytest, JUnit, NUnit, Playwright, Cypress) and API testing (REST, gRPC)
• Containerization and environments: Docker; Kubernetes a plus
• Relational databases and SQL; ability to validate data pipelines and analytics outputs
• Experience with Elasticsearch or similar text-retrieval data stores
• Performance/load testing (e.g., JMeter, k6, Locust) and profiling/observability
• Cloud experience (AWS/Azure/GCP) and Infrastructure-as-Code (e.g., Terraform)
• Experience building AI-enabled automation workflows (e.g., Claude/OpenAI APIs, prompt patterns for test generation, repo-aware RAG, scripts/services that turn AI output into runnable tests)
• Familiarity with agent frameworks (LangChain, LlamaIndex, AutoGen, or equivalents) and their tradeoffs in production quality pipelines
• Experience designing evaluation harnesses for non-deterministic AI systems — statistical confidence, behavioral consistency, and regression detection
• Agile software development experience (Scrum / XP)

Education

Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.

THE POSITION
Our roster has an opening with your name on it

We’re looking for a Staff Software Engineer to own and evolve test automation for our Sportsbook Emerging Experiences - Social and Advanced Search - across iOS, Android, and Web. This is a hands-on technical leadership role focused on building reliable functional and performance automation that improves release confidence.

You’ll partner closely with engineers, product, and QA to embed quality earlier in the development lifecycle, build repeatable patterns in our Nx monorepo and CI, and raise the bar on what “release ready” means for user-critical journeys.

In addition to the specific responsibilities outlined above, employees may be required to perform other such duties as assigned by the Company. This ensures operational flexibility and allows the Company to meet evolving business needs.

THE GAME PLAN
Everyone on our team has a part to play

Design and implement end-to-end automation for core Social and Search journeys using Cypress (web) and Detox (iOS/Android), aligned to our Nx monorepo structure.

Own and evolve the pillar’s automation foundations: test architecture, folder structure, screen-object patterns, shared utilities, and local-first run toolchains so teams can add coverage quickly and consistently.

Integrate automation into CI (Buildkite and/or GitHub Actions): affected execution, parallelization, clear pass/fail reporting, and quality gates that are actionable, while keeping suites easy to run locally for fast iteration.

Drive stability: track flakiness, improve test determinism, and shorten time-to-signal through improved synchronization, test data control, and failure triage patterns.

Establish a test data and environment strategy: mocks/fixtures for acceptance, prod-like data for E2E, and lightweight API/contract tests (Pact or equivalent) where they add value.

Build performance coverage for critical journeys (feed load, interactions, search latency/rendering) using Detox performance tooling and/or Flashlight + Maestro; define baselines and regression thresholds.

Own load/performance testing for key end-to-end user journeys (from BFF/edge APIs through platform and backend services) using Locust (Python) or equivalent, including realistic traffic modeling (ramp profiles, concurrency, think time), scenario design, assertions on p95/p99 latency, throughput, and error rates, and reporting.

For Advanced Search (including LLM-powered experiences where applicable), define automated evaluation: schema/structure checks, relevance/quality regression vs baselines, and edge-case/safety checks.

Partner with platform and observability teams to improve test visibility (dashboards, logging, artifacts) and ensure automation results are easy to interpret and act on.

Mentor and enable: coach engineers and QA (including team members transitioning from manual to automated testing) on automation authorship, local-first toolchains, and AI-assisted development workflows (e.g., Cursor) so squads can confidently build and maintain test coverage.

THE STATS
What we're looking for in our next teammate

7+ years of experience in software test automation / quality engineering, including designing and maintaining automation frameworks at scale.

Hands-on coding skills in TypeScript/JavaScript and/or Python; comfortable reading and contributing to production code.

Strong end-to-end automation experience across web and mobile (Cypress and Detox preferred; Playwright, Appium, WebdriverIO, etc. are transferable).

Experience working in monorepos and CI/CD: Nx (or similar), Buildkite/GitHub Actions, and practices like affected runs, parallelization, and fast feedback loops.

Experience testing APIs and distributed systems: test data setup, SQL/NoSQL validation, and contract testing/mocking approaches where appropriate.

Performance and reliability mindset: build performance baselines, run end-to-end load tests (Locust/k6/JMeter) that exercise BFF and downstream services, interpret p95/p99 latency and error rates, and reduce flaky tests through better design.

Staff-level leadership: proven ability to influence across teams, set standards, mentor others, and drive quality initiatives end-to-end.

Nice to Have

Mobile performance tooling (Detox performance, Flashlight, Maestro) and/or web performance profiling (Lighthouse, tracing) is a plus.

Accessibility testing experience (axe, WCAG) and/or visual regression testing.

Experience with observability and reporting (Grafana, ELK, Datadog) for test signal, flakiness, and CI analytics.

Cloud and data tooling (AWS, Docker/Kubernetes) for test environments, orchestration, and test data pipelines.

Experience testing ML/LLM-powered search: evaluation datasets and regression across model/prompt changes.

ABOUT FANDUEL

FanDuel Group is the premier mobile gaming company in the United States and Canada. FanDuel Group consists of a portfolio of leading brands across mobile wagering including: America’s #1 Sportsbook, FanDuel Sportsbook; its leading iGaming platform, FanDuel Casino; the industry’s unquestioned leader in horse racing and advance-deposit wagering, FanDuel Racing; and its daily fantasy sports product.  

In addition, FanDuel Group operates FanDuel TV, its broadly distributed linear cable television network and FanDuel TV+, its leading direct-to-consumer OTT platform. FanDuel Group has a presence across all 50 states, Canada, and Puerto Rico.

The company is based in New York with US offices in Los Angeles, Atlanta, and Jersey City, as well as global offices in Canada and Scotland. The company’s affiliates have offices worldwide, including in Ireland, Portugal, Romania, and Australia.

FanDuel Group is a subsidiary of Flutter Entertainment, the world's largest sports betting and gaming operator with a portfolio of globally recognized brands and traded on the New York Stock Exchange (NYSE: FLUT).

PLAYER BENEFITS
We treat our team right

We offer amazing benefits above and beyond the basics. We have an array of health plans to choose from (some as low as $0 per paycheck) that include programs for fertility and family planning, mental health support, and fitness benefits. We offer generous paid time off (PTO & sick leave), annual bonus and long-term incentive opportunities (based on performance), 401k with up to a 5% match, commuter benefits , pet insurance, and more - check out all our benefits here: FanDuel Total Rewards. *Benefits differ across location, role, and level.

FanDuel is an equal opportunities employer and we believe, as one of our principles states, “We are One Team!”. As such, we are committed to equal employment opportunity regardless of race, color, ethnicity, ancestry, religion, creed, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, or any other characteristic protected by state, local or federal law. We believe FanDuel is strongest and best able to compete if all employees feel valued, respected, and included.

The applicable salary range for this position is $159k- $199k USD, which is dependent on a variety of factors including relevant experience, location, business needs and market demand. This role may offer the following benefits: medical, vision, and dental insurance; life insurance; disability insurance; a 401(k) matching program; among other employee benefits. This role may also be eligible for short-term or long-term incentive compensation, including, but not limited to, cash bonuses and stock program participation. This role includes paid personal time off and 14 paid company holidays. FanDuel offers paid sick time in accordance with all applicable state and federal laws.

FanDuel is committed to providing reasonable accommodations for qualified individuals with disabilities. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please email Benefits@fanduel.com.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

#LI-Hybrid

As one of Microsoft’s most recognized global partners, Quisitive sits at the forefront of cloud transformation, enterprise data strategy, cybersecurity, and the emerging frontier of agentic AI. Here, consultants and technologists operate on the edge of innovation—supported by a culture that values craftsmanship, open collaboration, and technical expertise. If you’re looking for a place where you can innovate, solve complex problems, and build solutions that make a measurable impact, join us.

As a Senior QA Engineer embedded in our Telecom OSS practice, you will own end-to-end test strategy and automation for applications supporting cable TV, voice, and broadband internet services. You will work across telecom middleware layers and operational systems including:  provisioning, service activation, billing interfaces, and network management platforms — ensuring that complex, high-availability systems meet rigorous quality standards before reaching production.  This position is a hybrid role and you will need to be located in the Greater Atlanta area.

Key Responsibilities

• Design, build, and maintain scalable E2E test suites using Playwright targeting web-based OSS/BSS portals, service management UIs, and operational dashboards
• Develop and execute test strategies for telecom service applications spanning cable/TV, VoIP, and broadband internet platforms
• Test telecom middleware integrations including provisioning systems, service orchestration layers, and network-facing APIs (REST, SOAP, TL1, SNMP)
• Validate end-to-end service workflows such as subscriber activation, order management, fault management, and service assurance flows
• Integrate automated test suites into CI/CD pipelines (Azure DevOps, GitHub Actions, or equivalent) supporting rapid release cycles
• Collaborate with OSS architects and developers to define testable acceptance criteria for complex, multi-system integration scenarios
• Mentor junior QA engineers and establish team-wide testing standards, frameworks, and best practices specific to telecom environments
• Triage failures, isolate root causes across system boundaries, and communicate findings clearly to engineering and client stakeholders
• Contribute to pre-sales and solutioning by scoping QA workstreams for telecom client engagements

Required Qualifications

• 5+ years of QA/test automation experience, with at least 2 years hands-on with Playwright
• Demonstrated experience testing OSS/BSS applications in a cable, telecom, or managed services environment
• Familiarity with telecom service domains: cable/TV (video), voice (VoIP/POTS), and internet (broadband) provisioning and management
• Experience testing middleware integrations and APIs — REST, SOAP, or protocol-level interfaces common in telecom stacks
• Proven ability to design E2E test frameworks from scratch across multi-system, distributed architectures
• Strong working knowledge of CI/CD pipelines and integrating automated tests into build/deploy workflows
• Solid grasp of test strategy principles: risk-based testing, test pyramid, regression coverage, and environment management
• Experience working in Agile/Scrum delivery environments, ideally on client-facing engagements
• Strong communication skills — able to translate complex QA findings for both technical and non-technical audiences

Nice to Have

• Hands-on experience with OSS platforms such as Amdocs, CSG, Netcracker, Comverse, or similar
• Knowledge of TMForum standards (eTOM, SID, Open APIs) and how they apply to service assurance and fulfillment
• Familiarity with DOCSIS, SIP, or other cable/telecom protocols
• Experience with performance or load testing for high-throughput telecom transaction systems
• Exposure to Microsoft Azure-based telecom or cloud-native OSS deployments
• Prior consulting or client-facing delivery experience in the telecom or cable industry

Why Quisitive

• Work on mission-critical systems for leading North American cable and telecom operators
• Collaborate with Microsoft MVPs and industry-recognized delivery leaders in the telecom OSS space
• Exposure to a broad portfolio of telecom technologies across video, voice, and broadband domains
• Competitive compensation, comprehensive benefits, and a culture that invests in continuous learning and certification

​

About Quisitive​

With significant growth since 2016, Quisitive is rapidly progressing our vision of becoming the leading global Microsoft partner as we continue to expand across the United States, Canada and India. With a diversified delivery model that includes both nearshore and offshore capabilities, our team of Microsoft experts delivers cloud solutions, artificial intelligence and business applications that transform our clients’ businesses and achieve remarkable business outcomes. ​

About Your Role 

We are seeking an Agentic AI Engineer to design, build and deploy intelligent AI agents that enhance business workflows across the organization. 

This role focuses on building autonomous systems that can reason, take action across enterprise platforms and support teams by automating repetitive processes, accelerating response times and improving data quality. 

How You’ll Make an Impact 

• Design and deploy autonomous AI agents that are capable of executing structured business workflows with or without human interaction
• Develop multi-step reasoning workflows leveraging tool-calling, memory and planning strategies 
• Connect AI agents to operate across internal and external systems, including Salesforce, Slack, Google
• Ensure integrations meet enterprise security and compliance standards through guardrails, evaluation frameworks, and human-in-the-loop controls 
• Collaborate with internal teams to ensure QGenda’s infrastructure supports agent orchestration and responsible AI deployment 
• Continuously monitor, optimize and improve agent performance based on measurable KPIs

Who You Are 

• Entrepreneurial mindset with strong execution discipline 
• Systems thinker who balances innovation with risk management 
• Strong debugging and failure-analysis skills 
• Product-oriented - focused on business outcomes 
• Comfortable operating in ambiguity when building structured solutions

Experience You Bring 

• Bachelor’s Degree in Computer Science, Data Science or related technical discipline
• Hands-on experience building AI agents using Claude Code and/or OpenClaw, tool-calling and multi-step reasoning architectures 
• Experience integrating AI systems with Salesforce, Slack or other webhook-based systems 
• Experience with Playwright or similar browser automation frameworks 
• Strong programming skills in Python and/or TypeScript
• Experience deploying autonomous agents into production environments 
• Strong understanding of LLM limitations, evaluation methods and prompt engineering