About this Software Development Engineer in Test (SDET) role at Weekday AI
This role is for one of the Weekday's clients
Salary range: Rs 2300000 - Rs 4200000 (ie INR 23 - 42 LPA)
Min Experience: 4+ years
Location: Bengaluru, Karnataka, India
JobType: full-time
We are looking for an experienced Software Development Engineer in Test (SDET) to join our engineering team and play a key role in building reliable, scalable, and high-performing software systems. This role is ideal for professionals who are passionate about quality engineering, automation, and modern AI-powered applications. You will be responsible for designing and implementing robust test automation frameworks while ensuring the quality of backend services, APIs, distributed systems, and applications powered by Large Language Models (LLMs).
The ideal candidate has strong expertise in software testing, automation, and programming, along with hands-on experience working with vLLM to validate and optimize LLM inference pipelines. You will collaborate closely with software engineers, DevOps teams, and AI researchers to establish best practices for testing, reliability, and continuous delivery.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable automated test frameworks for web applications, APIs, backend services, and AI-powered systems.
- Build comprehensive test strategies covering functional, regression, integration, performance, security, and end-to-end testing.
- Develop automated test suites for LLM inference pipelines using vLLM, ensuring reliability, scalability, and performance.
- Validate model serving infrastructure, API responses, prompt execution, streaming outputs, and latency benchmarks.
- Work closely with developers to identify defects early in the software development lifecycle.
- Create automated CI/CD quality gates to ensure continuous testing across deployments.
- Perform load, stress, and performance testing for distributed applications and AI inference systems.
- Design test data management strategies and automate test environment provisioning.
- Investigate production issues, identify root causes, and implement preventive quality measures.
- Continuously improve testing processes, automation coverage, and engineering best practices.
- Collaborate with cross-functional teams to define quality metrics and release readiness criteria.
- Document test plans, automation frameworks, quality reports, and technical findings.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 4–10 years of experience as an SDET, Automation Engineer, or Software Quality Engineer.
- Strong programming experience in Python, Java, or similar object-oriented languages.
- Hands-on experience building scalable automation frameworks from scratch.
- Experience testing REST APIs, microservices, and distributed architectures.
- Solid understanding of software testing methodologies, SDLC, and Agile development practices.
- Experience integrating automated testing into CI/CD pipelines.
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Must-Have Skills
- Software Development Engineer in Test (SDET)
- vLLM
- Test Automation
- Python or Java
- API Testing
- Selenium, Playwright, or Cypress
- PyTest, JUnit, or TestNG
- Performance Testing (JMeter, Locust, or k6)
- CI/CD (GitHub Actions, Jenkins, GitLab CI)
- Docker and Kubernetes
- SQL and NoSQL Databases
- Git Version Control
Good-to-Have Skills
- Experience testing Generative AI or LLM-based applications.
- Knowledge of model serving frameworks such as TensorRT-LLM, Hugging Face TGI, or Ollama.
- Experience with vector databases and Retrieval-Augmented Generation (RAG) systems.
- Familiarity with monitoring tools such as Prometheus, Grafana, or OpenTelemetry.
- Exposure to security testing and vulnerability assessment tools.
- Understanding of distributed systems, caching technologies, and message queues.
What We're Looking For
The ideal candidate combines strong software development expertise with a quality-first mindset. You should be comfortable building automation frameworks, validating AI model inference using vLLM, and ensuring software reliability across complex distributed systems. Strong analytical thinking, debugging skills, and the ability to collaborate effectively with engineering and AI teams are essential. If you enjoy solving challenging quality engineering problems while working with cutting-edge AI technologies, we'd love to hear from you.