Senior AI Quality Assurance Engineer

Role Overview

An AI Quality Assurance Engineer ensures the accuracy, reliability, and compliance of AI systems and models before deployment. This role is critical for validating AI-driven applications, detecting defects, and safeguarding against risks such as bias, hallucinations, and non-deterministic behavior. The position involves designing robust test strategies for machine learning models and collaborating with data scientists, ML engineers, and product teams to maintain high-quality standards.

Key Responsibilities

· Testing & Validation

o Develop and execute comprehensive test plans for AI models and systems.

o Perform manual and automated tests to validate AI functionality under various scenarios.

o Conduct bias detection, edge-case testing, and stress testing for AI models.

· Automation & Tools

o Design and implement automated testing frameworks for AI workflows.

o Utilize AI-powered QA tools and self-healing test scripts to improve efficiency.

· Compliance & Governance

o Ensure AI systems adhere to ethical guidelines, regulatory standards, and internal policies.

o Maintain documentation such as Generative AI Bill of Materials (BoM) for transparency and audits.

· Collaboration

o Work closely with ML engineers, data scientists, and product managers to resolve defects.

o Participate in code reviews and contribute to continuous improvement initiatives.

· Monitoring & Reporting

o Analyze test results, identify defects, and track quality metrics.

o Provide risk assessments and recommendations for AI deployments.

Required Skills & Qualifications

· Education: Bachelor’s in Computer Science, Software Engineering, or related field.

· Experience:

o 3–7 years in QA, with at least 2 years in AI/ML testing.

o Familiarity with non-deterministic testing and AI-specific QA challenges.

· Technical Expertise:

o Proficiency in Python and testing frameworks (e.g., PyTest, Selenium).

o Knowledge of ML frameworks (TensorFlow, PyTorch) and MLOps tools.

o Experience with CI/CD pipelines and cloud platforms (AWS, Azure, GCP).

· Soft Skills:

o Strong analytical and problem-solving abilities.

o Excellent communication and collaboration skills.

Preferred Skills

· Understanding of ethical AI principles and bias testing.

· Familiarity with low-code/no-code automation tools and AI-driven QA platforms.

· Knowledge of regulatory compliance for AI systems.

#LI-DNI

#LifeAtBottomline

About us:

Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe.

We have 1000 employees across 20 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital experts, all dedicated to bringing extra value to every client.

About the role:

As a Data Analyst, your role will encompass:

• Conducting projects to accompany the transformation of your clients’ businesses through the effective collection, processing, and visualisation of data
• Extracting valuable insights from our clients’ marketing-related data sources.
• Designing dashboards for marketing decision-making while taking into account the business needs
• Accompanying our clients in the conception and implementation of data architectures and data pipelines, from collection to monitoring.
• Actively contributing to the expertise level and competencies of the Data & Analytics team
• Closely collaborate with the other divisions (Media & Activation, Creation, Consulting, Data Science and Data Engineer) to provide comprehensive services to your clients

Qualifications

Having an academic level of education (Bachelor or Master), in a data-driven working environment, you have experience or have knowledge in :

• A minimum of 1 year of work experience in a data-driven working environment
• 1 or more data collection (Google Analytics, Adobe Analytics, SQL database, CRM database, transactional data)
• 1 or 2 programming languages among SQL, Python and/or R.
• Must have extensive experience in either Tableau or Power BI. Experience in both is preferred but not essential.

Ideally, you have the knowledge or take interested in one or more of the following technologies:

• 1 Google Cloud Platform resource (Big Query, Google Cloud Storage) or its equivalent in Azure or AWS
• You know how to connect to an API through the knowledge of the different authentication method (OAuth, HTTP Basic, API key)
• 1 advertising tool, linked to tracking and/or analytics in a marketing context (Google Analytics, Adobe Analytics, DMP, DSP, Adservers, DV 360…)
• 1 ETL tool (Airflow, Dataiku, Dataflow, Dataprep…)
• 1 web application (R-Shiny, Python Flask) that you have industrialized

As a bonus, you have:

• Basic knowledge of statistics
• Basic knowledge of machine learning and data engineering

Why you should join us

• Artefact is the place to be: come and build the future of marketing
• Progress: every day offers new challenges and new opportunities to learn
• Culture: join the best team you could ever imagine
• Entrepreneurship: you will be joining a team of driven entrepreneurs. We won’t give up until we make a huge dent in this industry!

Come join us!

Artefact is a new generation of data service providers, specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…

What will you be doing? 

• Manage projects as well as lead our business growth, the data consulting teams welcome all business and technical background joiners, who would thrive as an expert in a specific field, or truly versatile players.
• In this fast-paced, fast-growing industry, the most important qualities in our eyes are intellectual curiosity, autonomy and dynamism.
• You wield both “business” and “data” knowledge, with experience ideally in a digital marketing consulting firm; You already have a first understanding of digital technologies, and care to develop more in the exciting world of data and digital business

What are we looking for? 

• You must have previous Management Consultancy, ideally within Strategy Consulting or Data Consulting.
• Graduated from Business school or Engineering, in our eyes' the most important qualities are intellectual curiosity, autonomy, and dynamism.
• We are looking for profiles with the double hat “business” and “data”, with at least 1-2 years of experience, and in the use of BI tools or data analysis.
• You will already understand digital technologies (Tracking, Machine Learning, RTB, Big Data, Platform as a Service,…).

Artefact is the place to be: come and build the future of data and marketing!
Innovation: We have a passion for creating impacting projects and believe innovation can come from anyone.
Action: We make things rather than telling people how to make them.
Collaboration: We believe in bringing talented people together, winning together, and in learning from each other.

Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…

What you will be doing?
As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.

Your responsibilities will include:

• Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
• Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
• Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
• Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
• Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.

What we are looking for?

• Proficiency in Python, SQL, and database management.
• Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP preferred), ML Modeling, Spark & Kafka.
• Proven problem-solving skills and a solution-oriented mindset.
• Excellent communication skills to collaborate effectively within teams and with stakeholders.
• Strong business acumen with an interest in business-facing roles.
• Adaptability and a start-up mentality to thrive in a dynamic environment.
• Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
• Successful candidates often possess Computer Science, Electronics, and Communication Engineering degrees.

About us:

Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe.

We have 1000 employees across 20 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital experts, all dedicated to bringing extra value to every client.

About the role:

As a Data Scientist, your role will encompass:

• Conducting ambitious projects in the transformation of clients through data
• Collaborating with the other Divisions (Activation, Creativity, and Strategy) to provide comprehensive services to your clients
• Developing privileged relationships with our clients, using your technical abilities to assist in the transformation of their marketing department

Among your responsibilities as a Data Scientist, you will be responsible for:

Performing data projects

• Securing delivery on your projects
• Communicating your work and achievements among the team
• Working closely with your Consulting counterpart to build and maintain strong relationships with your clients and best understand their needs
• Ensuring that your solutions are bringing values to the client problematic
• Being a good team player, knowing your role and responsibility in the global ambition

Qualifications: Education & experience required

• A Master’s degree in machine learning, mathematics, computer science, or related fields
• Hands-on experience developing and applying data-driven solutions in a corporate or consulting setting, preferably in a consumer marketing context (experience in the web industry is a plus)
• Strong knowledge of data processing, data modeling, algorithms, and data architecture
• Intellectual curiosity and excellent problem-solving skills, including the ability to structure and prioritise an approach for maximum impact

What we are looking for

• A Doer: you get things done and inspire your teams to do the same
• An Analyst: you LOVE data and think every company should take their decisions with facts
• A Pragmatist: you have a hacker mindset and always find the quick wins
• A Mentor: your clients and teams naturally seek for advice
• An Adventurer: you’re an entrepreneur constantly looking for problems to solve

Why you should join us

• Artefact is the place to be: come and build the future of marketing
• Progress: every day offers new challenges and new opportunities to learn
• Culture: join the best team you could ever imagine
• Entrepreneurship: you will be joining a team of driven entrepreneurs. We won’t give up until we make a huge dent in this industry!