Jobs › Companies › Gramian Consulting Group › Cybersecurity Engineer - AI Benchmarking

À propos de ce poste Cybersecurity Engineer - AI Benchmarking chez Gramian Consulting Group

Gramian Consulting Group · Télétravail · Pakistan

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Senior Software Security Engineer to develop high-quality training and evaluation tasks for advanced AI coding models. You will transform real-world software vulnerabilities, including CVEs, security advisories, and open-source bug reports, into realistic Harbor-format audit-and-patch tasks across multiple programming languages.

This role combines software security research, vulnerability reproduction, benchmark development, automated testing, and technical review. You will create tasks that assess whether AI systems can identify vulnerabilities, understand their underlying causes, reproduce security issues, and implement reliable fixes rather than simply recognizing familiar patterns or copying existing patches.

The ideal candidate has strong professional software engineering experience, deep practical knowledge of application security, and the ability to independently investigate vulnerabilities and build reproducible testing environments.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Project Focus: AI coding model training and evaluation, software vulnerability research, and secure patch development.

Key Responsibilities

  • Vulnerability Research: Source and investigate real-world vulnerabilities from CVEs, security advisories, bug reports, and open-source repositories.
  • Security Classification: Identify and classify vulnerabilities using the most specific applicable CWE and map them to relevant OWASP Top 10 categories where appropriate.
  • Vulnerability Reproduction: Reproduce security issues and develop reliable proof-of-vulnerability tests that demonstrate the underlying weakness.
  • Benchmark Development: Build Harbor-format audit-and-patch tasks across multiple programming languages and software ecosystems.
  • Task Authoring: Write realistic task instructions that describe the security issue without revealing vulnerable code, exploit details, or the expected remediation.
  • Environment Setup: Create reproducible Docker-based environments with pinned dependencies, clear setup instructions, and reliable execution procedures.
  • Verifier Development: Design and harden automated verifiers to prevent gaming, test manipulation, hardcoded solutions, and overfitting.
  • Patch Evaluation: Review and score AI-generated patches and technical reasoning using structured security and engineering rubrics.
  • Quality Assurance: Identify tasks that can be solved through superficial pattern matching or copying known upstream patches without understanding the vulnerability.
  • Technical Documentation: Document vulnerability context, reproduction steps, expected behavior, patch requirements, test methodology, and review decisions.

Requirements

  • 5+ years of professional software engineering experience.

  • Expert-level proficiency in at least one of the following programming languages:

    • Python

    • JavaScript / TypeScript

    • Java

    • C / C++

    • C#

    • Go

    • Rust

    • Ruby

    • PHP

    • Kotlin

    • Swift

  • Strong understanding of software security principles and common vulnerability classes.

  • Practical knowledge of CWE, CVE, and OWASP Top 10.

  • Ability to independently reproduce vulnerabilities and develop proof-of-vulnerability tests.

  • Hands-on experience with security testing and analysis tools, including:

    • Sanitizers

    • Fuzzers

    • Static-analysis tools such as CodeQL or Semgrep

  • Strong proficiency with Git, Linux, Bash, and Docker.

  • Ability to create automated tests and reproducible technical evaluation environments.

  • Excellent technical writing skills, with the ability to explain complex security issues and remediation requirements clearly.

  • Ability to work independently in a fully remote, research-oriented environment.

Prêt à postuler chez Gramian Consulting Group ?
Postuler chez Gramian Consulting Group

À propos de Gramian Consulting Group

Gramian Consultancy brings together the perspective of a software engineer, the knowledge of a technical recruiter, and the vision of a business builder. This unique experience is our signature advantage to delivering top quality services in the domain of recruiting, staff augmentation, and outsourcing.

Voir tous les emplois chez Gramian Consulting Group →

Emplois similaires

Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting Group
⚡ Postuler tôt Pakistan · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
micro1
Senior Intelligence Analyst – National Security
micro1
⚡ Postuler tôt Remote — 58 countries · lieu restreint $166,400–$353,600
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Pavago
Cloud / Network / Cybersecurity Engineer
Pavago
⚡ Postuler tôt Pakistan · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 3 sem.
CureMD
Application Security Analyst
CureMD
⚡ Postuler tôt Lahore Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 3 mois
Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking
Gramian Consulting Group
⚡ Postuler tôt Brazil · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting Group
⚡ Postuler tôt Brazil · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
Assurity Trusted Solutions
Infrastructure Cybersecurity Engineer
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
Assurity Trusted Solutions
Cybersecurity Engineer (GRC Manager)
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
Assurity Trusted Solutions
Cybersecurity Engineer (GRC with AI)
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Gramian Consulting Group

Voir tous les emplois chez Gramian Consulting Group →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit