Jobs › Companies › Gramian Consulting Group › Cybersecurity Engineer - AI Benchmarking Lead

À propos de ce poste Cybersecurity Engineer - AI Benchmarking Lead chez Gramian Consulting Group

Gramian Consulting Group · Télétravail · Pakistan

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Lead Software Security Engineer to lead a team of trainers developing high-quality training and evaluation tasks for frontier AI coding models. You will oversee project delivery, coordinate team capacity, maintain technical quality standards, and step in to perform hands-on vulnerability research and task development when workloads increase.

The project focuses on transforming real-world open-source vulnerabilities—including CVEs, security advisories, and bug reports—into Harbor-format audit-and-patch tasks across multiple programming languages. These tasks evaluate whether AI systems can identify, understand, reproduce, and securely remediate software vulnerabilities rather than relying on superficial pattern matching or copying known patches.

This position combines software security expertise, technical leadership, benchmark development, quality assurance, and delivery management. The ideal candidate is an experienced security-focused software engineer who can lead contributors, make sound technical decisions, manage delivery expectations, and maintain hands-on involvement in the work.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security research, AI coding model training and evaluation, benchmark development, and technical team leadership.

Key Responsibilities

  • Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets.

  • Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule.

  • Client Communication: Lead weekly client reporting, communicate delivery status, and proactively escalate risks involving tooling issues, rate limits, safety blocks, and resource constraints.

  • Scope & Requirements Alignment: Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes.

  • Technical Quality Assurance: Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards.

  • Team Calibration: Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria.

  • Capacity Planning: Use throughput and quality data to forecast staffing needs across project phases.

  • Recruitment & Onboarding: Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements.

  • Hands-on Technical Contribution: Step in to research vulnerabilities, reproduce security issues, develop proof-of-vulnerability tests, and create or review benchmark tasks during periods of high workload.

  • Documentation & Reporting: Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions.

Requirements

  • 6+ years of professional software engineering experience.

  • Expert-level proficiency in at least one of the following programming languages:

    • Python

    • JavaScript / TypeScript

    • Java

    • C / C++

    • C#

    • Go

    • Rust

    • Ruby

    • PHP

    • Kotlin

    • Swift

  • Strong understanding of software security concepts, including CWE, CVE, and OWASP Top 10.

  • Ability to reproduce software vulnerabilities and develop proof-of-vulnerability tests.

  • Hands-on experience with security tooling, including sanitizers, fuzzers, and static-analysis tools such as CodeQL or Semgrep.

  • Strong proficiency with Git, Linux, Bash, and Docker.

  • Strong technical judgment when evaluating verifier robustness, security patches, and AI-generated code.

  • Experience reviewing technical work and maintaining consistent quality standards across multiple contributors.

  • Some experience mentoring engineers, trainers, or technical contributors.

  • Excellent technical writing, documentation, and communication skills.

  • Ability to work independently in a fully remote, research-oriented environment.

  • Proven track record working on this project or equivalent software security dataset, benchmark development, or security evaluation work.

Prêt à postuler chez Gramian Consulting Group ?
Postuler chez Gramian Consulting Group

À propos de Gramian Consulting Group

Gramian Consultancy brings together the perspective of a software engineer, the knowledge of a technical recruiter, and the vision of a business builder. This unique experience is our signature advantage to delivering top quality services in the domain of recruiting, staff augmentation, and outsourcing.

Voir tous les emplois chez Gramian Consulting Group →

Emplois similaires

Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking
Gramian Consulting Group
⚡ Postuler tôt Pakistan · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
micro1
Senior Intelligence Analyst – National Security
micro1
⚡ Postuler tôt Remote — 58 countries · lieu restreint $166,400–$353,600
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Pavago
Cloud / Network / Cybersecurity Engineer
Pavago
⚡ Postuler tôt Pakistan · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 3 sem.
CureMD
Application Security Analyst
CureMD
⚡ Postuler tôt Lahore Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 3 mois
Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking
Gramian Consulting Group
⚡ Postuler tôt Brazil · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
Gramian Consulting Group
Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting Group
⚡ Postuler tôt Brazil · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 17 min
Assurity Trusted Solutions
Infrastructure Cybersecurity Engineer
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
Assurity Trusted Solutions
Cybersecurity Engineer (GRC Manager)
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h
Assurity Trusted Solutions
Cybersecurity Engineer (GRC with AI)
Assurity Trusted Solutions
⚡ Postuler tôt Singapore, Singapore, Singapor... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Gramian Consulting Group

Voir tous les emplois chez Gramian Consulting Group →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit