Jobs Companies Flatgigs Python Data Engineer

Sobre esta vaga de Python Data Engineer na Flatgigs

Flatgigs · Sri Lanka

Our client is building an operations management platform that handles workforce planning, rostering, dispatching, and performance analytics for a large-scale field operations environment. You will own the Python engine layer, responsible for the algorithms and data processing that power the core operational workflows used daily by operations teams.

This is not a typical web backend role. You will be working on constraint-based planning algorithms, large-scale data processing pipelines, and event-driven dispatch engines that operate in real time against live operational data.

WHAT YOU'LL OWN:

  • Planning engine: processing large volumes of operational schedule data through constraint evaluation, business rules, and engagement profiles to produce workforce planning demands. Built on Celery, Polars, and OR-Tools running on Azure App Service
  • Rostering engine: generating periodic staff rosters by solving constraint problems against planning demands, employee certifications, and leave data pulled from third-party HR systems. Running as an Azure Function App
  • Dispatch engine: real-time task assignment using proximity scoring against live employee location data, attendance records, and operational schedule data. Running as an always-on Azure Function App or App service.
  • Performance engine: scheduled KPI aggregation and SLA scoring across all modules. Running as a timer-triggered Azure Function App

WHY'S THIS ROLE INTERESTING:

The planning engine is the core of this platform. The algorithm you build determines how efficiently an operations team deploys its workforce against a complex schedule of demands. When the platform matures, the rule-based constraint engine you build will become the foundation for an ML-driven prediction model. You are building something that runs in a live operational environment and directly impacts how a team performs on the ground every day.

WHAT YOU'LL WORK WITH:

  • Python 3.11
  • Celery with Redis as broker for long-running jobs
  • Polars for large-scale data processing
  • OR-Tools for constraint solving and optimisation
  • Azure Functions for event-driven and scheduled workloads
  • Azure SQL via SQLAlchemy for output persistence
  • Azure Blob Storage for intermediate file handling
  • Azure Service Bus for async message queuing between modules
  • Third-party HR and workforce management API integrations
  • Real-time location data streams for proximity-based task assignment

Requirements

WHAT WE ARE LOOKING FOR:

Required:

  • 5 or more years of Python backend or data engineering experience
  • Experience with constraint solving, optimization, or scheduling algorithms (OR-Tools, PuLP, or equivalent)
  • Strong data processing experience with large datasets (Polars, pandas, or Apache Spark)
  • Experience with task queues and async processing (Celery, RQ, or equivalent)
  • Familiarity with Azure
  • Comfortable working with SQL databases and writing performant queries
  • Experience consuming REST APIs and message queues

Preferred:

  • Experience with Azure Functions or equivalent serverless compute
  • Experience with OR-Tools specifically
  • Knowledge of scikit-learn or ML model integration (ONNX, Azure ML) for a future ML upgrade path
  • Experience with Pydantic for data validation and schema enforcement

Nice to have:

  • Experience with large-scale workforce management or scheduling systems
  • Familiarity with SLA-based operational frameworks
  • Experience working in fast-paced, operationally critical environments

WHAT YOU "DO NOT NEED" TO KNOW:

This is a pure Python engineering role. You will not be expected to write TypeScript, work on the API layer, or contribute to the frontend.

Your responsibility sits clearly within the Python processing layer. The integration boundary between your work and the wider platform is Redis and Azure SQL. You will write clean, reliable outputs into these systems, and the surrounding services will consume them from there.

In simple terms: you own the Python logic and data processing. The rest of the platform reads from what you produce.

Pronto para se candidatar à Flatgigs?
Candidatar-se à Flatgigs

Sobre a Flatgigs

Flatgigs, Your Strategic Execution Partner for Startup Growth in MENA.

We go beyond recruitment. Flatgigs specializes in strategically solving critical talent and operational gaps that hinder startup scaling across the MENA region. Headquartered in the dynamic hub of Dubai, UAE, we connect high-growth companies with exceptional, sector-specific talent – the kind that demonstrably drives measurable ROI, accelerates revenue milestones, and builds sustainable, long-term value.

Ver todas as vagas na Flatgigs →

Vagas semelhantes

Pearl
Remote Senior Backend Engineer for Data and Analytics Company
Pearl
⚡ Candidate-se cedo Mexico City, Mexico City, Mexi... Remoto
● Nova 👁 Vista ✓ Candidatada há 38min
Medical Guardian
Principal Data Engineer
Medical Guardian
⚡ Candidate-se cedo Philadelphia, Pennsylvania, Un... Presencial
● Nova 👁 Vista ✓ Candidatada há 40min
Sangoma
AI Data Engineer
Sangoma
⚡ Candidate-se cedo Toronto, Ontario, Canada Remoto
● Nova 👁 Vista ✓ Candidatada há 47min
VM
Senior Data Engineer
Verse Medical
⚡ Candidate-se cedo New York City Híbrido $150,000–$200,000
● Nova 👁 Vista ✓ Candidatada há 1h
RA
Senior Software Engineer - Backend (Data)
Read AI, Inc.
⚡ Candidate-se cedo Read AI - Seattle HQ Híbrido
● Nova 👁 Vista ✓ Candidatada há 1h
Fluidstack
Geotechnical Engineer, Data Center Design
Fluidstack
⚡ Candidate-se cedo Austin, TX Híbrido $161,000–$197,000
● Nova 👁 Vista ✓ Candidatada há 1h
Fluidstack
Controls Engineer — Critical Facilities & Data Center Operations
Fluidstack
⚡ Candidate-se cedo Lubbock, TX Presencial $161,000–$208,000
● Nova 👁 Vista ✓ Candidatada há 1h
Fluidstack
IT Engineer, Data Center
Fluidstack
⚡ Candidate-se cedo San Francisco, CA Presencial $218,000–$252,000
● Nova 👁 Vista ✓ Candidatada há 1h
Cartesia
Software Engineer, Data Infrastructure
Cartesia
⚡ Candidate-se cedo *HQ - San Francisco, CA Presencial $180,000–$250,000 🛂 Patrocínio de visto
● Nova 👁 Vista ✓ Candidatada há 1h

Cadastre-se para receber sugestões sob medida com base nas vagas que você abre e nas buscas que você salva.

Mais vagas na Flatgigs

Ver todas as vagas na Flatgigs →

Candidatar-se agora
🤖

Opa — calma aí

A JobsRadar foi feita para pessoas de verdade passando por um momento difícil na busca por emprego — não para requisições automatizadas. Você está clicando rápido demais e agora está temporariamente bloqueado.

Volte mais tarde. Se você está mesmo procurando emprego, estamos com você — apenas aja como um ser humano.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Ganhe vantagem na sua busca por emprego.

Entre no nosso canal do Telegram para o que ajuda você a conseguir a vaga — referências salariais, o pulso semanal do mercado e avisos de novos recursos. Sem spam, só sinal.

Entre no canal — é grátis