Jobs › Companies › Fractal › Lead Data Engineering - Product Engineering & Delivery

About this Lead Data Engineering - Product Engineering & Delivery role at Fractal

Fractal · Onsite · Bengaluru

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Role Overview

Cogentiq I2C is Fractal’s agentic AI Product for invoice-to-cash, covering Collections, Cash Application, Deductions, Invoice Management and Credit Risk. It runs on a Next.js front end, a FastAPI service layer, the Cogentiq agentic runtime, and a data tier on Azure Databricks with PostgreSQL.


We are looking for a hands-on Data Engineering Leader with strong experience in building scalable, configurable, and cloud-agnostic data engineering solutions. The role requires a combination of deep technical expertise, product engineering mindset, and proven ownership of enterprise client deliveries.


A critical requirement is hands-on experience across at least two cloud data engineering platforms, with the ability to design portable PySpark-based pipelines and migrate workloads between platforms with minimal rework

.

Key Responsibilities

  • Data Engineering & Architecture: Design and develop scalable ETL/ELT pipelines, distributed data processing frameworks, Lakehouse solutions, and Medallion architectures (Bronze/Silver/Gold).
  • Cloud-Agnostic Engineering: Build reusable, metadata-driven, configuration-based data pipelines that can operate across different cloud environments and processing platforms.
  • Multi-Platform Portability: Architect and migrate PySpark workloads across platforms such as Databricks, Microsoft Fabric, AWS Glue/EMR, and GCP Dataproc, managing platform-specific dependencies and optimizations.
  • Product Engineering: Develop reusable frameworks, connectors, orchestration capabilities, and accelerators that support multiple enterprise clients with minimal customization.
  • Enterprise Integration: Design upstream and downstream integrations with SAP ECC/S/4HANA and other enterprise systems using APIs, BAPIs, IDocs, OData, CDC, and event-driven interfaces.
  • Data Governance: Implement data quality, cataloging, metadata management, lineage, security, and reconciliation capabilities.
  • DevOps & DataOps: Establish CI/CD, automated testing, infrastructure automation, observability, monitoring, and production support practices.
  • Engineering & Delivery Leadership: Lead engineering teams, own architecture and technical decisions, drive end-to-end client delivery, and ensure engineering quality, scalability, and production readiness.

Required Skills & Experience

  • 12+ years of engineering experience, including significant hands-on Data Engineering experience and technical leadership.
  • Strong hands-on expertise in Python, PySpark, Spark, SQL, distributed processing, and performance optimization.
  • Hands-on experience with at least TWO data engineering platforms, such as: Azure DatabricksMicrosoft FabricAWS Glue / EMRGoogle Cloud Dataproc / Dataflow
  • Demonstrated ability to migrate or adapt PySpark pipelines between platforms, understanding differences in execution environments, storage, orchestration, dependencies, and deployment.
  • Experience building configurable, metadata-driven ETL/ELT frameworks, reusable components, and cloud-agnostic data pipelines.
  • Strong understanding of Lakehouse architecture, Delta Lake, Medallion Architecture, data modeling, cataloging, lineage, and data quality.
  • Experience with enterprise systems integration, preferably SAP (upstream ingestion and downstream write-back).
  • Experience with DevOps/DataOps, CI/CD, automated testing, and production deployments.
  • Proven experience in product engineering, engineering team leadership, and end-to-end enterprise client delivery.

Good-to-Have

  • Experience with additional data platforms, including Snowflake, BigQuery, or Azure Synapse.
  • Experience with data governance tools such as Unity Catalog, Microsoft Purview, AWS Glue Data Catalog, or Collibra.
  • Experience with streaming pipelines, Kafka, CDC, and event-driven architectures.
  • Exposure to ML/AI data pipelines using SageMaker, Vertex AI, or Databricks ML.
  • Experience building reusable enterprise data products or accelerators for multiple clients.

Ideal Candidate

A hands-on engineering leader, not just a delivery manager or solution architect, who has built production-grade data pipelines, worked across multiple data engineering platforms, understands how to make PySpark workloads portable, and can lead both product development and complex enterprise client deliveries.


Critical Hiring Criteria: Strong PySpark engineering + hands-on experience across at least two DE platforms + configurable pipeline development + engineering delivery ownership.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Ready to apply to Fractal?
Apply to Fractal

About Fractal

At Fractal, towards our goal of “powering every human decision in the enterprise”, our partnerships and alliances help in creating and delivering a compelling suite of solutions to unlock value. We partner with companies from around the globe, leaders in their respective fields. With Fractal’s expertise in artificial intelligence, design, engineering, and digital transformation, combined with the data, technology, and software platforms from our partners, we create cutting-edge solutions to problems in the business world. We understand how critical and timely decision triggers, and information, empower our clients to create, unlock, deliver, and realize value. Together with our partners, our

See all jobs at Fractal →

Similar jobs

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at Fractal

See all jobs at Fractal →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free