Jobs Companies Aperia Senior Data Platform Engineer

À propos de ce poste Senior Data Platform Engineer chez Aperia

Aperia · Sur site · Dallas, Texas, United States

About Aperia Solutions 

Aperia Solutions is a leading payments SaaS company headquartered in Dallas, Texas. We build risk management, residuals accounting, compliance, and analytics platforms used by merchant banks, ISOs, payment processors, and other participants in the credit card payments ecosystem. Operating under PCI DSS 4.0 compliance across dual on-premises datacenters (Allen, TX and Chicago, IL) plus Azure cloud, we process high-volume payment data for some of the industry’s largest players. 

We’re in the middle of a significant platform modernization program: a next-generation risk analysis and scoring platform on Microsoft Fabric, an AI-powered ingestion platform, new AI-native applications, and ongoing evolution of the products our clients rely on every day. The teams executing this work are deliberately small and senior, with executive-level support and minimal bureaucracy. Every senior hire is a founding contributor to the architecture and the code. 

A

About the Role 

Aperia is building a next-generation risk analysis and scoring platform on Microsoft Fabric, and this role owns its medallion data architecture end-to-end. You'll design and build Bronze / Silver / Gold Delta tables, Fabric Spark feature pipelines, Direct Lake semantic models, and physical-layout optimizations. This is our highest-utilization engineering role on the project — central to both Phase 1 platform foundation and Phase 2 risk product delivery, working alongside a Senior Technical Lead, Senior DevOps engineer, and mid-level developer. 

The platform ingests transaction and merchant data from clients via SFTP and API, tokenizes sensitive PAN data at the ingestion boundary using our reserved-BIN HMAC-derived format-preserving scheme, and lands data in Aperia's canonical Silver on Microsoft Fabric per our internal canonical spec. You'll build the pipeline that populates canonical Silver via MERGE, consume it via OneLake shortcuts, and materialize risk-specific Gold tables that feed both custom-authored DMN rules and pre-scored Mastercard Brighterion feeds. 

What You'll Do 

  • Design and implement Bronze, canonical Silver, and Gold Delta table schemas with PAN-safe physical layout — statistics allowlist configuration, liquid clustering, deliberate retention settings, V-Order optimization. 
  • Build Fabric Spark notebooks for the feature pipeline (rolling velocity features across 24h / 7d / 30d windows, merchant-level rolling features, hierarchical rollups, cross-merchant features via pan_token joins). 
  • Author per-flavor-version Silver adapters — one function per flavor, unioned by name, tested against golden fixtures. 
  • Build the canonical MERGE DAG (Bronze → canonical Silver, idempotent on _natural_key per Aperia's canonical Fabric internal spec v1.4). 
  • Build the Gold materialization pipeline for both grains (fact_transaction_risk, fact_merchant_risk) with correct score-source stamping and idempotent merge semantics. 
  • Design and implement Direct Lake semantic models per reporting surface; performance-test against representative data volumes. 
  • Configure OneLake namespace layouts, workspace catalogs, and cross-workspace shortcut relationships with the residuals programme. 
  • Establish idempotent Delta write patterns using delta-rs from Python containers (segmented parallel writes with single atomic commit). 
  • Fabric capacity sizing (F-SKU selection, load testing, Reservation vs PAYG decisions). 
  • Partner with the DevOps engineer on Fabric IaC (Terraform capacity provisioning plus Fabric REST workspace bootstrap). 
  • Consult on ClickHouse contingency if Direct Lake latency proves insufficient for client-tier UIs. 

What You Bring 

  • 5+ years data engineering experience, with at least 2 years hands-on Spark development (PySpark preferred). 
  • Deep Delta Lake internals knowledge — transaction log format, checkpoints, retention settings (logRetentionDuration, deletedFileRetentionDuration), VACUUM, OPTIMIZE, deletion vectors, statistics collection. 
  • Parquet format expertise — footers, statistics allowlists, row-group sizing, dictionary encoding, column indexes. 
  • Microsoft Fabric hands-on experience — workspaces, capacities, notebooks, lakehouses, semantic models, Direct Lake, SQL analytics endpoint. 
  • SQL performance tuning skills for both OLAP (Fabric) and OLTP (PostgreSQL) workloads. 
  • Strong Python data engineering skills — pandas, PyArrow, delta-rs. 
  • Ability to communicate architecture clearly in writing and to work autonomously on well-scoped features. 

Nice to Have 

  • PCI-scoped data platform experience. 
  • Financial services or payments domain background. 
  • Power BI semantic model authoring (DAX). 
  • Familiarity with published data-standard governance patterns — logical model vs physical profile, SCD2 dimensions, natural-key idempotency, extension attribute stores. 
  • OneLake shortcuts and cross-workspace lakehouse patterns. 
  • ClickHouse or similar OLAP engine familiarity. 
  • Terraform for Azure data resources. 
  • Prior experience with fluid or schema-flexible ingestion patterns. 

Why Aperia 

  • Founding-member impact on a strategic platform serving a multi-hundred-million-dollar industry — your architectural decisions carry weight and ship to production. 
  • Direct working relationship with the SVP of Technology; small team; minimal bureaucracy; senior peers. 
  • Genuine engineering culture — technical correctness valued over slideware; extensive design documentation; real design reviews; ADR discipline. 
  • Explicit team commitment to AI-assisted development (Claude Code, Cursor, GitHub Copilot) — treated as a first-class productivity multiplier, not a novelty. Team standards documented and enforced. 
  • Modern tech stack: Microsoft Fabric, AKS, Azure, Airflow, Python, Delta Lake, Kogito/DMN, OpenBao, Kubernetes. 

Eligibility Requirements

  • Must be willing to submit to a background investigation and drug test as part of the selection process.

Job Type

  • Full-time

Schedule

  • Hybrid / Monday to Friday 

Work Location

  • Dallas, TX

Benefits

  • Health insurance 
  • Health savings account
  • Dental insurance
  • Vision insurance
  • 401(k) matching
  • Life insurance
  • Paid time off
  • Parental leave
  • Disability insurance
  • Childcare assistance
  • Education reimbursement
  • Fitness membership
  • Volunteer time off

 

Prêt à postuler chez Aperia ?
Postuler chez Aperia

À propos de Aperia

Join Aperia Solutions, a leader in SaaS solutions for the Payments and Compliance industries. Aperia is a Texas-based fintech and managed consultancy firm that creates custom SaaS applications and other software-based solutions for the payments, banking, and processing industry. Founded in 1999, Aperia offers business intelligence, risk management, compliance, and customer intelligence platforms. With offices in Dallas, Washington DC, and Vietnam, Aperia is a fast-paced, global organization that strives to improve efficiency in compliance, risk, and customer service operations. Aperia’s clients include banks, processors, payment facilitators, merchant service providers, independent sales organizations, and government entities. A career at Aperia promises a great challenge, culture, and opportunities to forge your own path. 

Voir tous les emplois chez Aperia →

Emplois similaires

Mindrift
Senior Python Data Scraping Engineer (Freelance)
Mindrift
⚡ Postuler tôt Texas, United States · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 1 j
Databricks
Senior Staff Backline Engineer - Data & AI
Databricks
⚡ Postuler tôt Dallas, Texas; San Francisco,... Sur site $354,432–$531,648
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
SNIPEBRIDGE
Civil Engineer | Data Center - 1S6J011
SNIPEBRIDGE
⚡ Postuler tôt Dallas, Texas, United States Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
SNIPEBRIDGE
Senior Data Engineer - 1S6J022
SNIPEBRIDGE
⚡ Postuler tôt Dallas, Texas, United States Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
Royal Electric
Data Engineer
Royal Electric
⚡ Postuler tôt Dallas, Texas, United States Sur site $93,000–$93,000
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Allworth Financial
Sr. Data Engineer
Allworth Financial
⚡ Postuler tôt Dallas, Texas, United States Hybride
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Tiger Analytics Inc.
Senior Data Engineer
Tiger Analytics Inc.
⚡ Postuler tôt Dallas, Texas, United States Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Rad AI
Data Engineer
Rad AI
⚡ Postuler tôt United States Hybride $145,000–$200,000
● Nouveau 👁 Vu ✓ Postulé il y a 3 h
Juniper Square
Senior Staff Software Engineer, Data
Juniper Square
⚡ Postuler tôt Americas (USA or Canada) · lieu restreint $235,000–$285,000
● Nouveau 👁 Vu ✓ Postulé il y a 3 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez Aperia

Voir tous les emplois chez Aperia →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit