Jobs Companies OpenDataJobs Data Engineer (AWS, Spark)

À propos de ce poste Data Engineer (AWS, Spark) chez OpenDataJobs

OpenDataJobs · Hybride · Washington, District of Columbia, United States

At Peregrine Advisors, you will build the pipelines that move a federal agency's data from source to platform. But we hire people, not seats. As the work evolves, you will learn new systems and tools, take on greater responsibility, and help develop the firm's capabilities, tools, and lines of business. We move our best to where the hardest problems are.

This is a full-time W-2 position with a salary of $103,000 to $140,000 per year. It is a hybrid work arrangement based in the Washington, DC metropolitan area, and the commuting cadence varies by assignment. The initial engagement requires United States citizenship and the ability to obtain a Public Trust determination.

We are a data and technology innovation hub and a Benefit Corporation working at the center of the federal government's mission to deliver for client stakeholders and the US public.

Your first project

Your first project will likely have you building ingest, processing, and storage at scale. Depending on the assignment, you may:

  • Build Spark-based extract, transform, and load (ETL) pipelines with Glue, Amazon EMR, Lambda, and Step Functions.
  • Write the processing in Python and PySpark.
  • Design the S3 layer, including Parquet, partitioning, and lifecycle, feeding Apache Iceberg tables.
  • Connect PostgreSQL on Amazon Aurora and DynamoDB, with Trino for federated Structured Query Language (SQL) across them.

You deliver pipelines that keep data clean and trustworthy at the volumes a federal platform runs at. You automate ingestion that used to be handled case by case, and you build the storage design everything downstream depends on.

This is where you start, not the shape of your career here.

Requirements

  • 4+ years of data engineering experience
  • Bachelor's degree
  • Spark ETL on AWS (Glue, Amazon EMR) in Python and PySpark
  • S3 data-lake design (Parquet, partitioning, lifecycle) feeding Apache Iceberg tables, Amazon Aurora PostgreSQL, and DynamoDB
  • Event orchestration (Lambda, Step Functions, SQS/SNS) with secrets management and monitoring
  • Data quality, validation, and lineage
  • Infrastructure-as-code (CloudFormation or Terraform)
  • Basic proficiency in writing, PowerPoint, and Excel

Preferred

  • Master's degree in a relevant field
  • Trino or comparable federated SQL across the lake and relational stores
  • Apache Ranger-governed access
  • Legacy ETL migration (for example DataStage)
  • Federal information technology or high-volume data experience
  • Familiarity with AI-assisted developer tooling

Who you are

You are a data engineer who wants to get better at it, and you know which parts you have not mastered yet. You care as much about whether the data is trustworthy as whether it arrives, and you do your best work alongside people who push you. You experiment, fail, learn, and repeat quickly. You would rather own an outcome than be handed a task.

What you bring

  • Hands-on data engineering on AWS: Spark ETL (Glue, EMR), Python and PySpark, and S3 data-lake design feeding the platform stores.
  • The reliability craft around it: event orchestration, data quality and lineage, monitoring, and infrastructure-as-code.
  • The judgment to build in a regulated environment where accuracy and auditability are not optional.

You adapt your development workflow as AI tools evolve, using them to help implement, test, and improve the components you own. You give the tools clear context, review and test their output, and remain accountable for the code you deliver.

When we talk

Be prepared to discuss a difficult problem you worked through, the decisions you made, what happened, and what you learned.

Benefits

Medical, dental, and vision with the employee premium fully paid and half of dependent premiums; employer-paid life, accidental death, and short-term and long-term disability insurance; a 401(k) matched 100% up to 4% of salary, vesting immediately; unlimited paid time off; and sponsored professional certifications and continuing education.

What we offer

You will work alongside developers, engineers, data scientists, architects, and strategists, on work ranging from strategy to implementation. We support your development across assignments and clients through extensive onboarding, sponsored professional certifications such as the Data Management Capability Assessment Model (DCAM) and AWS technical certifications, and rotation across functions to expand your skills and perspective. The mission is real, the problems are hard, and you own what you ship.

What we commit to

As a Benefit Corporation, our commitment runs three ways: real, measurable value for our clients; government that works better for the public; and a team that makes everyone in it better.

We hire people who want to help build the firm, not just work at it. If that is you, apply.

Peregrine Advisors is an equal opportunity employer.

Peregrine exclusively works with OPEN Data Jobs to recruit our team. Register with OPEN Data Jobs to be considered for this and future openings.

Prêt à postuler chez OpenDataJobs ?
Postuler chez OpenDataJobs

Comment se compare ce salaire pour Data Engineer

Ce poste paie $121,500/yren dessous de la fourchette habituelle pour les postes Data Engineer.

$92,840 la médiane $156,825 $242,500

Fourchette typique $123,750–$196,750/yr, à partir de 1,647 annonces Data Engineer comparables sur JobsRadar (rémunération annualisée en USD). Voir les aperçus de salaire pour Data Engineer →

À propos de OpenDataJobs

Connecting Data and Tech Professionals with a world of opportunities

Voir tous les emplois chez OpenDataJobs →

Emplois similaires

Workana
AI Web Scraping Engineer (Stealth Data Acquisition)
Workana
⚡ Postuler tôt United States · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 6 j
Hewlett Packard Enterprise
Senior Technical Marketing Engineer (TME) – Data Center Networking (Apstra)
Hewlett Packard Enterprise
⚡ Postuler tôt All, California, United States... Sur site $136,500–$276,500
● Nouveau 👁 Vu ✓ Postulé il y a 1 sem.
9W
ETL Developer
9th Way Insignia
⚡ Postuler tôt Washington, District of Columb... Sur site $77,135–$89,000
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
9W
Expert ETL Developer
9th Way Insignia
⚡ Postuler tôt Washington, District of Columb... Sur site $118,737–$150,000
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
Rhombus Power, Inc.
Data Engineer (Secret/Top Secret), Washington D.C.
Rhombus Power, Inc.
⚡ Postuler tôt Washington, District of Columb... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 2 sem.
OpenDataJobs
Data Engineer Role
OpenDataJobs
⚡ Postuler tôt Washington, District of Columb... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
Node.Digital
Senior Data Engineer
Node.Digital
⚡ Postuler tôt Washington, District of Columb... · lieu restreint
● Nouveau 👁 Vu ✓ Postulé il y a 1 mois
H2 Performance Consulting
Data Systems Engineer
H2 Performance Consulting
⚡ Postuler tôt Washington, District of Columb... Sur site
● Nouveau 👁 Vu ✓ Postulé il y a 2 mois
SE
Senior Data Platform Engineer
SentiLink
⚡ Postuler tôt United States · lieu restreint $170,000–$170,000
● Nouveau 👁 Vu ✓ Postulé il y a 1 h

Inscrivez-vous pour des suggestions adaptées aux emplois que vous ouvrez et aux recherches que vous enregistrez.

Plus d’emplois chez OpenDataJobs

Voir tous les emplois chez OpenDataJobs →

Postuler maintenant
🤖

Doucement — un instant

JobsRadar a été conçu pour de vraies personnes qui traversent une période difficile dans leur recherche d’emploi — pas pour des requêtes automatisées. Vous cliquez beaucoup trop vite et vous êtes maintenant temporairement bloqué.

Revenez plus tard. Si vous cherchez réellement un emploi, nous sommes de votre côté — agissez simplement comme un être humain.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Prenez une longueur d’avance dans votre recherche d’emploi.

Rejoignez notre canal Telegram pour ce qui vous aide à décrocher le poste — références salariales, le pouls hebdomadaire du marché et les annonces de nouveautés. Pas de spam, que du signal.

Rejoindre le canal — c’est gratuit