Jobs Companies NDEAVOUR CONSULTING Senior Data Engineer (Databricks / AWS)

About this Senior Data Engineer (Databricks / AWS) role at NDEAVOUR CONSULTING

NDEAVOUR CONSULTING · Remote · All Cities

Mobile Wave Solutions is a professional services company specializing in software development as a service. With a team of over 120 engineers, we deliver scalable, high-quality software that empowers our global clients to innovate and grow. We value collaboration, technical excellence, and a pragmatic approach to solving complex problems.

About the Role

The Senior Data Engineer will design, build, and optimize next-generation Lakehouse data platform. This is a hands-on role focused on transforming complex, legacy datasets into structured, high-quality data products that power analytics and operational workflows. We seek a proactive, independent problem-solver who excels in a fast-paced rebuild environment, maintains code stability (including AI-generated code), and drives rapid iteration.

Key Responsibilities

  • Design and implement robust, scalable data ingestion and transformation pipelines using Databricks, PySpark, and distributed processing. Utilize Airflow (or similar) for reliable workflow orchestration.

  • Implement Delta Lake principles, focusing on CDC and schema evolution. Establish and integrate data quality frameworks (e.g., Great Expectations) within CI/CD pipelines for data integrity.

  • Develop and optimize complex SQL and Python scripts. Integrate diverse data sources (APIs, S3 files, etc.) and handle both structured and unstructured data.

  • Support the implementation of data governance and cataloguing solutions (e.g., Unity Catalog). Proactively investigate and improve inconsistent legacy datasets.

  • Guide and manage AI agents for code generation, ensuring quality and stability. Work pragmatically and collaboratively to drive technical solutions.

Qualifications

  • 5+ years of professional experience in data engineering, focused on cloud and distributed processing environments.

  • Strong experience with Databricks, PySpark, distributed processing, and Delta Lake. Deep knowledge of CDC and schema evolution.

  • Expert SQL optimization and Python skills. Hands-on experience with Airflow (or similar).

  • Familiarity with relevant AWS components. Good understanding of CI/CD for data workflows and implementing data quality frameworks.

  • Knowledge of streaming (Kafka/Kinesis) and exposure to Unity Catalog or similar governance tools.

  • Proactive problem-solver; comfortable working with complex, inconsistent data without needing explicit specs.

  • Able to work independently in a fast-paced rebuild environment.

  • Collaborative, pragmatic, thrives on rapid iteration.

  • Skilled at directing AI agents to code while maintaining high quality standards.

Our Benefits

  • Remote Office – Flexible hybrid form of working

  • Parking Space – We provide free parking spots

  • Fun Office Space – We offer a game zone and a relaxation area

  • Health Insurance – Additional private health insurance, including a dental care plan

  • Personal Development – Company-sponsored training budget to further develop your skills

  • Employee Referral Program – Receive a bonus for referring a friend

  • Holidays – Enjoy an extra 5 days after your 1st and 5th year

  • Social Events – We love to celebrate our success together

  • Family Insurance – Add insurance to a family member

  • Offering sports cards – 100% sponsored by the company

Ready to apply to NDEAVOUR CONSULTING?
Apply to NDEAVOUR CONSULTING

Similar jobs

Sign up for suggestions tailored to the jobs you open and the searches you save.

More jobs at NDEAVOUR CONSULTING

See all jobs at NDEAVOUR CONSULTING →

Apply now
🤖

Whoa — hold up

JobsRadar was built for real people having a rough time in their job search — not for automated requests. You're clicking way too fast and you're now temporarily blocked.

Come back later. If you're genuinely job hunting, we've got your back — just act like a human.

Catch your next role the second it’s posted.

Create a free account and we’ll watch the boards for you — the instant a job matches your search, it lands in your inbox or Telegram. No digging, no refreshing.

Create free account

Free forever · takes 30 seconds · already have one?

Get an edge on your job hunt.

Join our Telegram channel for the stuff that helps you land the role — salary benchmarks, the weekly market pulse, and new-feature drops. No spam, just signal.

Join the channel — it's free