About this Lead Developer - Databricks role at Beghouconsulting
About the Role
We are seeking an experienced Team Lead - Databricks Applications to lead a team of developers building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure delivery of enterprise-ready solutions.
What you will do
- Architect and design production applications on the Databricks platform
- Drive technical decisions on application patterns, security, and performance
- Build and optimise data pipelines using Databricks Workflows and Delta Lake
- Establish coding standards, best practices, and code review processes
- Configure Unity Catalogue for data governance and access management
- Oversee cloud security, service principals, and permissions strategy
- Own application monitoring, performance tuning, and cost optimisation
- Lead and mentor a team of 1-2 Databricks developers
- Collaborate with stakeholders to translate requirements into technical solutions
- Participate in Agile ceremonies and contribute to sprint planning and delivery
You'll need to have:
- 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms
- 2+ years of experience in a technical leadership role
- Expert-level Python and SQL development skills
- Strong experience with REST API and web application development
- Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake
- Experience with compute management and performance optimization at scale
- Strong understanding of cloud security, identity management, and service principals
- Track record of turning prototypes into production-ready enterprise applications
- Excellent communication and stakeholder management skills
- Bachelor's or master's degree in computer science or related field
Preferred Qualifications
- Experience with CI/CD pipelines and Git workflows
- Familiarity with infrastructure as code (Terraform, ARM templates)
- Automated testing strategies (unit, integration, end-to-end)
- Frontend development experience with React
- Databricks certifications (Data Engineer Associate, Platform Administrator)