RDQ127R176

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

Unity Catalog is our platform native unified and open governance for data and AI. It eliminate silos, simplify governance and accelerate insights at scale. We are looking for a Senior Staff Software Engineer to come tech lead Unity Catalog Runtime Enforcement. We build and harden the runtime enforcement layer for Unity Catalog, ensuring secure, consistent authorization and data access across Databricks compute, engines, and clouds. This reduces incidents and simplifies customer choices by unifying enforcement semantics. 

The impact you will have:

• Lead and grow and engineering team delivering runtime enforcement outcomes in a high-severity, cross-org domain; establish scope, SLAs, and phased roadmaps.
• Establish single-source-of-truth scope, operating model, and durable mechanisms for enforcement.
• Lead multi-year, multi-team initiatives that shape how Databricks enforces Unity Catalog at runtime across compute types and engines.
• Introduce tools to allow greater automation and operability of services.
• Use your deep experience to help prevent and investigate production issues.
• Plan and lead complicated technical projects that work with several teams within the company.
• Contribute as a technical team lead by mentoring others, lead sprint planning, delegating work and assignments to team members and participate in project planning.

What we look for:

• 15+ years industry experience building and supporting large-scale distributed systems.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Extensive experience building and maintaining distributed systems.
• Security first mindset.
• Cross-org leadership in ambiguous, incident-heavy environments; disciplined rollout and ops maturity.
• Motivated by delivering customer value and impact.
• Experience driving company initiatives towards customer satisfaction.
• BS/MS/PhD in Computer Science or related majors, or equivalent experience.
•  

RDQ127R264

This role is open to remote candidates within the Europe, with a preference for those based in London, Netherlands, Germarny or Denmark.

Databricks is seeking an exceptional and strategic  Sr. Staff Security Engineer, Incident Response to join our Incident Response team. This pivotal role will provide decisions that have a direct impact on the long-term success of Databricks' security posture, creating solutions that enable potential future opportunities without a known path. You will play a key role in developing multi-year technology strategy for complete and critical areas of the business, encompassing multiple systems and teams, consistently delivering large-scale projects that meet company goals.

The Incident Response team's mission is to rapidly, efficiently, and standardly respond to security threats, incidents, and investigations to protect our customers, employees, and enterprise data. We leverage Databricks' own platform for near-real-time log analytics, alerting, and forensics, embracing a "Security for Databricks on Databricks" philosophy. As an Sr. Staff Security Engineer, you will tackle the most technical SIRTs, drive complex, open-ended problems with no obvious path to success, act as a multiplier by enabling systems, authoring tools, or introducing policies that elevate the entire organization's productivity.

The impact you will have:

• Strategic Impact & Technical Vision: Drive or influence the organization’s direction and roadmap, leading internal conversations about major technology areas and inspiring adoption. Provide decisions with direct, long-term impact on Databricks' success.
• Incident Leadership & Crisis Management: Lead complex investigations and impact analysis, performing crisis management using the Incident Management System (IMS). Engage with various stakeholders and communicate findings to executive leadership, ensuring successful navigation of major security incidents with minimal business impact.
• Advanced Threat Management: Exhibit expert knowledge in all cloud vendors used by Databricks (AWS, Azure, GCP), deeply understanding the entire architecture of major business components and articulating their security and risk limits. Drive the establishment of a cutting-edge threat detection and response program, significantly reducing Mean Time to Detect (MTTD) and Mean Time to Respond (MTTR) to security incidents.
• Technical Innovation & Automation: Architect scalable and organized frameworks for security automation and orchestration, including pre-investigation analysis and triage of alerts. Understand trends and directions of the security industry within your domain and architect large-scale designs consistent with organizational and company goals.
• Problem Solving: Demonstrate the ability to fix difficult and company-impactful problems wherever they lie, even if outside your comfort zone. Possess a full understanding of what malicious activity looks like in each cloud layer (network, storage, compute), understanding existing logs and correlating from multiple sources during an investigation.
• Cross-Functional Collaboration & Mentorship: Serve as a role model and mentor to every technical member of the team. Identify areas where Databricks can share effectively with the outside world, guiding content creation and communication via presentations and blogs. Work across departments, integrating security practices into various aspects of the organization and product development lifecycle.

What we look for:

• Experience: Typically 12+ years of experience in security, with a strong focus on incident response, detection, and/or threat intelligence, or an advanced degree with 8+ years of experience. This includes deep expertise in Incident Management and Incident Response tool development.
• Cloud Security Expertise: Demonstrates knowledge of Azure and AWS cloud concepts, showing expertise in analyzing logs, correlating available log sources to conclude an attack scenario, and identifying logging gaps to suggest best configurations for IR needs. You can function as an architect of cloud deployment and map cloud environment fundamentals to other major providers.
• Digital Forensics: Highly skilled in multiple areas of digital forensics (e.g., Network, Application/Log Analysis, Host/Disk, Memory Forensics/Malware Analysis, Cloud Forensics, Endpoint Forensics), able to speak confidently on advanced concepts like virtualized networking, advanced network anomalies, and container forensics.
• Enterprise Security: Has a detailed understanding of enterprise security incidents and in-depth knowledge of malware on endpoints. Possesses expert understanding of MacOS security posture and architecture.
• Technical Depth: Proficient with SIEM and SOAR platforms, EDR solutions, and forensic analysis tools. Skilled in leveraging AI and automation technologies to enhance security operations and threat detection capabilities.
• Leadership & Communication: Exceptional ability to engage in difficult conversations, handle them appropriately, and exhibit empathy and emotional intelligence. Proven capability to build, mentor, and lead high-performing cybersecurity teams, fostering a culture of excellence and continuous improvement. Strong communication of technical decisions through design docs and tech talks.
• Bias for Action & Collaboration: A history of proactively identifying and solving issues that impact the team and company. Demonstrates a strong desire to help peers and collaborate effectively.
• Customer/Stakeholder Obsessed: Able to push back or say no to unreasonable stakeholder requests in a professional and constructive manner.

P-1344

As a software engineer with a backend focus, you will work with your team to build infrastructure for the Databricks platform at scale.

The impact you'll have:

Our backend teams cover a diverse range of domains, from core compute fabric resource management to service platforms and machine learning infrastructure. For example, you might work on challenges such as:

• Supporting Databricks' growth by building foundational infrastructure platforms that enable seamless operation across numerous geographic regions and cloud providers.
• Implementing cloud-agnostic infrastructure abstractions to help Databricks engineers more efficiently manage and operate their services.
• Develop tools and processes that drive engineering efficiency at Databricks. We enhance the developer experience for Databricks engineers across various areas, including programming languages, linters, static analysis, IDEs, remote development environments, automated release pipelines, and test automation frameworks. Our current focus is on optimizing the Rust development experience across the organization.

What we look for:

• 8+ years of professional software development experience.
• Bachelor’s degree or higher in Computer Science, a related field, or equivalent experience.
• Proficiency in one or more backend languages such as Java, Scala, or Go.
• Hands-on experience in developing and operating large-scale, critical distributed backend systems.
• Demonstrated leadership throughout all project phases, from inception and design to implementation and operations, with a strong ability to drive architectural decisions and guide teams through complex challenges.
• Experience mentoring engineers, influencing best practices, and fostering a collaborative engineering environment.
• Self-driven and passionate with a strong focus on delivering impact through team collaboration.
• Strong written and verbal communication skills to drive alignment across teams, and contribute to both technical documentation and strategic decisions.
• Experience with infrastructure systems, security, and sensitive data, as well as familiarity with Kubernetes or cloud platforms like AWS, Azure, or GCP.

P-1127

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission is to deliver industry-leading performance and a seamless user experience at massive scale, with most data written in Databricks flowing through our platform.  We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.

We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will be instrumental in designing, developing, and maintaining robust backend systems that power Databricks workspaces. You will build the next-generation platform for serving workspace assets, ensuring high QPS, low latency, reliable, and performant systems, proactively addressing the future growth challenges. Additionally, as a senior member of the team, you will provide technical leadership, mentorship, and guidance to junior engineers, contributing to the overall improvement of team coding practices and system designs.

The Impact you will have:

• Solve real business needs at large scale by applying your software engineering.
• Low level systems debugging, performance measurement, and optimization on large production clusters.
• Build architecture design, influence product roadmap, and take ownership and responsibility over new projects.
• Introduce tools to allow greater automation and operability of services.
• Use your deep experience to help prevent and investigate production issues.
• Plan and lead complicated technical projects that work with several teams within the company.
• Contribute as a technical team lead by mentoring others, lead sprint planning, delegating work and assignments to team members and participate in project planning.

What we look for:

• 15+ years industry experience building and supporting large-scale distributed systems.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Motivated by delivering customer value and impact.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience driving company initiatives towards customer satisfaction.
• BS/MS/PhD in Computer Science or related majors, or equivalent experience.