Senior Staff Software Engineer - Delta

Senior Staff Software Engineer - Delta

Full-Time 48000 - 72000 £ / year (est.) Hybrid
Databricks Inc.

At a Glance

  • Tasks: Design and develop robust backend systems for Databricks workspaces, ensuring high performance.
  • Company: Join Databricks, a leader in data and AI infrastructure, with a collaborative culture.
  • Benefits: Enjoy comprehensive benefits, competitive salary, and opportunities for professional growth.
  • Other info: Be part of a diverse team committed to inclusion and innovation.
  • Why this job: Make a real impact by solving complex problems at scale with cutting-edge technology.
  • Qualifications: 15+ years in large-scale distributed systems; strong algorithms and data structures knowledge.

The predicted salary is between 48000 - 72000 £ per year.

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission is to deliver industry-leading performance and a seamless user experience at massive scale, with most data written in Databricks flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.

We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will be instrumental in designing, developing, and maintaining robust backend systems that power Databricks workspaces. You will build the next-generation platform for serving workspace assets, ensuring high QPS, low latency, reliable, and performant systems, proactively addressing the future growth challenges. Additionally, as a senior member of the team, you will provide technical leadership, mentorship, and guidance to junior engineers, contributing to the overall improvement of team coding practices and system designs.

The Impact you will have:

  • Solve real business needs at large scale by applying your software engineering.
  • Low level systems debugging, performance measurement, and optimization on large production clusters.
  • Build architecture design, influence product roadmap, and take ownership and responsibility over new projects.
  • Introduce tools to allow greater automation and operability of services.
  • Use your deep experience to help prevent and investigate production issues.
  • Plan and lead complicated technical projects that work with several teams within the company.
  • Contribute as a technical team lead by mentoring others, lead sprint planning, delegating work and assignments to team members and participate in project planning.

What we look for:

  • 15+ years industry experience building and supporting large-scale distributed systems.
  • Comfortable working towards a multi-year vision with incremental deliverables.
  • Motivated by delivering customer value and impact.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience driving company initiatives towards customer satisfaction.
  • BS/MS/PhD in Computer Science or related majors, or equivalent experience.

About Databricks:

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow.

Benefits:

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

Our Commitment to Diversity and Inclusion:

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance:

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Senior Staff Software Engineer - Delta employer: Databricks Inc.

Gravitas is an exceptional employer that fosters a collaborative and innovative work culture, perfect for those passionate about data architecture. Located in a vibrant tech hub, we offer competitive benefits, continuous professional development opportunities, and the chance to work with cutting-edge technologies like Databricks. Join us to make a meaningful impact while advancing your career in a supportive environment.

Databricks Inc.

Contact Details:

Databricks Inc. Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Staff Software Engineer - Delta

✨Tip Number 1

Network like a pro! Reach out to current employees at Databricks on LinkedIn or through mutual connections. A friendly chat can give you insider info and might just get your foot in the door.

✨Tip Number 2

Show off your skills! Prepare a portfolio or GitHub repository showcasing your best projects, especially those related to large-scale systems. This is your chance to demonstrate your expertise in action.

✨Tip Number 3

Ace the interview by practising common technical questions and system design scenarios. We recommend doing mock interviews with friends or using platforms that simulate real interview conditions.

✨Tip Number 4

Apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining the Databricks team.

We think you need these skills to ace Senior Staff Software Engineer - Delta

Backend Systems Development
Large-Scale Distributed Systems
Performance Measurement
Low Level Systems Debugging
Architecture Design
Algorithms and Data Structures
Technical Leadership

Some tips for your application 🫡

Tailor Your CV:Make sure your CV reflects the skills and experiences that align with the Senior Staff Software Engineer role. Highlight your experience with large-scale distributed systems and any relevant projects you've worked on.

Craft a Compelling Cover Letter:Use your cover letter to tell us why you're passionate about data and AI. Share specific examples of how you've solved complex problems in previous roles, especially those that demonstrate your leadership and technical skills.

Showcase Your Technical Skills:In your application, don't shy away from showcasing your deep understanding of algorithms, data structures, and system design. We want to see how you can apply these skills to real-world challenges.

Apply Through Our Website:We encourage you to apply directly through our website. This ensures your application gets to the right people and helps us keep track of all candidates efficiently. Plus, it’s super easy!

How to prepare for a job interview at Databricks Inc.

✨Know Your Tech Inside Out

Make sure you have a solid grasp of the technologies and systems mentioned in the job description. Brush up on distributed systems, algorithms, and data structures, as these are crucial for the role. Be ready to discuss your past experiences with large-scale systems and how you've tackled performance issues.

✨Showcase Your Leadership Skills

As a Senior Staff Software Engineer, you'll be expected to lead and mentor others. Prepare examples of how you've guided junior engineers or led projects in the past. Highlight your ability to influence product roadmaps and improve coding practices within teams.

✨Prepare for Technical Challenges

Expect to face technical questions that test your problem-solving skills. Practice coding challenges and system design problems that reflect real-world scenarios. Being able to debug low-level systems and optimise performance will be key, so brush up on those skills.

✨Align with Company Values

Research Databricks' mission and values, especially their commitment to diversity and inclusion. Be prepared to discuss how your personal values align with theirs and how you can contribute to fostering an inclusive culture within the team.