Databricks Architect in City of London

Databricks Architect in City of London

City of London Full-Time 72000 - 108000 £ / year (est.) No home office possible
Tredence Inc.

At a Glance

  • Tasks: Lead the design and optimisation of scalable data platforms using Databricks.
  • Company: Join a high-impact data team in London with a focus on innovation.
  • Benefits: Competitive salary, career growth, and exposure to advanced analytics and AI projects.
  • Why this job: Make a real impact by leading large-scale data transformation initiatives.
  • Qualifications: 10-15 years in data engineering, with 5+ years in Databricks architecture.
  • Other info: Collaborative environment with opportunities for professional development.

The predicted salary is between 72000 - 108000 £ per year.

We are seeking a highly experienced Databricks Architect to lead the design, development, and optimization of scalable data platforms and advanced analytics solutions. This role requires a deep understanding of Databricks Lakehouse architecture, big data engineering, cloud ecosystems, and enterprise data strategy. The ideal candidate will partner with business and technology leaders to deliver high-performance data systems that support analytics, AI/ML, and real-time insights.

Key Responsibilities

  • Architecture & Solution Design
  • Architect end-to-end Databricks Lakehouse solutions including data ingestion, ETL/ELT pipelines, Delta Lake, data warehousing, and data governance frameworks.
  • Define and enforce best practices, security standards, and performance optimization across Databricks workloads.
  • Design scalable big data architectures leveraging Spark, Delta Live Tables, Unity Catalog, and MLflow.
  • Lead cloud architecture design on Azure/AWS/GCP (based on organization need) integrated with Databricks.
  • Data Engineering & Platform Build
    • Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta.
    • Oversee data quality frameworks, metadata management, lineage, and monitoring.
  • Leadership & Stakeholder Engagement
    • Work closely with business leaders and product teams to translate requirements into robust technical solutions.
    • Guide development teams, perform architecture reviews, and ensure platform engineering excellence.
    • Conduct technical workshops, POCs, and roadmap planning for the Databricks environment.
  • Performance, Security & Governance
    • Optimize Databricks clusters, query performance, and cost management.
    • Implement data governance standards using Unity Catalog, RBAC, and compliance guidelines (GDPR, ISO).
    • Ensure resilience, scalability, and disaster recovery readiness.

    Required Skills & Qualifications

    • 10–15 years overall experience in data engineering or data architecture.
    • 5+ years of hands-on architecture experience specifically in Databricks.
    • Expert in Apache Spark, PySpark, Databricks SQL, Delta Lake, and distributed systems.
    • Strong understanding of Lakehouse architecture, BI ecosystems, and modern data platforms.
    • Cloud expertise in Azure / AWS / GCP (Azure preferred for many UK clients).
    • Experience with CI/CD, Infrastructure-as-Code (Terraform preferred), and DevOps.
    • Proven experience leading teams and delivering enterprise-grade data solutions.

    Preferred Qualifications

    • Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Architect).
    • Experience building ML solutions using MLflow or integrating with cloud ML services.
    • Experience in BFSI, Retail, Telecom, or Healthcare data environments.
    • Experience with real-time data processing (Kafka, EventHub, Kinesis).

    Soft Skills

    • Excellent communication and stakeholder management skills.
    • Strong problem-solving and solution-oriented mindset.
    • Ability to lead in a fast-paced and dynamic environment.
    • Collaborative, proactive, and able to provide strong technical direction.

    Why Join Us?

    • Work onsite with a high-impact, cutting-edge data team in London.
    • Opportunity to lead large-scale data transformation initiatives.
    • Exposure to enterprise data strategy, advanced analytics, and AI projects.
    • Competitive compensation and career-growth opportunities.

    Databricks Architect in City of London employer: Tredence Inc.

    Join our dynamic team in London as a Databricks Architect, where you'll lead innovative data transformation projects in a collaborative and high-impact environment. We offer competitive compensation, extensive career growth opportunities, and the chance to work with cutting-edge technologies that drive advanced analytics and AI initiatives. Our culture fosters teamwork and excellence, ensuring you thrive while making meaningful contributions to enterprise data strategies.
    Tredence Inc.

    Contact Detail:

    Tredence Inc. Recruiting Team

    StudySmarter Expert Advice 🤫

    We think this is how you could land Databricks Architect in City of London

    ✨Tip Number 1

    Network like a pro! Get out there and connect with folks in the industry. Attend meetups, webinars, or even local tech events. You never know who might have the inside scoop on job openings or can refer you directly to hiring managers.

    ✨Tip Number 2

    Show off your skills! Create a portfolio showcasing your Databricks projects or any relevant work. This gives potential employers a taste of what you can do and sets you apart from the crowd. Plus, it’s a great conversation starter during interviews!

    ✨Tip Number 3

    Prepare for those interviews! Research common questions for Databricks Architects and practice your answers. Be ready to discuss your experience with big data engineering and cloud ecosystems. Confidence is key, so rehearse until you feel like a rockstar!

    ✨Tip Number 4

    Don’t forget to apply through our website! We’ve got some fantastic opportunities waiting for you. Tailor your application to highlight your experience with Databricks and cloud architecture, and let us help you land that dream job!

    We think you need these skills to ace Databricks Architect in City of London

    Databricks Lakehouse architecture
    Big data engineering
    Data ingestion
    ETL/ELT pipelines
    Delta Lake
    Data warehousing
    Data governance frameworks
    Apache Spark
    PySpark
    Databricks SQL
    Cloud architecture design (Azure/AWS/GCP)
    CI/CD
    Infrastructure-as-Code (Terraform)
    Stakeholder management
    Real-time data processing (Kafka, EventHub, Kinesis)

    Some tips for your application 🫡

    Tailor Your CV: Make sure your CV is tailored to the Databricks Architect role. Highlight your experience with Databricks, big data engineering, and cloud ecosystems. We want to see how your skills align with what we're looking for!

    Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background makes you the perfect fit. We love seeing enthusiasm and a clear connection to our mission.

    Showcase Relevant Projects: If you've worked on projects that involved Databricks or similar technologies, make sure to mention them. We want to know about your hands-on experience and how you've tackled challenges in the past.

    Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!

    How to prepare for a job interview at Tredence Inc.

    ✨Know Your Databricks Inside Out

    Make sure you have a solid grasp of Databricks Lakehouse architecture and its components. Brush up on your knowledge of Delta Lake, ETL/ELT pipelines, and how to optimise performance. Being able to discuss these topics confidently will show that you're the right fit for the role.

    ✨Showcase Your Leadership Skills

    As a Databricks Architect, you'll need to lead teams and engage with stakeholders. Prepare examples from your past experiences where you've successfully guided teams or translated complex requirements into technical solutions. This will demonstrate your ability to take charge and deliver results.

    ✨Prepare for Technical Questions

    Expect in-depth technical questions about big data engineering, cloud ecosystems, and data governance. Review your knowledge of Apache Spark, PySpark, and CI/CD practices. Practising common interview questions can help you articulate your expertise clearly during the interview.

    ✨Understand the Business Context

    Familiarise yourself with the industry the company operates in, whether it's BFSI, Retail, Telecom, or Healthcare. Understanding the specific challenges and opportunities in these sectors will allow you to tailor your responses and show how your skills can directly benefit their business.

    Databricks Architect in City of London
    Tredence Inc.
    Location: City of London

    Land your dream job quicker with Premium

    You’re marked as a top applicant with our partner companies
    Individual CV and cover letter feedback including tailoring to specific job roles
    Be among the first applications for new jobs with our AI application
    1:1 support and career advice from our career coaches
    Go Premium

    Money-back if you don't land a job in 6-months

    >