Databricks Architect

Databricks Architect

Full-Time 72000 - 108000 £ / year (est.) No home office possible
SmartChoice International Limited

At a Glance

  • Tasks: Design and implement scalable data solutions using Databricks on AWS.
  • Company: Leading tech firm focused on innovative data solutions.
  • Benefits: Remote work, competitive pay, and opportunities for professional growth.
  • Why this job: Join a dynamic team and lead cutting-edge data migration projects.
  • Qualifications: 15+ years in data roles with strong Databricks and Python skills.
  • Other info: Ideal for proactive leaders looking to make an impact.

The predicted salary is between 72000 - 108000 £ per year.

Location: UK/Europe - Remote

Engagement Type: Contract (Outside IR35)

Role Overview

We are seeking a Senior Databricks Architect with 15+ years of experience in Data Engineering/Analytics to design and deliver scalable, secure, and cost-efficient data solutions on AWS. This is a leadership role requiring strong hands-on expertise, proactive risk management, and excellent stakeholder communication skills.

Key Responsibilities

  • Architect and implement data solutions using Databricks on AWS, PySpark, and Python
  • Lead cloud migration initiatives, including on-prem to AWS migrations
  • Drive GenAI-enabled automation for data asset migration
  • Develop scalable data models and deliver actionable business insights
  • Design and optimize ETL pipelines (Informatica or similar tools)
  • Build and deploy PySpark applications for large-scale data processing
  • Work on LLM pretraining, fine-tuning, augmentation, and optimization
  • Ensure high data quality through cleaning, transformation, and validation (Python/SQL)
  • Automate data workflows to enhance scalability and efficiency
  • Maintain clear technical documentation and best practices

Required Experience

  • 15+ years in Data Analyst/Data Engineer/Data Architect roles
  • Strong expertise in Databricks on AWS
  • Advanced Python (Pandas, Scikit-learn) and SQL skills
  • Proven experience in large-scale cloud data migrations
  • Hands-on experience with LLMs and GenAI-based automation
  • Strong experience designing secure, high-performance data architectures

Key Competencies

  • Proactive risk & issue management
  • Strong requirement clarification and stakeholder engagement skills
  • Excellent communication – able to translate technical insights into business value
  • Critical thinker with strong problem-solving capabilities
  • Self-driven, autonomous, and collaborative approach

Databricks Architect employer: SmartChoice International Limited

As a leading employer in the tech industry, we offer an exceptional work environment for Databricks Architects, characterised by a culture of innovation and collaboration. Our remote setup allows for flexibility while providing access to cutting-edge projects that drive personal and professional growth. With a commitment to employee development and a focus on meaningful contributions, we empower our team to excel in their roles and make a significant impact in the field of data engineering.
SmartChoice International Limited

Contact Detail:

SmartChoice International Limited Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Databricks Architect

✨Tip Number 1

Network like a pro! Reach out to your connections in the data engineering and analytics space. Attend meetups, webinars, or even online forums where you can chat with industry folks. You never know who might have a lead on that perfect Databricks Architect role!

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your past projects, especially those involving Databricks, AWS, and Python. This will give potential employers a taste of what you can do and how you can add value to their team.

✨Tip Number 3

Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with cloud migrations and data architecture. Practice explaining complex concepts in simple terms – it’s all about showing you can communicate effectively with stakeholders.

✨Tip Number 4

Don’t forget to apply through our website! We’ve got some fantastic opportunities waiting for talented individuals like you. Plus, applying directly can sometimes give you an edge over other candidates. Let’s get you that Databricks Architect gig!

We think you need these skills to ace Databricks Architect

Databricks
AWS
Data Engineering
PySpark
Python
SQL
ETL Pipeline Design
Informatica
LLM Pretraining
GenAI Automation
Data Quality Assurance
Technical Documentation
Stakeholder Engagement
Problem-Solving Skills
Cloud Migration

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Databricks Architect role. Highlight your 15+ years of experience in Data Engineering/Analytics and showcase your hands-on expertise with Databricks on AWS. We want to see how your skills align with what we're looking for!

Showcase Your Projects: Include specific examples of projects where you've designed and implemented data solutions using Databricks, PySpark, or Python. We love seeing real-world applications of your skills, so don’t hold back on the details!

Communicate Clearly: Since this role involves stakeholder communication, make sure your application reflects your ability to translate technical insights into business value. Use clear and concise language to demonstrate your communication skills – it’s a big plus for us!

Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of your application and ensures you’re considered for the role. Don’t miss out on this opportunity!

How to prepare for a job interview at SmartChoice International Limited

✨Know Your Databricks Inside Out

Make sure you brush up on your Databricks knowledge. Be ready to discuss your hands-on experience with Databricks on AWS, and prepare to share specific examples of how you've architected and implemented data solutions in the past.

✨Showcase Your Cloud Migration Experience

Since this role involves leading cloud migration initiatives, be prepared to talk about your previous projects. Highlight any challenges you faced during on-prem to AWS migrations and how you overcame them. This will demonstrate your proactive risk management skills.

✨Communicate Like a Pro

Excellent communication is key for this role. Practice explaining complex technical concepts in simple terms. Think about how you've translated technical insights into business value in your past roles, as this will resonate well with the interviewers.

✨Prepare for Technical Questions

Expect to dive deep into technical discussions, especially around Python, SQL, and ETL pipelines. Brush up on your knowledge of PySpark applications and LLMs. Being able to discuss these topics confidently will show that you're the right fit for the job.

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>