At a Glance
- Tasks: Lead the design and delivery of cutting-edge data and AI solutions on the Databricks Lakehouse Platform.
- Company: Join a dynamic consultancy partnered with Databricks, driving innovation in data engineering.
- Benefits: Enjoy flexible working options, competitive salary, and opportunities for professional growth.
- Why this job: Be at the forefront of data technology, shaping solutions that impact businesses and communities.
- Qualifications: Expertise in Databricks, Apache Spark, and cloud platforms is essential; certifications are a plus.
- Other info: Ideal for seasoned professionals looking to mentor and lead in a collaborative environment.
The predicted salary is between 54000 - 84000 £ per year.
Techyard is supporting a growing Databricks-partnered consultancy in securing a Databricks Champion Solution Architect to lead the design and delivery of advanced data and AI solutions on the Databricks Lakehouse Platform. This strategic, high-impact role is ideal for a seasoned professional who can operate as both a hands-on architect and a trusted advisor—bridging business vision with technical excellence. You’ll play a pivotal part in driving innovation, embedding best practices, and shaping the consultancy’s data engineering capabilities as they scale their team and client base.
Key Responsibilities:
- Architect and implement end-to-end, scalable data and AI solutions using the Databricks Lakehouse (Delta Lake, Unity Catalog, MLflow).
- Design and lead the development of modular, high-performance data pipelines using Apache Spark and PySpark.
- Champion the adoption of Lakehouse architecture (bronze/silver/gold layers) to ensure scalable, governed data platforms.
- Collaborate with stakeholders, analysts, and data scientists to translate business needs into clean, production-ready datasets.
- Promote CI/CD, DevOps, and data reliability engineering (DRE) best practices across Databricks environments.
- Integrate with cloud-native services and orchestrate workflows using tools such as dbt, Airflow, and Databricks Workflows.
- Drive performance tuning, cost optimisation, and monitoring across data workloads.
- Mentor engineering teams and support architectural decisions as a recognised Databricks expert.
Essential Skills & Experience:
- Demonstrable expertise with Databricks and Apache Spark in production environments.
- Proficiency in PySpark, SQL, and working within one or more cloud platforms (Azure, AWS, or GCP).
- In-depth understanding of Lakehouse concepts, medallion architecture, and modern data warehousing.
- Experience with version control, testing frameworks, and automated deployment pipelines (e.g., GitHub Actions, Azure DevOps).
- Sound knowledge of data governance, security, and compliance, including Unity Catalog.
- Excellent communication, leadership, and problem-solving skills.
Desirable:
- Databricks certifications (e.g., Data Engineer Associate / Professional or Solutions Architect).
- Familiarity with MLflow, dbt, and BI tools such as Power BI or Tableau.
- Exposure to MLOps practices and deploying ML models within Databricks.
- Experience working within Agile and DevOps-driven delivery environments.
Contact Detail:
TechYard Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Databricks Solution Architect Champion
✨Tip Number 1
Network with professionals in the Databricks community. Attend meetups, webinars, or conferences where you can connect with current Databricks Solution Architects. This can provide insights into the role and may even lead to referrals.
✨Tip Number 2
Showcase your hands-on experience with Databricks and Apache Spark through personal projects or contributions to open-source initiatives. Having a portfolio that demonstrates your skills can set you apart from other candidates.
✨Tip Number 3
Stay updated on the latest trends and best practices in data engineering and AI solutions. Follow relevant blogs, podcasts, and forums to ensure you can discuss current topics during interviews.
✨Tip Number 4
Prepare to discuss specific scenarios where you've implemented scalable data solutions or optimised performance in previous roles. Real-world examples will demonstrate your expertise and problem-solving abilities effectively.
We think you need these skills to ace Databricks Solution Architect Champion
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Databricks, Apache Spark, and cloud platforms. Use specific examples that demonstrate your expertise in designing and implementing data solutions.
Craft a Compelling Cover Letter: In your cover letter, explain why you are passionate about the Databricks Lakehouse Platform. Discuss how your skills align with the key responsibilities of the role and how you can contribute to the consultancy's growth.
Showcase Relevant Projects: Include details of any relevant projects you've worked on, particularly those involving data pipelines, CI/CD practices, or mentoring teams. This will help illustrate your hands-on experience and leadership capabilities.
Highlight Certifications: If you have any Databricks certifications or relevant training, be sure to mention them. This can set you apart from other candidates and demonstrate your commitment to professional development in this field.
How to prepare for a job interview at TechYard
✨Showcase Your Technical Expertise
Be prepared to discuss your hands-on experience with Databricks and Apache Spark. Highlight specific projects where you've implemented scalable data solutions, and be ready to explain the architecture and design choices you made.
✨Demonstrate Your Problem-Solving Skills
Expect scenario-based questions that assess your ability to tackle real-world challenges. Think of examples where you've successfully resolved issues related to data pipelines or performance tuning, and articulate your thought process clearly.
✨Communicate Effectively
As a Solution Architect, you'll need to bridge the gap between technical and non-technical stakeholders. Practice explaining complex concepts in simple terms, and be ready to discuss how you've collaborated with teams to translate business needs into technical solutions.
✨Emphasise Your Leadership Experience
This role requires mentoring and guiding engineering teams. Prepare to share examples of how you've led teams, influenced architectural decisions, and championed best practices in previous roles, showcasing your leadership style and impact.