At a Glance
- Tasks: Design and implement scalable data solutions using Databricks on AWS.
- Company: Leading tech firm focused on innovative data solutions.
- Benefits: Remote work, competitive pay, and opportunities for professional growth.
- Why this job: Join a dynamic team and lead cutting-edge data migration projects.
- Qualifications: 15+ years in data roles with strong Databricks and Python skills.
- Other info: Ideal for proactive leaders looking to make an impact.
The predicted salary is between 72000 - 108000 £ per year.
Location: UK/Europe - Remote
Engagement Type: Contract (Outside IR35)
Role Overview
We are seeking a Senior Databricks Architect with 15+ years of experience in Data Engineering/Analytics to design and deliver scalable, secure, and cost-efficient data solutions on AWS. This is a leadership role requiring strong hands-on expertise, proactive risk management, and excellent stakeholder communication skills.
Key Responsibilities
- Architect and implement data solutions using Databricks on AWS, PySpark, and Python
- Lead cloud migration initiatives, including on-prem to AWS migrations
- Drive GenAI-enabled automation for data asset migration
- Develop scalable data models and deliver actionable business insights
- Design and optimize ETL pipelines (Informatica or similar tools)
- Build and deploy PySpark applications for large-scale data processing
- Work on LLM pretraining, fine-tuning, augmentation, and optimization
- Ensure high data quality through cleaning, transformation, and validation (Python/SQL)
- Automate data workflows to enhance scalability and efficiency
- Maintain clear technical documentation and best practices
Required Experience
- 15+ years in Data Analyst/Data Engineer/Data Architect roles
- Strong expertise in Databricks on AWS
- Advanced Python (Pandas, Scikit-learn) and SQL skills
- Proven experience in large-scale cloud data migrations
- Hands-on experience with LLMs and GenAI-based automation
- Strong experience designing secure, high-performance data architectures
Key Competencies
- Proactive risk & issue management
- Strong requirement clarification and stakeholder engagement skills
- Excellent communication – able to translate technical insights into business value
- Critical thinker with strong problem-solving capabilities
- Self-driven, autonomous, and collaborative approach
Databricks Architect employer: SmartChoice International Limited
Contact Detail:
SmartChoice International Limited Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Databricks Architect
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering and analytics space. Attend meetups, webinars, or even online forums where you can chat with industry folks. You never know who might have a lead on that perfect Databricks Architect role!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your past projects, especially those involving Databricks, AWS, and Python. This will give potential employers a taste of what you can do and how you can add value to their team.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your experience with cloud migrations and data architecture. Practice explaining complex concepts in simple terms – it’s all about showing you can communicate effectively with stakeholders.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got some fantastic opportunities waiting for talented individuals like you. Plus, applying directly can sometimes give you an edge over other candidates. Let’s get you that Databricks Architect gig!
We think you need these skills to ace Databricks Architect
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Databricks Architect role. Highlight your 15+ years of experience in Data Engineering/Analytics and showcase your hands-on expertise with Databricks on AWS. We want to see how your skills align with what we're looking for!
Showcase Your Projects: Include specific examples of projects where you've designed and implemented data solutions using Databricks, PySpark, or Python. We love seeing real-world applications of your skills, so don’t hold back on the details!
Communicate Clearly: Since this role involves stakeholder communication, make sure your application reflects your ability to translate technical insights into business value. Use clear and concise language to demonstrate your communication skills – it’s a big plus for us!
Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of your application and ensures you’re considered for the role. Don’t miss out on this opportunity!
How to prepare for a job interview at SmartChoice International Limited
✨Know Your Databricks Inside Out
Make sure you brush up on your Databricks knowledge. Be ready to discuss your hands-on experience with Databricks on AWS, and prepare to share specific examples of how you've architected and implemented data solutions in the past.
✨Showcase Your Cloud Migration Experience
Since this role involves leading cloud migration initiatives, be prepared to talk about your previous projects. Highlight any challenges you faced during on-prem to AWS migrations and how you overcame them. This will demonstrate your proactive risk management skills.
✨Communicate Like a Pro
Excellent communication is key for this role. Practice explaining complex technical concepts in simple terms. Think about how you've translated technical insights into business value in your past roles, as this will resonate well with the interviewers.
✨Prepare for Technical Questions
Expect to dive deep into technical discussions, especially around Python, SQL, and ETL pipelines. Brush up on your knowledge of PySpark applications and LLMs. Being able to discuss these topics confidently will show that you're the right fit for the job.