At a Glance
- Tasks: Lead Databricks migrations and optimise environments while collaborating with teams.
- Company: Dynamic tech company offering flexible work arrangements.
- Benefits: Competitive pay, remote work options, and potential contract extensions.
- Other info: Work 1 day a week in Swindon with excellent career growth opportunities.
- Why this job: Join a cutting-edge project and make a real impact in data migration.
- Qualifications: Experience with Databricks, AWS, Python, and strong problem-solving skills.
The predicted salary is between 60000 - 80000 £ per year.
Hays are now looking for a Databricks Consultant / SME for one of our local clients:
- Flexible rate - Outside IR35
- 1 day a week in Swindon, the rest is WFH
- Initial 6 month contract (extensions likely)
We're seeking a highly experienced Databricks specialist who can confidently navigate the platform end-to-end, including leading migrations from legacy setups using DBFS-mounted tables and Hive Metastore. You'll bring strong AWS knowledge, hands-on experience working with S3 via Python, a solid understanding of data storage formats, and practical Python development expertise.
What you'll be doing:
- Lead the migration of Databricks assets (notebooks, jobs, clusters) from DBFS to Unity Catalog
- Define and implement a scalable, standardised migration approach across teams
- Support teams with ad-hoc Databricks issues related to migration and platform usage
- Optimise the Databricks environment for structure, access, and governance
- Automate infrastructure and deployments using Terraform and/or CloudFormation
- Build and maintain data pipelines using Python, SQL and Databricks APIs
- Monitor platform performance using tools such as CloudWatch, Grafana, and Kibana
- Collaborate with engineering teams, stakeholders, and platform users
What we're looking for:
- Strong hands-on experience with Databricks in an AWS environment
- Proven experience with Unity Catalog and Databricks migrations
- Strong Python skills and experience working with Databricks APIs
- Solid understanding of data pipelines, SQL, and data platform architecture
- Experience with Infrastructure as Code (Terraform or CloudFormation)
- Knowledge of monitoring and observability tools (e.g. CloudWatch, Grafana, Kibana)
- Strong problem-solving skills and ability to work independently
- Excellent communication and stakeholder engagement skills
- Exposure to Databricks Apps or AI/ML workloads (nice to have)
If you have previously led migrations to Unity Catalogue and you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or please send a copy of your CV to Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers.
Databricks Consultant (UC Migration) in Swindon employer: Hays Technology
At Hays, we pride ourselves on being an excellent employer, offering a flexible work environment that includes one day a week in Swindon and the rest from home. Our culture fosters collaboration and innovation, providing ample opportunities for professional growth and development, particularly for specialists like Databricks Consultants who are eager to lead impactful migrations and optimise data platforms. Join us to be part of a supportive team that values your expertise and encourages you to thrive in your career.
StudySmarter Expert Advice🤫
We think this is how you could land Databricks Consultant (UC Migration) in Swindon
✨Tip Number 1
Network like a pro! Reach out to your connections in the Databricks and AWS communities. Attend meetups or webinars, and don’t be shy about asking for introductions. You never know who might have the inside scoop on job openings!
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your Databricks projects, especially any migrations you've led. This can be a game-changer during interviews, as it gives potential employers a tangible look at what you can do.
✨Tip Number 3
Prepare for those interviews! Brush up on common Databricks scenarios and be ready to discuss your experience with Unity Catalog and Python development. Practising your answers can help you feel more confident and articulate.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might just be perfect for you. Plus, applying directly can sometimes give you a leg up in the hiring process.
We think you need these skills to ace Databricks Consultant (UC Migration) in Swindon
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Databricks, AWS, and Python. We want to see how your skills match the job description, so don’t be shy about showcasing your relevant projects and achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're the perfect fit for this role. Mention your hands-on experience with migrations and any specific tools you've used, like Terraform or CloudFormation.
Showcase Problem-Solving Skills:In your application, give examples of how you've tackled challenges in previous roles. We love seeing candidates who can think on their feet and come up with innovative solutions, especially in a Databricks environment!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the easiest way for us to keep track of your application and ensures you don’t miss out on any updates. Plus, we love seeing applications come in through our platform!
How to prepare for a job interview at Hays Technology
✨Know Your Databricks Inside Out
Make sure you’re well-versed in all things Databricks, especially around migrations and Unity Catalog. Brush up on your experience with DBFS-mounted tables and Hive Metastore, as these will likely come up during the interview.
✨Show Off Your Python Skills
Since strong Python skills are a must for this role, be prepared to discuss your hands-on experience with Python development. Maybe even bring along a project or two that showcases your ability to build data pipelines using Python and Databricks APIs.
✨Demonstrate Problem-Solving Prowess
Expect questions that test your problem-solving abilities, especially related to Databricks issues. Think of specific examples where you’ve tackled challenges in migration or optimised environments, and be ready to share those stories.
✨Engage with Stakeholders
Communication is key! Be ready to discuss how you've collaborated with engineering teams and stakeholders in the past. Highlight your experience in engaging with different teams to ensure smooth migrations and platform usage.
