At a Glance
- Tasks: Design and operate secure, scalable Databricks data platforms on AWS.
- Company: Join a forward-thinking tech company focused on data innovation.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on continuous learning and career advancement.
- Why this job: Make an impact by building reliable data products with cutting-edge technology.
- Qualifications: 3+ years in data pipeline development and hands-on experience with Databricks.
The predicted salary is between 60000 - 80000 £ per year.
We are seeking a Databricks DevOps Engineer to design and operate secure, scalable and reliable Databricks-based data platforms on AWS. This role focuses on infrastructure automation, CI/CD implementation, platform governance and observability. You will help build the engineering foundations that enable teams to deliver reliable data products.
Key Responsibilities
- Design and implement ELT/ETL pipelines using PySpark and Databricks
- Build scalable batch and streaming data pipelines using Spark and Kafka
- Develop optimised SQL and Python pipelines for data transformation and integration
- Integrate external data sources using REST APIs and data ingestion frameworks
- Optimise Spark jobs and cluster performance for reliability and cost efficiency
- Implement data quality checks, validation and monitoring
- Apply CI/CD practices and version control for pipeline deployment
- Work closely with solution architects, DevOps engineers and business analysts to deliver data products
- Produce technical documentation, architecture diagrams and operational runbooks
Key Requirements
- Eligible and willing to pass relevant background checks
- 3+ years experience building production data pipelines
- Hands‑on experience with Databricks, Spark and PySpark
- Experience with Delta Lake, Unity Catalog and Databricks Workflows
- Experience with data pipeline design, testing and deployment
- Familiarity with test‑driven development, CI/CD practices and Git-based development
- Strong collaboration and communication skills
- Working knowledge of Hadoop REST APIs and Kafka experience
Nice to Have
- Cloud experience with AWS, Azure or GCP
- Certifications in Databricks, AWS or data engineering
- Infrastructure as Code (Terraform)
- Orchestration: Airflow or AWS Glue
- Streaming technologies including Structured Streaming
- Observability tooling for data pipelines
- Experience working with regulated industries such as banking or financial services
DevOps Consultant - Databricks in Belfast employer: ISx4 Group
As a leading employer in the tech industry, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to excel. Our DevOps Consultants benefit from extensive professional development opportunities, competitive compensation, and a commitment to work-life balance, all while working in a vibrant location that encourages creativity and teamwork. Join us to be part of a forward-thinking team dedicated to building cutting-edge data solutions on AWS.
StudySmarter Expert Advice🤫
We think this is how you could land DevOps Consultant - Databricks in Belfast
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work with Databricks or in DevOps. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving Databricks, Spark, and CI/CD practices. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common DevOps scenarios and challenges. Be ready to discuss how you've tackled issues in past projects, particularly around data pipelines and automation. We want to see your problem-solving skills in action!
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace DevOps Consultant - Databricks in Belfast
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Databricks, Spark, and PySpark. We want to see how your skills align with the key responsibilities listed in the job description, so don’t hold back on showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about DevOps and data engineering. We love seeing candidates who can communicate their enthusiasm for building reliable data products.
Showcase Your Technical Skills:Don’t forget to mention your hands-on experience with CI/CD practices and version control. We’re looking for someone who can hit the ground running, so highlight any relevant tools or frameworks you’ve worked with, like Terraform or Airflow.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at StudySmarter!
How to prepare for a job interview at ISx4 Group
✨Know Your Tech Inside Out
Make sure you’re well-versed in Databricks, Spark, and PySpark. Brush up on your knowledge of ELT/ETL pipelines and be ready to discuss how you've implemented them in past projects. Being able to talk confidently about your hands-on experience will impress the interviewers.
✨Showcase Your CI/CD Skills
Since this role focuses on CI/CD practices, prepare to discuss your experience with version control and pipeline deployment. Bring examples of how you've applied these practices in previous roles, and be ready to explain the benefits they brought to your projects.
✨Collaboration is Key
This position requires strong collaboration skills, so think of examples where you’ve worked closely with solution architects, DevOps engineers, or business analysts. Highlight how effective communication helped deliver successful data products in your previous roles.
✨Prepare for Technical Questions
Expect technical questions related to data pipeline design, testing, and deployment. Review common challenges and solutions in building scalable data platforms. Practising problem-solving scenarios can help you articulate your thought process during the interview.
