At a Glance
- Tasks: Design and develop scalable data solutions using Azure Databricks and Data Factory.
- Company: Join a forward-thinking HR tech company focused on innovation.
- Benefits: Competitive pay, flexible working options, and opportunities for professional growth.
- Other info: Collaborative culture with a focus on automation and continuous improvement.
- Why this job: Make an impact by building reliable data pipelines in a dynamic environment.
- Qualifications: 8-10 years of data engineering experience with strong Azure skills.
Contract: Inside IR35
Role Overview
We are looking for an experienced Azure Databricks Data Engineer to design, develop and deliver scalable data solutions within an HR technology environment. You will work across the employee lifecycle, building reliable data pipelines and analytics solutions with a strong focus on automation, testing, security and production quality.
Key Responsibilities
- Design and develop scalable data pipelines and analytics solutions using Azure Databricks and Azure Data Factory.
- Build and improve data products supporting HR and employee lifecycle processes.
- Translate business and technical requirements into production-ready solutions.
- Develop data lake, data warehouse and data mesh solutions using Azure services.
- Work with large, complex and multi-format datasets.
- Apply automated testing, CI/CD and DevOps practices throughout the development lifecycle.
- Build observability into solutions to monitor production health and support incident resolution.
- Ensure solutions meet security, reliability, compliance and performance standards.
- Collaborate with engineering, product, HR and other cross-functional teams.
- Contribute to technical decisions with long-term scalability and sustainability in mind.
Essential Skills and Experience
- 8-10 years of hands‑on data engineering experience.
- Strong commercial experience with Azure Databricks and Azure Data Factory.
- Advanced Spark development using Python or Scala, alongside strong SQL skills.
- Experience with Azure Data Lake Storage Gen2 and Azure SQL or PostgreSQL.
- Strong understanding of Azure analytics services and Azure identity, including SPN, SAMI and UAMI.
- Experience designing data lake, data warehouse, data mesh and service-oriented integration solutions.
- Previous ETL development experience using Informatica, SSIS, Talend or similar.
- Experience delivering solutions within an Agile SDLC environment.
- Strong Git, GitLab or GitHub experience, including branching, pull requests and CI/CD.
- Hands-on scripting experience with Linux or PowerShell.
- Exposure to Docker and automated testing practices.
- Experience with pipeline orchestration tools such as Apache Airflow, Autosys or Control-M, with Airflow preferred.
- Excellent written and verbal English communication skills.
- Kafka or other streaming technologies.
- Terraform, ARM templates, YAML or Puppet.
#J-18808-Ljbffr
Databricks Data Engineer employer: Coltech
Coltech is an excellent employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of Bristol. With a hybrid working model, employees enjoy flexibility while tackling complex engineering challenges in mobile security, alongside opportunities for professional growth and development within a supportive team environment. The company values diversity and encourages creative problem-solving, making it a rewarding place for those passionate about technology and security.
StudySmarter Expert Advice🤫
We think this is how you could land Databricks Data Engineer
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Coltech before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Coltech.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Coltech.
We think you need these skills to ace Databricks Data Engineer
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at Coltech, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Coltech, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Coltech’s attention and show the tangible impact of your work.
How to prepare for a job interview at Coltech
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Coltech.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Coltech.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Coltech.
