At a Glance
- Tasks: Design and build scalable data solutions using Databricks and integrate AI platforms.
- Company: Whitehall Resources, a forward-thinking tech company in the heart of Cambridge.
- Benefits: Hybrid working, competitive pay, and opportunities for professional growth.
- Other info: Collaborative environment with exciting projects and career advancement opportunities.
- Why this job: Join us to shape the future of AI-ready data products and make an impact.
- Qualifications: 4+ years in data engineering with strong skills in Python, SQL, and Databricks.
The predicted salary is between 72000 - 88000 £ per year.
Whitehall Resources are looking for a Data Engineer.
This role is hybrid working with 2 days per week onsite in Cambridge, and the remainder remote working on an initial 6 month contract.
***Inside IR35***
Job Overview
We are seeking an experienced Data Engineer to design and deliver scalable, high-quality data solutions in Databricks.
You will play a key role in evolving our enterprise data platform, creating trusted, AI-ready data products that power reporting, analytics, automation and AI across Enterprise IT.
You will design and build modern data pipelines integrating enterprise platforms such as AI platforms including Microsoft Copilot, Open AI and other enterprise AI services.
The role will also contribute to our growing AI capabilities, engineering solutions for AI usage and adoption data, Retrieval-Augmented Generation (RAG), LLM integration and AI orchestration.
Responsibilities: Design, build and maintain scalable ETL/ELT pipelines using Databricks, Py Spark, SQL and Python.
- Build trusted data products using Lakehouse and Medallion Architecture principles.
- Integrate data from enterprise systems including Service Now, Jira, Azure Dev Ops and AI platforms such as Copilot and Open AI.
- Build data pipelines for AI usage, adoption, telemetry and performance analytics.
- Design and implement RAG pipelines, including ingestion, embeddings, vector/semantic search and retrieval.
- Integrate LLMs, APIs and enterprise data to support AI applications and agents.
- Build and maintain AI orchestration workflows connecting models, data, tools and business processes.
- Implement automated data quality, testing, monitoring and validation.
- Optimise solutions for performance, scalability, reliability and cost.
- Contribute to data governance, metadata, lineage, security and documentation.
- Use Git and CI/CD to support automated and reliable deployment.
Required Skills and Experience: Minimum 4 years' data engineering experience, with strong experience in Databricks.
- Strong Python, Py Spark and SQL skills.
- Experience designing scalable ETL/ELT pipelines and enterprise data models.
- Strong understanding of Data Vault, Delta Lake, Lakehouse and Medallion Architecture.
- Experience integrating enterprise systems through APIs and other data interfaces.
- Experience working with structured and unstructured data.
- Practical experience with Generative AI, RAG, embeddings, vector/semantic search and LLM integration.
- Experience with AI or workflow orchestration, connecting models, data, APIs and tools.
- Experience with automated data quality, testing and monitoring.
- Experience with Git and CI/CD and good understanding of data governance and security.
Nice to Have Skills and Experience: Experience with Microsoft Copilot, Open AI/Azure Open AI or Microsoft Graph.
- Experience with Databricks AI capabilities, including Mosaic AI and Vector Search.
- Experience with orchestration frameworks such as Lang Chain, Lang Graph or Semantic Kernel.
- Experience developing AI agents or agentic workflows.
- Experience with Jira, Service Now or Azure Dev Ops data.
- Knowledge of Power BI, Tableau or AI/BI.
- Familiarity with Agile delivery and iterative development.
- Strong communication and collaboration skills.
Data Engineer in Cambridge employer: Whitehall Resources Limited
Whitehall Resources is an exceptional employer, offering a dynamic work environment in the heart of Central London. With a strong focus on employee development and collaboration, we provide our HR Systems Analysts with opportunities to enhance their skills while working on impactful projects within SAP SuccessFactors. Our culture promotes innovation and teamwork, ensuring that every team member feels valued and empowered to contribute to the success of the People Department.
Contact Details:
Whitehall Resources Limited Recruitment Team
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Cambridge
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Whitehall Resources Limited before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Whitehall Resources Limited.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Whitehall Resources Limited.
We think you need these skills to ace Data Engineer in Cambridge
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at Whitehall Resources Limited, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Whitehall Resources Limited, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Whitehall Resources Limited’s attention and show the tangible impact of your work.
How to prepare for a job interview at Whitehall Resources Limited
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Whitehall Resources Limited.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Whitehall Resources Limited.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Whitehall Resources Limited.