At a Glance
- Tasks: Design and build scalable Azure Databricks data pipelines using cutting-edge technologies.
- Company: Leading global energy trading organisation driving major tech transformation.
- Benefits: Competitive contract rate, hybrid work model, and opportunity for long-term engagement.
- Other info: Be part of a dynamic team with significant influence on technical decisions.
- Why this job: Join a high-impact project transforming the energy sector with real-time data solutions.
- Qualifications: Extensive experience in Azure Databricks, PySpark, SQL, and cloud data architecture.
The predicted salary is between 63000 - 77000 £ per year.
Industry: Commodities / Energy Trading
Location: London (Hybrid)
Contract: Initial 6-month contract (long-term transformation programme)
X4 Technology are partnered with a leading global energy trading organisation delivering a major technology transformation centred on the migration from a legacy ETRM platform to Endur and the modernisation of its enterprise data platform using Azure Databricks. As part of this multi-year programme, the organisation is migrating Oracle-based data platforms into Azure Databricks to build a scalable, cloud-native data platform supporting Endur, global reporting, analytics and risk management, while reducing critical data latency from 10-15 minutes to near real-time.
They are looking for an experienced Senior Data Engineer to play a key role in designing and building the Azure Databricks platform. This role combines deep hands-on engineering with technical ownership, helping define engineering standards, optimise platform performance and shape the future architecture of a business-critical data platform.
Responsibilities of the Senior Data Engineer (Azure Databricks):
- Design, build and optimise scalable Azure Databricks data pipelines and platforms using PySpark, SQL, Delta Lake and Structured Streaming.
- Lead the migration of legacy Oracle data platforms into Azure Databricks, delivering high-performance data solutions for trading, reporting and analytics.
- Drive engineering best practices across performance, scalability, CI/CD, testing, governance and cloud cost optimisation.
- Collaborate with architects, platform teams and business stakeholders to shape technical solutions, mentor engineers and influence platform direction.
Requirements for the Senior Data Engineer (Azure Databricks):
- Extensive hands-on experience delivering enterprise-scale Azure Databricks data platforms, with strong expertise in PySpark, Python, SQL, Delta Lake and Structured Streaming (Delta Live Tables desirable).
- Strong understanding of modern cloud data architecture, data modelling, performance optimisation, governance and data engineering best practices.
- Experience working on large-scale cloud migration or platform modernisation programmes, with the ability to influence technical direction and mentor engineering teams.
- Experience within energy trading, commodities, capital markets or financial services is advantageous but not essential.
This is an opportunity to work on one of the largest Azure Databricks transformations in the energy trading sector, helping build a modern cloud data platform that underpins trading, risk, reporting and analytics. You'll have significant influence over technical decisions while remaining deeply involved in hands-on engineering within a high-performing team. Interviews are being scheduled immediately, with a view to onboarding as soon as possible.
Contract Senior Data Engineer (Databricks) employer: X4 Technology
X4 Technology is an excellent employer, offering a dynamic work environment that fosters innovation and collaboration. With a strong focus on employee growth, we provide opportunities for professional development and skill enhancement, particularly in cutting-edge technologies like encryption and cloud security. Our inclusive culture and commitment to work-life balance make this an ideal place for talented individuals looking to make a meaningful impact in the tech industry.
StudySmarter Expert Advice🤫
We think this is how you could land Contract Senior Data Engineer (Databricks)
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like X4 Technology before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like X4 Technology.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like X4 Technology.
We think you need these skills to ace Contract Senior Data Engineer (Databricks)
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at X4 Technology, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to X4 Technology, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab X4 Technology’s attention and show the tangible impact of your work.
How to prepare for a job interview at X4 Technology
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at X4 Technology.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at X4 Technology.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at X4 Technology.
