At a Glance
- Tasks: Design and maintain data pipelines using PySpark and Azure technologies.
- Company: Leading global financial markets infrastructure provider with a hybrid work culture.
- Benefits: Competitive pay, flexible working, and opportunities for skill development.
- Other info: 6-month contract with potential for career growth in a fast-paced environment.
- Why this job: Join a dynamic team and make an impact in the financial data sector.
- Qualifications: Proficient in Python and PySpark, with Azure experience.
The predicted salary is between 50000 - 65000 € per year.
Contracting role based in London (Hybrid, 1-3 days in office) for a 6-month engagement. You will design, build, and maintain data pipelines powering an end-to-end mastering flow for a leading global financial markets infrastructure and data provider, working across PySpark, Azure Cosmos DB, and Microsoft Fabric.
Key Responsibilities
- Build and maintain PySpark pipelines for ingestion, normalisation, bi-temporal processing, and publication of financial instrument data
- Develop and optimise Azure Cosmos DB read/write patterns and integrate with external APIs for Minting & Matching
- Implement data quality checks, comprehensive unit/integration tests, and CI/CD pipeline management via GitLab CI
- Monitor and troubleshoot production pipelines using Eventstream telemetry, KQL, and DataDog
- Translate business requirements into technical solutions, maintaining documentation and knowledge repositories
What You Will Ideally Bring
- Strong proficiency in Python and PySpark, with hands-on experience building streaming mastering pipelines
- Solid Azure experience - Cosmos DB (NoSQL), ADLS/OneLake, and Key Vault
- Strong understanding of temporal data modelling, data quality frameworks, and CI/CD practices
- Experience with lakehouses, dataflows, and semantic models within Microsoft Fabric
Pyspark Developer (Microsoft Fabric) - 6-Month Contract - London employer: Hamilton Barnes
As a leading global financial markets infrastructure and data provider, we pride ourselves on fostering a dynamic work culture that encourages innovation and collaboration. Our London-based team enjoys the flexibility of a hybrid working model, competitive remuneration, and ample opportunities for professional growth through continuous learning and development. Join us to be part of a forward-thinking organisation where your contributions directly impact the financial landscape.
StudySmarter Expert Advice🤫
We think this is how you could land Pyspark Developer (Microsoft Fabric) - 6-Month Contract - London
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work with PySpark or Azure. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your PySpark projects and any data pipelines you've built. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common technical questions related to PySpark and Azure. We recommend doing mock interviews with friends or using online platforms to get comfortable with the format.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Pyspark Developer (Microsoft Fabric) - 6-Month Contract - London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with PySpark and Azure. We want to see how your skills match the job description, so don’t be shy about showcasing relevant projects or achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re excited about this role and how your background makes you a perfect fit. We love seeing genuine enthusiasm for what we do.
Showcase Your Technical Skills:When detailing your experience, focus on specific technologies mentioned in the job description, like Azure Cosmos DB and CI/CD practices. We want to know how you’ve used these tools in real-world scenarios!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy!
How to prepare for a job interview at Hamilton Barnes
✨Know Your Tech Inside Out
Make sure you brush up on your PySpark and Azure skills before the interview. Be ready to discuss your experience with building data pipelines and how you've tackled challenges in the past. They’ll want to see that you can not only talk the talk but also walk the walk!
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of how you've implemented data quality checks or optimised read/write patterns in Azure Cosmos DB. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight your problem-solving abilities.
✨Familiarise Yourself with CI/CD Practices
Since CI/CD pipeline management is a key part of the role, make sure you can discuss your experience with GitLab CI and how you've used it in previous projects. Being able to explain your approach to continuous integration and deployment will set you apart from other candidates.
✨Ask Insightful Questions
At the end of the interview, don’t forget to ask questions! Inquire about the team’s current projects or challenges they face with their data pipelines. This shows your genuine interest in the role and helps you gauge if the company is the right fit for you.
