At a Glance
- Tasks: Design and develop cloud-based data pipelines using Azure and Databricks.
- Company: Leading London Market insurer investing in a modern data platform.
- Benefits: Up to £75,000 salary, 25% bonus, and excellent benefits.
- Other info: Great opportunity for career growth and skill development.
- Why this job: Join a dynamic team and shape the future of data engineering.
- Qualifications: Experience with Python, Azure, and building ETL/ELT data pipelines.
London | Hybrid
Up to £75,000 + 25% Bonus + Excellent Benefits
A leading London Market insurer is continuing to invest in its enterprise data platform and is looking for a Data Engineer to join a growing Data & Analytics function.
The Opportunity
Join a growing Data & Analytics team within a leading London Market insurer investing heavily in its cloud data platform. Working with modern technologies including Azure, Databricks, SQL and Python, you'll play a key role in designing, building and maintaining scalable data solutions that enable smarter decision making across Underwriting, Finance and Operations.
You'll collaborate with engineers, analysts and business stakeholders to develop robust data pipelines, improve data quality and optimise cloud-based data processing. This is an excellent opportunity to work on enterprise-scale data engineering projects while helping shape the future of a modern Azure and Databricks platform, with plenty of scope to develop your technical skills and progress your career.
What You'll Be Doing
- Designing and developing cloud-based data pipelines using Azure Data Factory and Databricks.
- Building scalable ETL and ELT solutions to ingest and transform data from multiple business systems.
- Developing data solutions using SQL, Python and PySpark.
- Supporting the deployment of production-ready data pipelines using CI/CD and DevOps best practices.
- Working with business stakeholders to understand data requirements and deliver technical solutions.
- Improving data quality, performance and reliability across the data platform.
- Supporting data modelling, orchestration and cloud data architecture initiatives.
- Troubleshooting production issues and continuously improving engineering standards.
- Collaborating with the wider Data & Analytics team to deliver high-value data products.
What We're Looking For
- Commercial experience as a Data Engineer.
- Experience with Python and/or PySpark.
- Experience working with Microsoft Azure data technologies.
- Exposure to Databricks or a strong desire to develop expertise in the platform.
- Experience building ETL or ELT data pipelines.
- Knowledge of Azure Data Factory or similar integration tools.
- Understanding of Git, source control and CI/CD practices.
- Experience working within Agile delivery environments.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder engagement skills.
- A proactive mindset with a genuine enthusiasm for learning new technologies.
#J-18808-Ljbffr
Data Engineer - Azure, DataBricks, PySpark employer: Arthur Recruitment
Join a forward-thinking personal lines insurer that values innovation and creativity in its pricing team. With a strong emphasis on employee growth, you will have the opportunity to develop your skills in a collaborative environment while working on cutting-edge pricing methodologies. Enjoy a supportive work culture that encourages curiosity and offers meaningful career advancement opportunities in a dynamic sector.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer - Azure, DataBricks, PySpark
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Arthur Recruitment!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Engineer - Azure, DataBricks, PySpark at Arthur Recruitment.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Arthur Recruitment.
✨Apply Directly through Our Website
When you find a suitable opening like Data Engineer - Azure, DataBricks, PySpark at Arthur Recruitment, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Arthur Recruitment, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Arthur Recruitment. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Arthur Recruitment
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Arthur Recruitment!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
