At a Glance
- Tasks: Build and optimise data pipelines using cutting-edge tools like Databricks and Microsoft Fabric.
- Company: Join a forward-thinking company that values diversity and innovation.
- Benefits: Competitive salary, 27 days holiday, birthday leave, and paid charity days.
- Other info: Enjoy a supportive culture with excellent career growth opportunities.
- Why this job: Make an impact by delivering clean data for enterprise analytics in a fun environment.
- Qualifications: Proficient in PySpark, SQL, and experienced with data pipeline construction.
The predicted salary is between 50000 - 60000 £ per year.
We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.
Job requirements
- Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats.
- Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities.
- Practical knowledge of structural data formats including Parquet, JSON, and CSV.
- Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment.
- Familiarity with unit testing data pipelines and implementing automated data quality checks.
Job responsibilities
- Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows.
- Implement Delta Live Tables (DLT) to automate batch and real-time streaming data processing.
- Build and maintain the Medallion Architecture silver & gold layer across shared storage.
- Write optimised transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL.
- Configure data access, masking, and governance policies within Databricks Unity Catalog.
- Optimise Lakehouse table performance using Z-Order indexing, liquid clustering, and file compaction techniques.
- Deploy data pipelines using CI/CD frameworks, Git integration, and Databricks Asset Bundles (DABs).
- Prepare finalised gold layer datasets to support real-time Power BI Direct Lake reporting model.
Benefits
- Salary aligned with your skills and expertise.
- 27 days holiday allowance plus statutory public holidays and the option to purchase more.
- Birthday leave.
- 2 giving back days per year – paid leave to work with local charities or good causes.
- Enhanced family-friendly policies, including enhanced maternity pay.
- Fun and professional working environment.
Diversity and Inclusion
Diversity is a core business imperative of the Group. We are an equal opportunities employer which promotes inclusiveness and always employ the best professional for the job. Having a diverse workforce allows the Group to draw upon a range of different ideas and experiences which supports our business’s growth and creates an environment where everyone has an equal opportunity for success.
Data Engineer in Bury employer: Leonard Curtis
As a Data Engineer with us, you'll thrive in a dynamic and inclusive work environment that values your expertise and encourages professional growth. We offer competitive salaries, generous holiday allowances, and unique benefits like birthday leave and paid volunteer days, all while fostering a culture of diversity and collaboration. Join us to make a meaningful impact through innovative data solutions in a supportive setting.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer in Bury
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with other Data Engineers on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those involving PySpark and Databricks. This gives potential employers a taste of what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on common data engineering questions and practical scenarios. Practice explaining your past projects and how you tackled challenges, especially around ETL workflows and data quality checks.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Data Engineer in Bury
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with PySpark, Databricks SQL, and ETL/ELT workflows. We want to see how your skills match the job description, so don’t be shy about showcasing relevant projects!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re passionate about data engineering and how your background makes you a perfect fit for our team at StudySmarter. Keep it engaging and personal.
Showcase Your Projects:If you've built any data pipelines or worked with Delta Lake formats, include those examples in your application. We love seeing practical experience, so share links to your GitHub or any relevant portfolios!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands. Plus, it shows us you’re serious about joining the StudySmarter family!
How to prepare for a job interview at Leonard Curtis
✨Know Your Tech Inside Out
Make sure you brush up on your skills with PySpark, Databricks SQL, and T-SQL. Be ready to discuss how you've built production pipelines and worked with Delta Lake formats. Having specific examples from your past experience will show that you’re not just familiar with the tools, but you can actually use them effectively.
✨Showcase Your Problem-Solving Skills
Prepare to talk about how you've handled challenges in data pipeline orchestration and error handling. Think of a couple of scenarios where you had to troubleshoot issues or optimise workflows. This will demonstrate your practical knowledge and ability to think on your feet.
✨Understand the Medallion Architecture
Familiarise yourself with the Medallion Architecture, especially the silver and gold layers. Be ready to explain how you would build and maintain these layers in a cloud environment. This shows that you understand the bigger picture and can contribute to the overall data strategy.
✨Ask Insightful Questions
Prepare some thoughtful questions about the company’s data practices, team structure, or future projects. This not only shows your interest in the role but also gives you a chance to assess if the company is the right fit for you. Plus, it makes for a more engaging conversation!
