At a Glance
- Tasks: Lead the development of scalable data pipelines and manage a small team of Data Engineers.
- Company: Bibby Financial Services supports over 9000 SMEs globally, fostering growth and innovation.
- Benefits: Enjoy private healthcare, flexible benefits, 25 days holiday, and a company car allowance.
- Other info: This hybrid role offers flexibility and a commitment to inclusivity in the workplace.
- Why this job: Join a dynamic team that values relationships, creativity, and personal growth in a fast-paced environment.
- Qualifications: Bachelor's or Master's in Computer Science or relevant experience; expertise in Databricks and cloud platforms required.
The predicted salary is between 60000 - 70000 € per year.
Job Description
Senior Databricks Data Engineer (flexible location) Bibby Financial Services have an exciting opportunity available for a reliable Senior Databricks Data Engineer to join our team. You will join us on a full time, permanent basis and in return, you will receive a competitive salary of £60,000 - £70,000 per annum.
About the role:As our Senior Databricks Data Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units domestically and internationally.
You will have an active leadership role in determining and developing the shape of your teams solution delivery against business requirements, as well as helping to inform and input into the wider technical architecture and strategy. This is very much a hands-on role, where the majority of your time will be spent actively developing solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to.
Your responsibilities as our Senior Databricks Data Engineer will include:
- Understand the business / product strategy and supporting goals with the purpose of ensuring data interpretation aligns
- Provide technical leadership on how to break down initiatives into appropriately sized features, epics and stories that balance value and risk. Take a leadership role on setting standards, driving quality and consistency in solution delivery
- Work closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build plan
- Lead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs
- Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques
- Collaborate with the BI Product Owner, analysts, and other business stakeholders to understand data requirements and deliver solutions that meet business needs
- Optimize and tune data processing systems for performance, reliability, and scalability
- Implement data quality and validation processes to ensure the accuracy and integrity of data throughout the pipelines
- Operate an agile CI/CD environment within Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices
- Develop and maintain data models, schemas, and documentation
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution
- Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as appropriate
- Ensure adherence to BFS Governance processes
- Provide line management and technical leadership to a small team of Data Engineers
- Work closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build plan
- Lead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs
- Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques
What we are looking for in our ideal Senior Databricks Data Engineer:
- A Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Alternatively, relevant experience in the data engineering field
- Databricks, including Unity Catalog
- Terraform, defining, deploying, and managing cloud infrastructure as code
- Proficiency in programming languages such as Python, Spark, SQL
- Strong experience with SQL databases
- Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF)
- Experience with cloud platforms (Azure preferred) and related data services
- Excellent problem-solving skills and attention to detail
- Inclusive and curious, continuously seeks to build knowledge and understanding
- Strong communication and collaboration skills.
- Experience of Waterfall and Agile delivery methodologies
- As our Senior Databricks Data Engineer, we will reward you and your hard work with:
- Private healthcare for you and your family
- Company car allowance
- Company pension scheme
- Wide range of flexible benefits, such as gym membership, technology, or health assessments
- Access to an online wellbeing centre
- Range of discounts from many businesses
- 25 days holiday, which increases with servic,e and options to buy or sell more
- Electric Vehicle/Plug-in Hybrid Vehicle (EV/PHEV) scheme
Why us?We’ve supported small and medium-sized enterprises (SMEs) since 1982, and today we support more than 9000 businesses worldwide. We are proud to help businesses, both big and small to grow and thrive in domestic and international markets.We’re in the business of relationships. Whether working together or supporting our clients, that’s what makes us stand out from the crowd.We know our value lies in our brilliant people, It is fast-paced and varied, and we can handle it. We trust each other, take ownership, work flexibly, have fun and deliver for our clients every time.We empower our colleagues to be themselves and grow in the way they want – we believe in them and celebrate their success.
There’s no place quite like BFS and we’re proud of that. It’s all down to our colleagues - they make us the business with which every SME wants to partner.
If you would like to join us, please click ‘Apply’ today to be considered as our Senior Databricks Data Engineer - we would love to hear from you! This role will be hybrid and can be based in any of our UK offices.
We're absolutely committed to being a truly inclusive place to work, where everyone has an equal opportunity to reach their true potential. Let us know if you need adjustments to support you through any stage of the recruitment process.We reserve the right to close applications early. No agencies, please
Senior Databricks Data Engineer in Banbury employer: Bibby Financial Services
Bibby Financial Services is an exceptional employer that values its employees by fostering a dynamic and inclusive work culture. With a strong emphasis on personal growth, we offer extensive training opportunities and a range of flexible benefits, including private healthcare and a generous holiday allowance. Our commitment to empowering our team members ensures that you can thrive in your role as a Senior Databricks Data Engineer while contributing to the success of SMEs globally.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Databricks Data Engineer in Banbury
✨Tip Number 1
Familiarise yourself with Databricks and its features, especially Unity Catalog. Being able to discuss how you've used these tools in past projects will show your expertise and readiness for the role.
✨Tip Number 2
Brush up on your knowledge of Azure DevOps and CI/CD practices. Highlighting your experience in agile environments and how you've successfully managed data pipelines will set you apart from other candidates.
✨Tip Number 3
Prepare to discuss your leadership style and experiences managing teams. Since this role involves coaching and supporting a small team of Data Engineers, showcasing your ability to lead effectively will be crucial.
✨Tip Number 4
Stay updated on the latest trends in data engineering and be ready to suggest improvements or innovations. Showing that you're proactive about learning and adapting will demonstrate your commitment to the field.
We think you need these skills to ace Senior Databricks Data Engineer in Banbury
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights relevant experience and skills that align with the job description. Focus on your expertise in Databricks, data pipelines, and cloud platforms like Azure.
Craft a Compelling Cover Letter:Write a cover letter that showcases your passion for data engineering and your understanding of the company's goals. Mention specific projects or experiences that demonstrate your leadership and technical skills.
Highlight Technical Skills:Clearly list your proficiency in programming languages such as Python and SQL, as well as your experience with tools like Apache Airflow and Terraform. This will help you stand out as a strong candidate.
Showcase Problem-Solving Abilities:Include examples of how you've tackled complex data challenges in previous roles. This will illustrate your problem-solving skills and attention to detail, which are crucial for the Senior Databricks Data Engineer position.
How to prepare for a job interview at Bibby Financial Services
✨Showcase Your Technical Skills
As a Senior Databricks Data Engineer, you'll need to demonstrate your proficiency in Databricks, SQL, and Python. Be prepared to discuss specific projects where you've successfully implemented data pipelines or ETL processes, and highlight any experience with tools like Apache Airflow or Azure DevOps.
✨Understand the Business Context
Make sure you understand Bibby Financial Services' business model and how data engineering supports their goals. Research their products and services, and be ready to explain how your role as a data engineer can contribute to their success and decision-making processes.
✨Prepare for Leadership Questions
Since this role involves managing a small team, expect questions about your leadership style and experience. Think of examples where you've coached or supported team members, and be ready to discuss how you ensure quality and consistency in solution delivery.
✨Demonstrate Agile Methodology Knowledge
Familiarise yourself with Agile principles and practices, as this role operates within an Agile delivery environment. Be prepared to discuss your experience with sprint cycles, collaboration with product owners, and how you adapt to changing requirements in a fast-paced setting.