At a Glance
- Tasks: Design and build data pipelines using Azure and Databricks to drive impactful insights.
- Company: Join Verian, a global agency transforming public policy through data.
- Benefits: Enjoy flexible working, a supportive team, and opportunities for professional growth.
- Why this job: Be at the forefront of digital transformation and influence social change with your work.
- Qualifications: Experience in data engineering, cloud technologies, and strong stakeholder management skills.
- Other info: Dynamic environment with a focus on innovation and wellbeing.
The predicted salary is between 60000 - 84000 £ per year.
Verian is an independent research, evidence, evaluation, and communications agency that helps governments solve public policy challenges by working with citizens and the public realm. We provide services to government and public sector organizations, drawing on expertise in social research, policy development, and communication. Operating globally, Verian has offices across Europe, Asia Pacific, and the United States.
We are seeking a Senior Data Engineer to join our Data Platform team and contribute to the delivery of our product strategy for managing and analysing social research data. Working primarily with Azure and Databricks, supported by technologies like Power BI, you’ll design, build, and maintain scalable, reliable, and high-quality data pipelines. As a key member of the team, you will collaborate with product managers, lead engineers, and cross-functional teams to turn business requirements into technical solutions that drive real-world impact.
Responsibilities
- Collaborate with global business stakeholders to translate business requirements into clear technical specifications
- Design, develop and maintain data pipelines using Azure Data Factory (ADF), Databricks, Synapse, Python, R, Spark, Pandas and SQL
- Manage and optimise Azure resources including Azure Portal, Blob Storage, and Data Lake
- Implement and manage data workflows, ensuring seamless data orchestration and integration
- Develop and maintain ETL processes, including delta loading and change data capture (CDC) mechanisms
- Implement pipelines with Azure DevOps, Terraform and/or CI/CD
- Ensure data security, quality, and governance, including access controls and retention policies
- Use Power BI for data visualisation, reporting, and insights delivery
Skills and Experience
- Proven experience as Senior Data Engineer in international environments, ideally within the consulting sector
- Strong stakeholder management skills and ability to adapt across regions and cultures
- Comfortable working in a fast-paced, agile environment
- Track record in designing and implementing scalable data platforms and products
- Deep expertise in Cloud technologies, especially Microsoft Azure
- Advanced skills in Python, R, Spark, Pandas, and SQL
- Hands‑on experience with Delta Live Tables
- Familiarity with the Databricks medallion architecture
- Working knowledge of Unity Catalog and data governance principles
- Experience applying Agile and DevOps practices
- Proficient in building and maintaining CI/CD pipelines
- Experience using Terraform for infrastructure as code
Why Join Verian?
- Joining Verian means becoming part of a dynamic and collaborative community that thrives on innovation and intellectual curiosity.
- Play a pivotal role in building our data platform from the ground up, at the heart of Verian’s digital transformation.
- Contribute to innovative data products that leverage AI and Machine Learning.
- Work on cutting-edge projects that influence public policy and drive meaningful social change.
- Benefit from flexible working arrangements that support a healthy work–life balance.
- Join a supportive, passionate team in an environment where wellbeing truly matters.
How to Apply
If you’re passionate about turning data into insights that impact society, we’d love to hear from you! Apply online today, and if your profile matches, we’ll be in touch for an initial exploratory interview. We encourage applications from all sections of society and provide reasonable accommodations for candidates with disabilities throughout the application and interview process.
Senior Data Engineer employer: Verian Group
Contact Detail:
Verian Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer
✨Tip Number 1
Network like a pro! Reach out to current or former employees at Verian on LinkedIn. A friendly chat can give you insider info and might just get your foot in the door.
✨Tip Number 2
Show off your skills! Prepare a portfolio or a project that highlights your experience with Azure, Databricks, and data pipelines. This will help you stand out during interviews.
✨Tip Number 3
Practice makes perfect! Get comfortable with common interview questions for data engineers. Think about how your past experiences align with Verian's mission and values.
✨Tip Number 4
Apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re genuinely interested in joining the Verian team.
We think you need these skills to ace Senior Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Senior Data Engineer role. Highlight your experience with Azure, Databricks, and any relevant projects that showcase your skills in building data pipelines. We want to see how your background aligns with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about data engineering and how you can contribute to our mission at Verian. Be sure to mention specific technologies and experiences that relate to the job description.
Showcase Your Stakeholder Management Skills: Since collaboration is key in this role, make sure to highlight your stakeholder management skills. Share examples of how you've successfully worked with cross-functional teams to turn business requirements into technical solutions. We love seeing teamwork in action!
Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it shows you’re keen on joining our team at Verian!
How to prepare for a job interview at Verian Group
✨Know Your Tech Stack
Make sure you’re well-versed in the technologies mentioned in the job description, especially Azure, Databricks, and the programming languages like Python and SQL. Brush up on your knowledge of data pipelines and ETL processes, as these will likely come up during technical discussions.
✨Showcase Your Collaboration Skills
Since the role involves working with cross-functional teams, be prepared to discuss your experience in stakeholder management. Share specific examples of how you've successfully collaborated with product managers and engineers to turn business requirements into technical solutions.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving skills in real-world scenarios. Think about challenges you've faced in previous roles, particularly in designing scalable data platforms or optimising data workflows, and be ready to explain your thought process and the outcomes.
✨Demonstrate Your Passion for Impact
Verian is all about making a difference through data. Be sure to express your enthusiasm for using data to influence public policy and drive social change. Share any relevant projects or experiences that highlight your commitment to this mission.