Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and maintain data pipelines on Azure, using PySpark and Apache Airflow.
- Company: Circana is a diverse and inclusive company committed to continuous learning and growth.
- Benefits: Enjoy remote work flexibility, a supportive culture, and recognition as a Great Place To Work.
- Why this job: Make a significant impact in data engineering while collaborating with a global team.
- Qualifications: Experience in data engineering, Azure services, and strong skills in Python and SQL required.
- Other info: Join a team that values curiosity, accountability, and inclusivity.
The predicted salary is between 48000 - 72000 £ per year.
Join to apply for the Senior Data Engineer (Remote) role at Circana
Join to apply for the Senior Data Engineer (Remote) role at Circana
At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified by Great Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana.
Learn more at www.circana.com.
What will you be doing?
We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply!
Job Responsibilities
- ETL/ELT Pipeline Development:
- Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow.
- Implement batch and real-time data processing solutions using Apache Spark.
- Ensure data quality, governance, and security throughout the data lifecycle.
- Manage and optimize cloud infrastructure (Azure) for data processing workloads, with a focus on cost-effectiveness.
- Implement and maintain CI/CD pipelines for data workflows to ensure smooth and reliable deployments.
- Develop and optimize large-scale data processing pipelines using Apache Spark and PySpark.
- Implement data partitioning, caching, and performance tuning techniques to enhance Spark-based workloads.
- Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning initiatives.
- Design and maintain DAGs (Directed Acyclic Graphs) in Apache Airflow to automate complex data workflows.
- Monitor, troubleshoot, and optimize job execution and dependencies within Airflow.
- Provide technical guidance and mentorship to a team of data engineers in India.
- Foster a collaborative environment and promote best practices for coding standards, version control, and documentation.
Requirements
- Client facing role so strong communication and collaboration skills are vital
- Proven experience in data engineering, with hands-on expertise in Azure Data Services, PySpark, Apache Spark, and Apache Airflow.
- Strong programming skills in Python and SQL, with the ability to write efficient and maintainable code.
- Deep understanding of Spark internals, including RDDs, DataFrames, DAG execution, partitioning, and performance optimization techniques.
- Experience with designing and managing Airflow DAGs, scheduling, and dependency management.
- Knowledge of CI/CD pipelines, containerization technologies (Docker, Kubernetes), and DevOps principles applied to data workflows.
- Excellent problem-solving skills and a proven ability to optimize large-scale data processing tasks.
- Prior experience in leading teams and working in Agile/Scrum development environments.
- A track record of working effectively global remote teams
Desirable:
- Experience with data modelling and data warehousing concepts.
- Familiarity with data visualization tools and techniques.
- Knowledge of machine learning algorithms and frameworks.
Circana Behaviours
As well as the technical skills, experience and attributes that are required for the role, our shared behaviours sit at the core of our organization. Therefore, we always look for people who can continuously champion these behaviours throughout the business within their day-to-day role:
- Stay Curious: Being hungry to learn and grow, always asking the big questions.
- Seek Clarity: Embracing complexity to create clarity and inspire action.
- Own the Outcome: Being accountable for decisions and taking ownership of our choices.
- Center on the Client: Relentlessly adding value for our customers.
- Be a Challenger: Never complacent, always striving for continuous improvement.
- Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.
- Commit to each other: Contributing to making Circana a great place to work for everyone.
Location
This position can be located in the following area(s): Bracknell
Seniority level
-
Seniority level
Mid-Senior level
Employment type
-
Employment type
Full-time
Job function
-
Job function
Information Technology
-
Industries
Market Research
Referrals increase your chances of interviewing at Circana by 2x
Get notified about new Senior Data Engineer jobs in United Kingdom.
London Area, United Kingdom $100,000.00-$120,000.00 2 weeks ago
London, England, United Kingdom 3 weeks ago
Senior Data Analyst, Strategic Marketing
London, England, United Kingdom 3 weeks ago
Adderbury, England, United Kingdom 1 month ago
Greater London, England, United Kingdom 1 week ago
City Of London, England, United Kingdom 1 week ago
Greater London, England, United Kingdom 2 days ago
London, England, United Kingdom 1 week ago
London, England, United Kingdom 4 days ago
Manchester, England, United Kingdom 1 week ago
Senior Fraud Strategy Data Analyst – Control Optimisation
London, England, United Kingdom 1 month ago
Birmingham, England, United Kingdom 1 week ago
Edinburgh, Scotland, United Kingdom 1 week ago
London, England, United Kingdom 1 week ago
Newcastle Upon Tyne, England, United Kingdom 1 week ago
Manchester, England, United Kingdom 1 week ago
London, England, United Kingdom 2 days ago
Senior React Native Engineer – Outside of IR-35
London, England, United Kingdom 2 months ago
London, England, United Kingdom 5 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Senior Data Engineer (Remote) employer: Circana
Contact Detail:
Circana Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Data Engineer (Remote)
✨Tip Number 1
Familiarise yourself with the specific technologies mentioned in the job description, such as Azure, PySpark, and Apache Airflow. Consider building a small project or contributing to open-source projects that utilise these tools to demonstrate your hands-on experience.
✨Tip Number 2
Network with current or former employees of Circana on platforms like LinkedIn. Engaging in conversations about their experiences can provide valuable insights into the company culture and expectations, which you can leverage during interviews.
✨Tip Number 3
Prepare to discuss your problem-solving skills and past experiences in optimising data processing tasks. Be ready to share specific examples that highlight your ability to handle large-scale data workloads effectively.
✨Tip Number 4
Showcase your leadership and collaboration skills by preparing examples of how you've mentored others or worked within a team. Circana values inclusivity and teamwork, so demonstrating your alignment with these behaviours will strengthen your application.
We think you need these skills to ace Senior Data Engineer (Remote)
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights relevant experience in data engineering, particularly with Azure Data Services, PySpark, and Apache Spark. Use specific examples to demonstrate your skills in building ETL/ELT pipelines and managing cloud infrastructure.
Craft a Compelling Cover Letter: In your cover letter, express your passion for data engineering and how your values align with Circana's commitment to diversity and continuous learning. Mention specific projects or achievements that showcase your problem-solving skills and ability to work in a collaborative environment.
Showcase Technical Skills: Clearly outline your technical skills in Python, SQL, and any experience with CI/CD pipelines or containerization technologies. Highlight your understanding of Spark internals and your experience with Airflow DAGs, as these are crucial for the role.
Demonstrate Soft Skills: Since this is a client-facing role, emphasise your strong communication and collaboration skills. Provide examples of how you've successfully led teams or worked with global remote teams, showcasing your ability to foster a positive and inclusive work environment.
How to prepare for a job interview at Circana
✨Showcase Your Technical Skills
Be prepared to discuss your hands-on experience with Azure Data Services, PySpark, Apache Spark, and Apache Airflow. Bring examples of past projects where you designed and optimised ETL/ELT pipelines, as this will demonstrate your technical expertise.
✨Emphasise Communication Skills
Since this is a client-facing role, highlight your strong communication and collaboration skills. Be ready to share examples of how you've effectively worked with teams or clients in the past, especially in remote settings.
✨Demonstrate Problem-Solving Abilities
Prepare to discuss specific challenges you've faced in data engineering and how you overcame them. This could include optimising large-scale data processing tasks or troubleshooting issues within Airflow. Show that you can think critically and adapt to complex situations.
✨Align with Company Values
Circana values curiosity, clarity, and inclusivity. During the interview, express your commitment to continuous learning and improvement. Share how you foster collaboration and inclusivity in your work environment, as this aligns with their core behaviours.
