At a Glance
- Tasks: Design and optimise data pipelines using cutting-edge tech like Azure, PySpark, and Apache Airflow.
- Company: Join Circana, a forward-thinking company passionate about technology and client success.
- Benefits: Flexible work environment, opportunities for growth, and a culture that celebrates achievements.
- Other info: Collaborative team atmosphere with mentorship opportunities and a focus on innovation.
- Why this job: Make a real impact by solving complex data challenges for clients globally.
- Qualifications: 5+ years in data engineering with strong skills in Python, SQL, and cloud services.
The predicted salary is between 60000 - 80000 € per year.
At Circana, we are fueled by our passion for continuous learning and growth. We seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. Join our Global Professional Services team as a Data Engineer, where you will be instrumental in bridging the gap between client needs, business objectives, and cutting-edge technology solutions, particularly supporting our new Private Cloud clients.
This role is for more than just a service provider; we are seeking a consultant-minded go-getter who is client-obsessed, a liquid thinker who thrives at pace, and is bold and brave in challenging the status quo. We are a team that values being part of a successful business and building partnerships based on trust, deep knowledge, respect, and unwavering support. We are passionate about technology, data and AI and how it can be leveraged to solve our clients' most pressing business challenges.
You will be a key player in understanding our clients' world, becoming their trusted partner, and proactively identifying opportunities for innovation and efficiency. Curiosity, accountability, and a positive, questioning mindset are at the core of our team's DNA – we don't just aim to meet expectations, we strive to exceed them. You will work collaboratively with global Circana teams, acting as the vital link to ensure seamless, unified support and strategic technological partnership for our clients.
In this role we are seeking a skilled and motivated Data Engineer to join a growing Global Team based in the UK. You will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for Data Engineering and a desire to make a significant impact, we encourage you to apply!
Key Responsibilities:- ETL/ELT Pipeline Development: Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow. Implement batch and real-time data processing solutions using Apache Spark. Ensure data quality, governance, and security throughout the data lifecycle.
- Cloud Data Engineering: Manage and optimize cloud infrastructure (Azure) for data processing workloads, with a focus on cost-effectiveness. Implement and maintain CI/CD pipelines for data workflows to ensure smooth and reliable deployments.
- Big Data & Analytics: Develop and optimize large-scale data processing pipelines using Apache Spark and PySpark. Implement data partitioning, caching, and performance tuning techniques to enhance Spark-based workloads. Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning initiatives.
- Workflow Orchestration (Airflow): Design and maintain DAGs (Directed Acyclic Graphs) in Apache Airflow to automate complex data workflows. Monitor, troubleshoot, and optimize job execution and dependencies within Airflow.
- Team Leadership & Collaboration: Provide technical guidance and mentorship to a team of data engineers in India. Foster a collaborative environment and promote best practices for coding standards, version control, and documentation.
- Client facing role so strong communication and collaboration skills are vital (Ideally gained in a Consulting organisation).
- 5+ years of proven experience in data engineering, with hands-on expertise in Azure Data Services, PySpark, Apache Spark, and Apache Airflow.
- Strong programming skills in Python and SQL, with the ability to write efficient and maintainable code.
- Deep understanding of Spark internals, including RDDs, DataFrames, DAG execution, partitioning, and performance optimization techniques.
- Experience with designing and managing Airflow DAGs, scheduling, and dependency management.
- Knowledge of CI/CD pipelines, containerization technologies (Docker, Kubernetes), and DevOps principles applied to data workflows.
- Excellent problem-solving skills and a proven ability to optimize large-scale data processing tasks.
- Prior experience in leading teams and working in Agile/Scrum development environments.
- A track record of working effectively with global remote teams.
- Experience with data modelling and data warehousing concepts.
- Familiarity with data visualization tools and techniques.
- Knowledge of machine learning algorithms and frameworks.
We are seeking an individual who embodies the following characteristics:
- An authentic optimist with a genuine passion for solving problems and driving progress.
- Intensely curious – you love to understand the 'why' and 'how' behind things, especially when it comes to technology and client challenges.
- Highly accountable for your actions, your deliverables, and the success of your clients.
- Comfortable and adept at building strong, professional relationships with both external clients and internal technical and business teams.
- Deeply committed to giving your best for your team and ensuring our technology solutions exceed client expectations.
- Confident in making informed decisions, weighing options and considering the technical and business implications.
- Highly organised, with meticulous attention to detail in managing documentation, communication, and time.
- Passionate about technology, Data, AI, and their application in solving real-world business problems.
- Previous experience translating client requirements into technical specifications.
Interested?
ETL Data Senior Developer in London employer: Circana
At Circana, we pride ourselves on fostering a dynamic work culture that champions continuous learning and personal growth, making it an exceptional employer for those in the ETL Data Senior Developer role. Our UK-based Global Professional Services team thrives on collaboration, innovation, and a client-centric approach, offering employees the chance to work with cutting-edge technology while enjoying a flexible work environment that balances professional and personal commitments. With ample opportunities for mentorship and career advancement, Circana is dedicated to empowering its employees to exceed expectations and make a meaningful impact in the world of data engineering.
StudySmarter Expert Advice🤫
We think this is how you could land ETL Data Senior Developer in London
✨Tip Number 1
Network like a pro! Get out there and connect with people in the industry. Attend meetups, webinars, or even just grab a coffee with someone who works at Circana. Building relationships can open doors that a CV just can't.
✨Tip Number 2
Show off your skills! If you’ve got a portfolio or any projects that highlight your expertise in ETL/ELT pipelines or Azure, make sure to share them during interviews. It’s a great way to demonstrate your hands-on experience and passion for data engineering.
✨Tip Number 3
Prepare for those tricky questions! Research common interview questions for data engineers and practice your responses. Think about how your experience aligns with Circana's values of curiosity and accountability – they’ll love to see that you’re a good fit!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining the Circana team and contributing to their innovative projects.
We think you need these skills to ace ETL Data Senior Developer in London
Some tips for your application 🫡
Show Your Passion for Data:When writing your application, let your enthusiasm for data engineering shine through! Share specific examples of how you've tackled challenges in the past and how your curiosity drives you to find innovative solutions.
Tailor Your Application:Make sure to customise your CV and cover letter to highlight the skills and experiences that align with the job description. We want to see how your background in Azure, PySpark, and Apache Airflow makes you the perfect fit for our team!
Be Clear and Concise:Keep your application straightforward and to the point. Use bullet points where possible to make it easy for us to see your key achievements and skills. Remember, clarity is key when showcasing your expertise!
Apply Through Our Website:We encourage you to submit your application directly through our website. This way, we can ensure your application gets the attention it deserves and you’ll be one step closer to joining our amazing team!
How to prepare for a job interview at Circana
✨Know Your Tech Inside Out
Make sure you brush up on your knowledge of Azure, PySpark, Apache Spark, and Airflow. Be ready to discuss how you've used these technologies in past projects, and think of specific examples where you optimised data pipelines or solved complex problems.
✨Show Off Your Client Skills
Since this role is client-facing, prepare to demonstrate your communication and collaboration skills. Think of scenarios where you've successfully built relationships with clients or worked in a team to deliver results. Highlight your ability to understand client needs and translate them into technical solutions.
✨Be Ready for Problem-Solving Questions
Expect to face some technical challenges during the interview. Practice explaining your thought process when tackling data engineering problems. Use the STAR method (Situation, Task, Action, Result) to structure your answers and showcase your problem-solving skills effectively.
✨Emphasise Your Curiosity and Accountability
Circana values curiosity and accountability, so be prepared to discuss how you stay updated with industry trends and technologies. Share examples of how you've taken ownership of your work and driven progress in your previous roles, showing that you're not just meeting expectations but exceeding them.
