At a Glance
- Tasks: Design and build data pipelines using Azure and PySpark for Fortune 500 companies.
- Company: Fractal Analytics, a strategic AI partner known for innovation and a great workplace culture.
- Benefits: Competitive salary, growth opportunities, and a vibrant work environment.
- Why this job: Join a team that empowers imagination with intelligence and drives impactful decisions.
- Qualifications: Experience in CPG domain and strong data engineering skills required.
- Other info: Dynamic role with opportunities to mentor and lead within a collaborative team.
The predicted salary is between 70000 - 90000 £ per year.
Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work(R) Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.
Location: London
Core Technical Responsibilities
- CPG domain experience is mandatory
- Design and build end-to-end data pipelines (batch and near real-time) using PySpark, Databricks, and Azure Data Platform (ADF, ADLS, Synapse)
- Be hands-on in development, debugging, optimization, and production support of data pipelines
- Work with or extend existing/proprietary ETL frameworks (e.g., Mar's Simpel or similar) and improve performance and reliability
- Implement data modeling, transformation, and orchestration patterns aligned with best practices
- Apply data engineering fundamentals including partitioning, indexing, caching, cost optimization, and performance tuning
- Collaborate with upstream and downstream teams to ensure data quality, reliability, and SLAs
Architecture & Design
- Contribute to the design of cloud-native data architectures covering ingestion, processing, storage, and consumption
- Translate business and analytical requirements into practical, scalable data solutions
- Support data governance practices including metadata, lineage, data quality checks, and access controls
- Work within hybrid environments (on-prem to cloud) and support modernization initiatives
- Understand and apply data mesh concepts where relevant (domain ownership, reusable data products, basic contracts)
- Evaluate tools and frameworks with a build vs. buy mindset, recommending pragmatic solutions
Team & Delivery Responsibilities
- Act as a technical anchor for a data engineering team
- Provide technical guidance, code reviews, and mentoring to engineers
- Own delivery for assigned data products or pipelines — from design through deployment
- Collaborate with product owners, analysts, and architects to clarify requirements and priorities
Stakeholder & Communication
- Engage with business and analytics stakeholders to understand data needs and translate them into technical solutions
- Clearly communicate technical designs and trade-offs to both technical and non-technical audiences
- Escalate risks and propose mitigation strategies proactively
- Support documentation of architecture, pipelines, and operational processes
Good to Have
- Exposure to AI/ML data workflows (feature engineering, model inputs, MLOps basics)
- Aware of LLMs / Agentic AI architectures from a data platform perspective
- Experience with other platforms such as AWS, GCP, Snowflake, BigQuery, Redshift
- Familiarity with data governance or catalog tools (DataHub, Collibra, dbt, etc.)
- Experience working in CPG, Retail, Supply Chain, or similar domains
If you like wild growth and working with happy, enthusiastic over-achievers, you will enjoy your career with us!
Lead Data Engineer / Architect - Azure / CPG Domain employer: Fractal
Contact Detail:
Fractal Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Lead Data Engineer / Architect - Azure / CPG Domain
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who work at Fractal or similar companies. A personal referral can make all the difference in getting noticed.
✨Tip Number 2
Prepare for interviews by brushing up on your technical skills and understanding the CPG domain. We recommend practising common data engineering scenarios and being ready to discuss your past projects in detail.
✨Tip Number 3
Show your passion for data! During interviews, share your thoughts on the latest trends in data engineering and how you can contribute to Fractal's mission of empowering imagination with intelligence.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets into the right hands. Plus, you can set up alerts for new job postings that match your interests.
We think you need these skills to ace Lead Data Engineer / Architect - Azure / CPG Domain
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Lead Data Engineer role. Highlight your experience with Azure and the CPG domain, as these are key for us. Use specific examples that showcase your skills in building data pipelines and working with data architectures.
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Share your passion for data engineering and how you align with our mission at Fractal. Don’t forget to mention any relevant projects or experiences that demonstrate your expertise in the field.
Showcase Your Technical Skills: We love seeing technical skills in action! Include any relevant certifications or projects that demonstrate your proficiency in tools like PySpark, Databricks, and Azure Data Platform. This will help us see how you can contribute to our team.
Apply Through Our Website: To ensure your application gets the attention it deserves, apply directly through our website. It’s the best way for us to receive your details and keep track of your application. Plus, it shows you’re serious about joining our team!
How to prepare for a job interview at Fractal
✨Know Your Tech Inside Out
Make sure you’re well-versed in the core technologies mentioned in the job description, like PySpark, Databricks, and Azure Data Platform. Brush up on your knowledge of data pipelines and be ready to discuss your hands-on experience with them.
✨Showcase Your CPG Domain Experience
Since CPG domain experience is mandatory, prepare specific examples from your past work that highlight your expertise in this area. Be ready to explain how your experience can benefit the company and contribute to their goals.
✨Communicate Clearly and Confidently
Practice explaining complex technical concepts in simple terms. You’ll likely need to communicate with both technical and non-technical stakeholders, so being able to articulate your ideas clearly will set you apart.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving skills and ability to handle real-world scenarios. Think about challenges you've faced in previous roles and how you overcame them, especially in relation to data governance and architecture.