At a Glance
- Tasks: Design and scale data pipelines for AI-driven commercial workflows.
- Company: Join a diverse team at a leading tech company focused on innovation.
- Benefits: Competitive salary, inclusive culture, and opportunities for professional growth.
- Other info: Embrace a collaborative environment that values diverse perspectives.
- Why this job: Make an impact by shaping the future of AI and data architecture.
- Qualifications: 6+ years in data engineering with expertise in Microsoft stack and Python.
The predicted salary is between 60000 - 80000 £ per year.
Role Purpose
As a Senior Data Engineer within our Commercial Digital AI & Automation team, you will design, own, and scale the data foundation powering our next‑generation, AI‑driven commercial workflows.
You will serve as the technical authority for our data architecture, designing and implementing highly reliable data pipelines from key CRM and ERP sources.
In this role, you will architect the governed context layer that grounds AI agents in accurate business data, establish intelligent feedback loops to drive continuous learning, and deliver the advanced analytical products needed to measure agent performance and commercial outcomes.
Key Responsibilities
- Data Architecture & Pipeline
Engineering: Architect, build, and operate resilient data pipelines integrating Salesforce, SAP, and service data into highly governed analytical and operational data products.
Lead the technical implementation utilizing Microsoft Fabric, Dataverse, Python, and SQL.
- AI Context
Management: Design and own the context layer for AI agents.
Deliver curated, versioned data products with strict data contracts, entity resolution, and optimized retrieval interfaces to ground LLM/AI outputs.
- Intelligent
- Feedback
Loops: Establish sophisticated feedback systems to capture agent outcomes, human corrections, and downstream results, seamlessly feeding them back into data products, prioritization models, and scoring logic.
- Advanced Reporting & Analytics: Oversee the delivery of robust Power BI dashboards, semantic models, and datasets covering critical agent performance, pipeline/funnel metrics, and data quality.
- Data Quality, Governance & Security: Set the standards for and implement robust data‑quality frameworks (completeness monitoring, deduplication, entity resolution, and source reconciliation).
Define and enforce data lineage, access controls, retention, and compliance protocols in close partnership with IT and data owners.
- Integration
Evolution: Drive the modernization of our data landscape by transitioning legacy, file/export‑based flows toward secure, modern, API‑based, in‑perimeter integration patterns.
- Role Requirements
- Experience & Autonomy: 6+ years of hands‑on data engineering experience, with a proven track record of owning end‑to‑end data architectures and production pipelines supporting operational (not just analytical) enterprise use cases.
- Technical Stack Expertise: Deep expertise across the Microsoft data stack (Fabric, Dataverse, Power BI) alongside advanced Python and SQL development skills.
- Integration Expertise: Proven experience integrating complex enterprise data from Salesforce and/or SAP, specifically utilizing modern API‑based integration patterns.
- Advanced AI Data
Engineering: Direct experience designing data modeling/entity resolution frameworks across CRM/ERP domains, as well as designing context/retrieval layers (e. g., RAG systems) and feedback loops for AI/LLM applications.
- Leadership & Stewardship: Proven ability to make independent architectural and tooling decisions, set technical standards for engineering teams, and ensure the absolute reliability of data feeding customer‑facing AI agents.
- Leadership Behaviours
- Inspire
- Your
People: Communicate a compelling technical vision, simplify complex architectural challenges, and plan for the long‑term interest of the business.
Bring positive energy, ambition, high integrity, and a proactive willingness to learn from setbacks.
- Strengthen
- Your
Team: Set a high bar for technical excellence, hold peers and collaborators accountable, and foster a growth mindset through coaching, mentoring, and active collaboration.
- Grow
- Your
Business: Implement data strategies that deliver tangible business results.
Put customers at the heart of what you build, proactively optimize existing processes, and champion the Spectris Business Systems.
Malvern Panalytical, Micromeritics and Sci Aps, part of the Spectris Group, are committed to a diverse and inclusive culture where everyone can thrive and achieve a fulfilling career.
We encourage applications from underrepresented individuals and people with diverse backgrounds.
Although we always select the most qualified applicant for each role and make all decisions without regard to race, sex, age, or any other protected class, we are an inclusive, equal opportunity organization that prizes diversity.
Your unique perspective is important to us.
#J-18808-Ljbffr
Data Engineer in Malvern employer: Malvern Panalytical
Malvern Panalytical is an excellent employer, offering a dynamic and inclusive work culture that values innovation and collaboration. As a Senior Azure Cloud Architect, you will have access to continuous professional development opportunities, enabling you to grow your skills in a supportive environment. With the flexibility of remote work in the UK, you can enjoy a healthy work-life balance while contributing to impactful projects in cloud technology.
