At a Glance
- Tasks: Lead data architecture projects and design scalable data platforms for AI applications.
- Company: Join Scale Factory, an innovative AI consultancy with a focus on quality and transformation.
- Benefits: Enjoy 25 days annual leave, health benefits, and flexible hybrid working.
- Other info: Collaborative culture with opportunities for mentorship and professional growth.
- Why this job: Make a real impact in the AI space while developing your technical skills.
- Qualifications: 6+ years in data architecture with hands-on experience in AWS or Databricks.
The predicted salary is between 72000 - 88000 £ per year.
About Scale Factory
We are an AI enablement consultancy. Delivering quality-led AI-first foundations, embedding capability and excellence into the foundational fabric of the companies we work with. We give leaders the confidence to move faster, take smarter risks and pursue transformation. Formerly Ten10, we have deep roots in Quality which means we don't just build for the future, we ensure it actually works. We combine this engineering discipline with cutting-edge AI expertise to deliver robust, scalable foundations that turn ambitious transformation into reliable reality.
Role Purpose
We see data as the foundations for AI and are growing our data practice to help businesses embrace the future and make their data fit for the AI age. We are seeking an AI literate (and willing to learn / gain certifications in this important new area) Data Leader. You will act as a senior technical lead and hands-on data architect on client engagements. You'll work directly with client engineering teams, data leads, and technical stakeholders to design, build, and deploy production-grade data platforms and AI applications. Rooted in the codebase, you will lead delivery teams by example, ensuring high engineering standards, robust software practices, and architectural alignment. Off-project, you will contribute directly to shaping our technical practice by building reference implementations, accelerators, and reusable delivery assets.
Technical Architecture & Delivery
- Design end-to-end target data platforms (ingestion, storage, transformation, serving, and governance) in alignment with overall technical direction.
- Make and document key architectural decisions and technical trade-offs (e.g., lakehouse vs. warehouse, AI context stores).
- Translate business and functional requirements into scalable, resilient data pipeline architectures and detailed technical roadmaps.
- Embed non-functional requirements, data security, privacy, lineage, quality controls, and FinOps guardrails directly into the engineering design.
Hands-on Engineering & Technical Leadership
- Serve as the Tech Lead on client engagements where required, guiding delivery teams and unblocking technical hurdles.
- Write, review, and maintain production-grade code.
- Establish and champion practice engineering standards, including unit/integration testing, CI/CD pipelines, automated deployments, environments, and observability.
- Mentor, coach, and support mid-level and senior engineers to elevate the overall technical output of the team.
Client Engagement & Technical Advisory
- Facilitate technical discovery and architecture alignment sessions with client engineering teams and technical leads.
- Act as a trusted technical advisor on trade-offs, performance optimization, refactoring, and risk mitigation.
- Communicate architectural concepts, decision records, and technical trade-offs clearly to both technical and non-technical stakeholders.
Practice Building & Knowledge Sharing
- Build reusable delivery assets, reference architectures, code accelerators, and technical playbooks.
- Assist with interviewing and technical assessments for prospective data engineering candidates.
- Collaborate across cloud infrastructure and testing practice groups to ensure seamless technical cross-pollination.
Essential Experience
- 6+ years in data architecture and technical delivery, with hands-on experience leading data transformation projects.
- Proven experience building and deploying scalable data platforms end-to-end on AWS and/or Databricks.
- Strong, hands-on production experience with Python, SQL, Spark, and Databricks or AWS data tools.
- Experience working in a consultancy, systems integrator, or client-facing setting with direct accountability to project delivery outcomes.
- Solid depth in dimensional modeling, NoSQL schemas, and lakehouse/medallion architecture patterns.
- Practical experience implementing data catalogues, lineage, access controls, data quality checks, and monitoring.
- Experience implementing cost controls, platform monitoring, and optimizing data compute/storage expenses.
- SC clearance, or eligibility for it.
Desirable
- Databricks and/or AWS certifications at Associate or Professional level.
- Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming).
- Exposure to Data Mesh concepts, data products, or federated data governance models.
- Exposure to AI/ML data foundations, including feature stores, MLflow, model serving, or retrieval pipelines (RAG).
- Experience working within regulated environments (Financial Services, Healthcare, Public Sector).
How You Work
- Recommends practical, elegant solutions over unnecessary complexity.
- Leads with working code, rigorous standards, and sound engineering practices.
- Produces clear technical documentation, architecture diagrams, and decision records.
- Enjoys mentoring team members and sharing knowledge to raise collective engineering capability.
- Comfortable navigating technical ambiguity within fast-paced or evolving environments.
What’s in It for You?
- 25 Days of Annual Leave: Plus 1 extra day every year for the first three years, with a holiday buying scheme.
- Pension Plan: Employer-matched contributions up to 5%.
- Health Benefits: Comprehensive coverage for medical, dental, optical, and alternative therapies.
- Fitness Support: Subsidised gym memberships and a bike-to-work scheme.
- Commuter Benefits: Season ticket loans to make travel easier.
- Free Annual Rail Cards.
- Electric vehicle salary sacrifice scheme.
- Flexible Work Model: Hybrid working that fits your lifestyle.
- Social Events: From annual kick-offs and Christmas parties to team socials and sporting events, we love celebrating success together.
- Training & Development: Tailored learning opportunities and full support for certifications to keep your skills sharp.
Let’s Build the Future Together
Lead Data Consultant - AWS / Databricks in London employer: Centre4 Testing
At Scale Factory, we pride ourselves on being an exceptional employer that fosters a culture of collaboration, creativity, and innovation. Our commitment to employee growth is evident through tailored training opportunities and a flexible hybrid working model that promotes work-life balance. With exciting projects across diverse industries and a supportive team environment, we empower our employees to thrive while making a meaningful impact in the world of AI and cloud solutions.
StudySmarter Expert Advice🤫
We think this is how you could land Lead Data Consultant - AWS / Databricks in London
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Centre4 Testing!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Lead Data Consultant - AWS / Databricks at Centre4 Testing.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Centre4 Testing.
✨Apply Directly through Our Website
When you find a suitable opening like Lead Data Consultant - AWS / Databricks at Centre4 Testing, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Lead Data Consultant - AWS / Databricks in London
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Centre4 Testing, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Centre4 Testing. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Centre4 Testing
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Centre4 Testing!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.