At a Glance
- Tasks: Lead the design and delivery of modern data solutions using cutting-edge technologies.
- Company: Join an award-winning tech company recognised for its commitment to security and innovation.
- Benefits: Enjoy competitive salary, inclusive culture, and opportunities for professional growth.
- Other info: Dynamic environment with a focus on diversity and accessibility in the workplace.
- Why this job: Make a real impact by driving enterprise data strategies and mentoring future tech leaders.
- Qualifications: Proven experience in data engineering and leadership roles with strong Python skills.
The predicted salary is between 60000 - 80000 £ per year.
The Role
Technical Lead - Data Engineering and play a critical role in driving our enterprise data platform strategy.
You will lead the design, development, and delivery of modern data solutions using Snowflake, DBT, Azure/AWS, Python, Airflow, and CI/CD technologies.
This role combines deep technical expertise with leadership responsibilities, guiding engineering teams, defining best practices, and ensuring the successful delivery of scalable, secure, and high-performing data platforms.
- Your responsibilities
- Lead the design and implementation of scalable and secure data platforms using Snowflake, DBT, Airflow, Python, and Azure/AWS services.
- Define technical architecture, coding standards, engineering best practices, and development frameworks for the data engineering team.
- Drive the adoption of CI/CD pipelines using Git Hub Actions, Azure Dev Ops, Jenkins, or similar tools to automate build, test, deployment, and release management processes.
- Lead the development, optimization, and maintenance of complex ETL/ELT pipelines for large-scale data processing.
- Establish Dev Ops and Data Ops practices to improve deployment efficiency, reliability, and operational excellence.
- Mentor and coach data engineers through technical guidance, code reviews, architecture reviews, and knowledge-sharing sessions.
- Collaborate with enterprise architects and business stakeholders to translate business requirements into scalable technical solutions.
- Own platform reliability, monitoring, performance tuning, and troubleshooting of production data pipelines.
- Implement Infrastructure as Code (Ia C) using Terraform/Terragrunt to automate cloud resource provisioning.
- Drive data quality, governance, security, and compliance standards across the data ecosystem.
- Lead technical discussions, solution design workshops, and project planning activities.
- Evaluate emerging technologies and recommend innovative approaches to improve data engineering capabilities and delivery processes.
- Support Agile delivery and provide technical leadership throughout the project lifecycle.
- Technical Leadership
- Proven experience as a Technical Lead, Lead Data Engineer, or similar leadership role.
- Experience leading distributed development teams and delivering large-scale data engineering projects.
- Strong stakeholder management and technical decision-making capabilities.
- Python & Data Engineering
- Expert-level proficiency in Python for data engineering, automation, orchestration, and application development.
- Strong experience developing scalable ETL/ELT frameworks using Python and SQL.
- Hands‑on experience with DBT, Airflow, Snowflake, and cloud-native data services.
- CI/CD & Dev Ops
- Strong experience designing and implementing CI/CD pipelines using Git Hub Actions, Azure Dev Ops, Jenkins, Git Lab CI/CD, or similar platforms.
- Experience implementing automated testing, code quality checks, release management, and deployment automation.
- Strong understanding of Dev Ops, Data Ops, CI/CD best practices, and release governance.
- Cloud & Platform Engineering
- Extensive experience designing cloud-based data solutions on Azure and/or AWS.
- Strong knowledge of cloud security, networking, monitoring, and operational best practices.
- Experience with Infrastructure as Code using Terraform and Terragrunt.
- Data Architecture
- Expertise in Data Vault, dimensional modelling, data warehousing, and modern data platform architectures.
- Advanced SQL development and performance optimization skills.
- Communication & Stakeholder Engagement
Desirable Skills / Knowledge / Experience
- Experience with Generative AI and AI-powered data engineering solutions.
- Experience with Power BI, Micro Strategy, or other BI tools.
- Knowledge of Kubernetes, Docker, and containerized deployments.
- Experience with Databricks and modern lakehouse architectures.
- Azure Data Factory, Synapse Analytics, or AWS Glue experience.
- Experience implementing Data Ops frameworks and observability platforms.
- Exposure to enterprise architecture and governance frameworks.
- Languages: Python (primary), SQL, Bash
- Cloud: Azure, AWS
- Tools: Airflow, DBT
- Data: Snowflake, Delta Lake, Redis, Azure Data Lake
- Infra & Ops: Terraform, Git Hub Actions, Azure Dev Ops, Azure Monitor
LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations.
Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance.
A multiple award-winning organisation, having secured the prestigious Queens Award for
Enterprise: International Trade over consecutive years.
We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported.
We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply.
If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.
Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.
#J-18808-Ljbffr
Technical Lead Data engineering in City of Westminster employer: Onyx-Conseil
Onyx-Conseil is an excellent employer for those seeking a dynamic and rewarding career in infrastructure engineering. With a strong focus on employee development, the company offers numerous growth opportunities, a collaborative work culture, and the chance to work on impactful projects in secure environments. Located in Salford, employees benefit from a vibrant community and access to cutting-edge technology, making it an ideal place for professionals looking to enhance their skills and contribute to meaningful projects.
StudySmarter Expert Advice🤫
We think this is how you could land Technical Lead Data engineering in City of Westminster
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Onyx-Conseil!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Technical Lead Data engineering at Onyx-Conseil.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Onyx-Conseil.
✨Apply Directly through Our Website
When you find a suitable opening like Technical Lead Data engineering at Onyx-Conseil, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Technical Lead Data engineering in City of Westminster
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Onyx-Conseil, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Onyx-Conseil. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Onyx-Conseil
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Onyx-Conseil!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.