Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the migration to AWS RDS and mentor a dynamic data team.
- Company: AND Digital, a forward-thinking tech company closing the digital skills gap.
- Benefits: Flexible working, training budget, and fun team socials await you!
- Why this job: Make a real impact while developing your skills in a supportive environment.
- Qualifications: 7-10 years in data engineering with strong AWS and Python expertise.
- Other info: Join a diverse team that values collaboration, curiosity, and innovation.
The predicted salary is between 48000 - 72000 ÂŁ per year.
Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. Weâve been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or âClubsâ) so that our partners are always prioritised by a regional team close to them. This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Join us - and help us fulfil our mission to close the worldâs digital skills gap.
We are seeking a Lead Data Engineer to act as the technical practice lead for the Luna data team. This is an important role responsible for leading a high business priority migration from ANDâs existing Redshift environment to our new AWS RDS (Postgres) architecture. Beyond technical architecture, you will be a mentor and skills builder for the team. You will guide the technical growth of our Data Analysts, transitioning them from SQL-centric workflows to production-ready Python and DataOps practices, while collaborating closely with stakeholders to translate business needs into scalable technical roadmaps.
What youâll bring to the table:
- Technical Leadership & Architecture: Lead new Data Pipeline Delivery: Implement the new Python-based ETL pipelines for data movement from Lunaâs microservice DynamoDB tables to RDS transactional DB (Postgres OLTP) and subsequently to the RDS data warehouse (Postgres OLAP).
- Platform Optimization: Leverage expertise from previous data setups to optimize the new Postgres OLTP for transactional performance and the OLAP environment for analytics effectiveness, with both being conscious of on-going cost management.
- Standard Setting: Establish and enforce DataOps standards, including version control (Git), automated CI / CD deployment, and schema migration management using tools like Liquibase or Drizzle ORM.
Team Enablement & Mentorship:
- Hands-on Coaching: Actively mentor team members, elevating their skills in Python, Git, and engineering workflows through code reviews and workshops.
- Code Quality: Conduct rigorous code reviews, providing detailed, educational feedback that explains best practices and clearly outlines required changes to elevate team standards.
- AI Engineering patterns: Support the definition and implementation of AI tooling and practices to augment the Data engineering team.
Strategic Agile Delivery:
- Initiative Planning: Break down larger reporting initiatives into manageable epics and stories within our Agile framework (a mix of Scrum for larger work items, and Kanban for smaller continuous flow items).
- Stakeholder Management: Network with business domains to capture requirements and provide strategic guidance on the data platform migration plan.
- Product Partnership: Support the Data Product Owner by providing the technical context necessary to prioritize the team's backlog effectively.
Required Experience & Technical Skills:
- Data Engineering - 7 to 10 years experience building and supporting full-stack data pipelines from source to reporting.
- AWS Mastery - 5+ years deep experience with AWS, ideally administration and optimization of RDS / Aurora (Postgres) and Redshift.
- Python - 5+ years expert-level Python, with specific experience working on ETL pipelines, including libraries like Pandas and orchestration tools like Airflow or Prefect.
- PostgreSQL - 5+ years expert-level SQL and database architecture (partitioning, indexing) for both OLTP and OLAP.
- DataOps / Tools - 3+ years expertise in Git, with solid understanding of Git branching and workflow, and schema management (e.g., Liquibase, Flyway, or Drizzle).
Why join AND Digital?
- Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to peopleâs lives.
- A âBlended Workingâ model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
- A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
- An annual budget for training and upskilling, including allocated days off so you donât have to study in your own free time.
- Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
- A safe environment for you to be yourself and challenge yourself.
Benefits:
- 25 days holiday allowance + bank holidays
- Share scheme
- A ÂŁ1000 flexifund to use on a personalised list of benefits such as Gym membership, Cycle to Work Scheme, Health, dental and optical cash plan
- 6% pension PLUS many more
For a full list of benefits - Equal Opportunities Statement At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application. We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.
Lead Data Engineer employer: AND Digital
Contact Detail:
AND Digital Recruiting Team
StudySmarter Expert Advice đ¤Ť
We think this is how you could land Lead Data Engineer
â¨Tip Number 1
Network like a pro! Reach out to current employees at AND Digital on LinkedIn or other platforms. Ask them about their experiences and any tips they might have for your interview process. Itâs all about making connections!
â¨Tip Number 2
Prepare for the technical side! Brush up on your Python and AWS skills, especially around ETL pipelines and DataOps practices. You want to show that you can lead the charge in migrating data and optimising performance.
â¨Tip Number 3
Show off your mentoring skills! Be ready to discuss how you've helped others grow in their roles. AND Digital values team enablement, so share examples of how you've elevated your team's skills in the past.
â¨Tip Number 4
Donât forget to apply through our website! Itâs the best way to ensure your application gets seen by the right people. Plus, it shows youâre genuinely interested in joining the AND Digital family.
We think you need these skills to ace Lead Data Engineer
Some tips for your application đŤĄ
Show Your Passion: When writing your application, let your enthusiasm for data engineering shine through! We love seeing candidates who are genuinely excited about the role and our mission to close the digital skills gap.
Tailor Your Experience: Make sure to highlight your relevant experience in data engineering, especially with AWS and Python. We want to see how your background aligns with the Lead Data Engineer role, so donât hold back on those key achievements!
Be Clear and Concise: Keep your application straightforward and to the point. We appreciate clarity, so use bullet points or short paragraphs to make it easy for us to see your qualifications and skills at a glance.
Apply Through Our Website: Donât forget to submit your application through our website! Itâs the best way for us to receive your details and ensures youâre considered for the role. Plus, it helps us keep everything organised!
How to prepare for a job interview at AND Digital
â¨Know Your Tech Inside Out
As a Lead Data Engineer, youâll need to showcase your expertise in AWS, Python, and PostgreSQL. Brush up on your knowledge of ETL pipelines and be ready to discuss specific projects where you've implemented these technologies. Prepare to explain your thought process behind architectural decisions and how they benefited the project.
â¨Demonstrate Leadership Skills
This role requires not just technical skills but also the ability to mentor and lead a team. Think of examples where you've successfully guided others, whether through code reviews or workshops. Be prepared to discuss how you foster collaboration and elevate team standards.
â¨Understand the Business Context
AND Digital values close relationships with clients, so itâs crucial to understand their business needs. Research the companyâs mission to close the digital skills gap and think about how your role as a Lead Data Engineer can contribute to that goal. Be ready to discuss how you would translate business requirements into technical solutions.
â¨Prepare for Agile Discussions
Since the role involves working within an Agile framework, brush up on your Agile methodologies. Be prepared to talk about how you break down larger initiatives into manageable tasks and how youâve collaborated with stakeholders in the past. Highlight any experience you have with Scrum or Kanban to show youâre a good fit for their workflow.
