Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Lead the migration to AWS RDS and mentor a dynamic data team.
- Company: AND Digital, a forward-thinking tech company closing the digital skills gap.
- Benefits: Flexible working, training budget, and fun team socials await you!
- Why this job: Make a real impact while developing your skills in a supportive environment.
- Qualifications: 7-10 years in data engineering with strong AWS and Python expertise.
- Other info: Join a diverse team that values collaboration, curiosity, and innovation.
The predicted salary is between 60000 - 84000 ÂŁ per year.
Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. Weâve been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always leave a legacy for the client. We do this through close relationships with our offices (or âClubsâ) so that our partners are always prioritised by a regional team close to them. This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Join us - and help us fulfil our mission to close the worldâs digital skills gap.
We are seeking a Lead Data Engineer to act as the technical practice lead for the Luna data team. This is an important role responsible for leading a high business priority migration from ANDâs existing Redshift environment to our new AWS RDS (Postgres) architecture. Beyond technical architecture, you will be a mentor and skills builder for the team. You will guide the technical growth of our Data Analysts, transitioning them from SQL-centric workflows to production-ready Python and DataOps practices, while collaborating closely with stakeholders to translate business needs into scalable technical roadmaps.
What youâll bring to the table:
- Technical Leadership & Architecture: Lead new Data Pipeline Delivery: Implement the new Python-based ETL pipelines for data movement from Lunaâs microservice DynamoDB tables to RDS transactional DB (Postgres OLTP) and subsequently to the RDS data warehouse (Postgres OLAP).
- Platform Optimization: Leverage expertise from previous data setups to optimize the new Postgres OLTP for transactional performance and the OLAP environment for analytics effectiveness, with both being conscious of on-going cost management.
- Standard Setting: Establish and enforce DataOps standards, including version control (Git), automated CI / CD deployment, and schema migration management using tools like Liquibase or Drizzle ORM.
Team Enablement & Mentorship:
- Hands-on Coaching: Actively mentor team members, elevating their skills in Python, Git, and engineering workflows through code reviews and workshops.
- Code Quality: Conduct rigorous code reviews, providing detailed, educational feedback that explains best practices and clearly outlines required changes to elevate team standards.
- AI Engineering patterns: Support the definition and implementation of AI tooling and practices to augment the Data engineering team.
Strategic Agile Delivery:
- Initiative Planning: Break down larger reporting initiatives into manageable epics and stories within our Agile framework (a mix of Scrum for larger work items, and Kanban for smaller continuous flow items).
- Stakeholder Management: Network with business domains to capture requirements and provide strategic guidance on the data platform migration plan.
- Product Partnership: Support the Data Product Owner by providing the technical context necessary to prioritize the team's backlog effectively.
Required Experience & Technical Skills:
- Data Engineering - 7 to 10 years experience building and supporting full-stack data pipelines from source to reporting.
- AWS Mastery - 5+ years deep experience with AWS, ideally administration and optimization of RDS / Aurora (Postgres) and Redshift.
- Python - 5+ years expert-level Python, with specific experience working on ETL pipelines, including libraries like Pandas and orchestration tools like Airflow or Prefect.
- PostgreSQL - 5+ years expert-level SQL and database architecture (partitioning, indexing) for both OLTP and OLAP.
- DataOps / Tools - 3+ years expertise in Git, with solid understanding of Git branching and workflow, and schema management (e.g., Liquibase, Flyway, or Drizzle).
Why join AND Digital?
- Opportunities to work on projects with big clients and the chance to produce meaningful work that makes a difference to peopleâs lives.
- A âBlended Workingâ model, meaning you will be able to work in a range of locations from; your home, in your clubhouse, on a client, as well as just a change of scenery.
- A dedicated career scrum team, designed to help you reach your career goals and develop the skills you need to be your best self.
- An annual budget for training and upskilling, including allocated days off so you donât have to study in your own free time.
- Monthly and quarterly team socials - on us - ranging from after work drinks, to driving experience days with your fellow club members.
- A safe environment for you to be yourself and challenge yourself.
Benefits:
- 25 days holiday allowance + bank holidays
- Share scheme
- A ÂŁ1000 flexifund to use on a personalised list of benefits such as Gym membership, Cycle to Work Scheme, Health, dental and optical cash plan
- 6% pension PLUS many more
For a full list of benefits - Equal Opportunities Statement At AND Digital we embrace diversity and are committed to equal opportunities. We are actively recruiting for a diverse and inclusive workforce so want to ensure we do everything we can to support your application. We want you to feel safe and empowered to let us know if you require any adjustments to be made to your application or interview process so please speak to our recruitment team.
Lead Data Engineer employer: AND Digital Limited
Contact Detail:
AND Digital Limited Recruiting Team
StudySmarter Expert Advice đ¤Ť
We think this is how you could land Lead Data Engineer
â¨Tip Number 1
Network like a pro! Reach out to current employees at AND Digital on LinkedIn or other platforms. Ask them about their experiences and any tips they might have for your interview process. Itâs all about making connections!
â¨Tip Number 2
Prepare for the technical side! Brush up on your Python and AWS skills, especially around ETL pipelines and DataOps practices. You want to show that you can lead the charge in migrating data environments smoothly.
â¨Tip Number 3
Show off your mentoring skills! Be ready to discuss how you've helped others grow in their roles. AND Digital values team enablement, so share examples of how you've elevated your team's skills in the past.
â¨Tip Number 4
Donât forget to apply through our website! Itâs the best way to ensure your application gets seen by the right people. Plus, it shows youâre genuinely interested in joining the AND Digital family.
We think you need these skills to ace Lead Data Engineer
Some tips for your application đŤĄ
Show Your Passion: When you're writing your application, let your enthusiasm for data engineering shine through! We want to see how excited you are about the role and how your skills can help us close the digital skills gap.
Tailor Your Experience: Make sure to highlight your relevant experience in data pipelines and AWS. We love seeing how your background aligns with our needs, so donât be shy about showcasing your achievements in Python and DataOps!
Be Clear and Concise: Keep your application straightforward and to the point. We appreciate clarity, so use simple language to explain your technical skills and experiences. Remember, weâre looking for someone who can communicate effectively with both techies and non-techies!
Apply Through Our Website: Donât forget to submit your application through our website! Itâs the best way for us to keep track of your application and ensure it gets the attention it deserves. Plus, it shows youâre keen on joining our team!
How to prepare for a job interview at AND Digital Limited
â¨Know Your Tech Inside Out
As a Lead Data Engineer, you'll need to showcase your expertise in AWS, Python, and PostgreSQL. Brush up on your knowledge of ETL pipelines and be ready to discuss specific projects where you've implemented these technologies. Prepare to explain your thought process behind architectural decisions and how you optimised data performance.
â¨Showcase Your Mentorship Skills
AND Digital values team enablement and mentorship. Be prepared to share examples of how you've coached others in Python, Git, or DataOps practices. Highlight any workshops or code reviews you've conducted, and explain how you helped elevate your team's skills and standards.
â¨Understand the Business Needs
It's crucial to translate technical jargon into business value. Familiarise yourself with AND Digital's mission to close the digital skills gap. Think about how your role as a Lead Data Engineer can directly impact their clients and contribute to their success. Be ready to discuss how you would approach stakeholder management and capture requirements effectively.
â¨Be Agile and Adaptable
Since the role involves working within an Agile framework, demonstrate your understanding of both Scrum and Kanban methodologies. Prepare to discuss how you've broken down larger projects into manageable tasks and how you prioritise work in a fast-paced environment. Show that you're flexible and can adapt to changing priorities while keeping the team aligned.