At a Glance
- Tasks: Design and optimise scalable AWS data pipelines using Python, SQL, and Spark.
- Company: Join a collaborative tech company at the forefront of AI-driven consumer intelligence.
- Benefits: Competitive salary, flexible working, and opportunities for professional growth.
- Other info: Dynamic team environment with excellent career development opportunities.
- Why this job: Make a real impact with cutting-edge data and AI technology from day one.
- Qualifications: Experience in data engineering with Python, SQL, and AWS services.
The predicted salary is between 60000 - 75000 £ per year.
Build the data platform powering a new generation of AI-driven consumer intelligence. You’ll work at the intersection of AWS, large-scale behavioural data and agentic AI, creating scalable pipelines and data products that turn ethically sourced, consented consumer data into meaningful insights.
Joining a collaborative, scaling technology company, you’ll have the freedom to experiment with cutting-edge tools, broaden your experience and make a visible impact on the platform from day one. The team uses Claude extensively to support development, debugging, testing and documentation. You’ll combine AI-assisted development with strong Python, SQL and Spark fundamentals to produce reliable, well-tested solutions.
What you’ll be doing:
- Designing, building and optimising scalable AWS data pipelines and ETL/ELT processes
- Developing data solutions using Python, SQL and Spark
- Processing large and complex behavioural datasets
- Improving data quality, reliability, performance and monitoring
- Using Claude and other AI-assisted development tools to support delivery
- Collaborating with engineers, analysts and data scientists
- Identifying opportunities to automate and improve data workflows
- Contributing ideas as the platform and its data products continue to evolve
What we’re looking for:
- Hands-on data engineering experience using Python and SQL
- Practical Spark or PySpark experience
- Experience building production data pipelines using AWS data services
- A good understanding of scalable ETL/ELT design and data quality
- Experience using Claude or another AI-assisted development tool, with the ability to review and validate generated code
- Strong communication skills and an interest in working within a small, collaborative team
This is an opportunity to work with cutting-edge data and AI technology, take ownership beyond one narrow area and help shape a platform as the business grows. Applicants must already have the right to work in the UK, as sponsorship is not available for this position.
Data Engineer - London in City of London employer: Datatech Analytics
Datatech Analytics is an exceptional employer, offering a dynamic work culture that prioritises innovation and collaboration within the secure government and defence sectors. Employees benefit from meaningful projects that have a direct impact on national security, alongside opportunities for professional growth and development in cutting-edge technologies. With a hybrid working model and a focus on employee well-being, this role provides a unique chance to contribute to critical transformation programmes while enjoying a supportive and engaging workplace.
