Data Engineer – Spark / PySpark Technify Talent is recruiting an experienced Data Engineer to build data platforms that support research engineers and other technical specialists within a fast-paced startup. We’re looking for someone fluent in Spark and PySpark who understands how to build reliable, usable data platforms for people tackling complex research and analytical problems. You’ll bring strong engineering foundations alongside regular use of AI coding agents. What you’ll be doing * Building and developing data platforms and pipelines using Spark and PySpark. * Working closely with research engineers and specialist users to understand their data needs. * Making data accessible and dependable for research and analytical work. * Using AI coding agents to support development, while taking ownership of code quality and technical decisions. * Adapting the platform as requirements and priorities evolve. What we’re looking for * Strong commercial data engineering experience and fluency in Spark/PySpark. * Experience building data platforms for research engineers, quants or similarly specialist users. * Solid engineering foundations developed before AI coding tools became commonplace. * Frequent, practical use of coding agents, with no preference for a particular tool or provider. * The ability to work independently and translate complex requirements into practical solutions. Useful extras * Familiarity with the AWS data stack. * Experience working in a fast-moving startup with changing priorities. For further details please contact Katie Collins
Data Engineer in London employer: Technify Talent Limited
At Technify Talent Limited, we pride ourselves on being an exceptional employer in the Defence Technology sector, offering a dynamic work culture that fosters innovation and collaboration. Our commitment to employee growth is evident through comprehensive training programmes and opportunities for advancement, all while working in a role that directly impacts critical infrastructure and national security. With regular UK travel and the chance to engage with cutting-edge technology, our team enjoys a rewarding and meaningful career path.
