At a Glance
- Tasks: Design and optimise scalable data platforms for advanced analytics.
- Company: Dynamic tech company focused on data-driven solutions.
- Benefits: Hybrid work, competitive salary, and opportunities for professional growth.
- Other info: Collaborate with top professionals and work with cutting-edge technologies.
- Why this job: Make a real impact in a fast-paced, innovative data environment.
- Qualifications: 3+ years in data engineering, strong Python and Rust skills.
The predicted salary is between 63000 - 77000 £ per year.
Data Engineer London | Hybrid | Full-time Are you a skilled Data Engineer eager to work with high-volume datasets and cutting-edge technologies?
We're looking for a data-driven professional to develop and optimise a scalable data platform that supports advanced analytics and quantitative research.
Please ensure you read the below overview and requirements for this employment opportunity completely.
You'll play a key role in designing robust data pipelines, integrating real-time feeds, and ensuring the seamless flow of structured and unstructured data.
In this role, you'll be responsible for building and maintaining high-performance data pipelines that process complex and large-scale datasets.
You'll work closely with analysts and researchers to understand their data requirements, optimising real-time data ingestion by integrating external APIs and alternative data sources.
You will focus on enhancing the data architecture to improve accessibility, efficiency, and security while automating ETL workflows to streamline data modelling and analysis.
You'll also support event-driven systems by implementing technologies like Kafka and Protobuf, ensuring seamless data streaming and processing.
A key aspect of your role will be implementing rigorous quality assurance measures, ensuring data integrity and consistency across all inputs and outputs.
Additionally, you'll collaborate with teams to support machine learning applications, facilitating data preparation for model training and deployment.
What You'll Need3+ years of experience in a data engineering Strong proficiency in Python and Rust Hands-on experience with AWS cloud, Linux, and Docker.
Expertise in distributed computing frameworks (Ray, Dask, or Apache Arrow).
Strong analytical skills, with the ability to handle large-scale, high-frequency data.
Solid understanding of ETL pipelines, data modelling, and database optimisation.
Experience working with real-time streaming technologies This is a fantastic opportunity to be part of a fast-moving, data-driven environment where your technical expertise will have a real impact. xwwtmva You'll work with cutting-edge tools, collaborate with top-tier professionals, and contribute to the efficiency and innovation of a growing data team.
If you're ready to take your data engineering career to the next level, we'd love to hear from you!
Data Engineer employer: Consortia
As a fast-growing, FCA-regulated EMI based in London, we offer an exceptional opportunity for the Head of Payments to lead a critical transformation in our payments operations. Our work culture prioritises collaboration and support, providing significant autonomy to shape the future of payments while benefiting from a hybrid working model that promotes work-life balance. With a focus on employee growth and a commitment to modernising payment technologies, we are dedicated to creating a high-performing team that thrives in a dynamic environment.
