At a Glance
- Tasks: Design and maintain scalable data pipelines for real-time streaming solutions.
- Company: Join a leading energy sector company with a flexible work culture.
- Benefits: Competitive salary, hybrid work model, and opportunities for professional growth.
- Other info: Collaborative environment with excellent career advancement opportunities.
- Why this job: Be part of a dynamic team making an impact in the energy sector with cutting-edge technology.
- Qualifications: Strong SQL and Python skills, experience with Apache technologies, and cloud platforms.
The predicted salary is between 85000 - 85000 £ per year.
Data Engineer - Real Time Streaming Experience Permanent £85,000 PP Hybrid 3 Days a week West London
Norton Blake are supporting a long standing client of ours, who work in the Energy Sector.
This role is a key hire for the business, and would be joining a strong team of individual contributors who work in a highly flexible environment.
Experience & Technical Skills
- Strong SQL skills with the ability to write and optimise complex queries.
- Commercial experience developing data solutions using Python.
- Experience designing, building and maintaining scalable data pipelines.
- Strong experience with
Apache-based streaming and distributed data processing technologies , including tools such as
Apache Kafka ,
Apache Spark (Structured Streaming) or similar real-time data processing frameworks.
- Experience building both batch and real-time data processing solutions.
- Good understanding of data warehousing concepts, dimensional modelling and data governance.
- Experience working with relational databases such as Postgre SQL, My SQL or similar.
- Exposure to cloud-based data platforms and infrastructure-as-code practices.
- Experience using Git, CI/CD pipelines and containerisation technologies such as Docker or Kubernetes.
- Strong troubleshooting and performance optimisation skills across data platforms.
- Excellent communication skills with the ability to work collaboratively across engineering and business teams.
Desirable Experience
- Experience working with event-driven architectures and streaming data platforms.
- Exposure to technologies such as Apache Airflow, Dagster or other workflow orchestration tools.
- Experience with analytical databases such as Click House or similar.
- Familiarity with business intelligence platforms and data visualisation tools.
- Experience working within large-scale, data-intensive or regulated environments.
- Knowledge of Graph QL, metadata management or data catalogue solutions.
- #J-18808-Ljbffr
Data Engineer - Streaming employer: Norton Blake
Join a leading enterprise organisation in West London that values innovation and collaboration, offering a dynamic work culture where your expertise as a Power Platform Architect will directly influence the future of digital transformation. With a strong focus on employee growth, you will have access to continuous learning opportunities and the chance to work alongside senior stakeholders in a hybrid environment, ensuring a balanced work-life experience. This role not only allows you to shape best practices but also positions you at the forefront of cutting-edge Microsoft solutions, making it an exciting and rewarding place to advance your career.
