At a Glance
- Tasks: Lead and design data solutions to maximise value from data in a top Energy Trading company.
- Company: Join a world-leading Energy Trading firm with a focus on innovation.
- Benefits: Competitive salary, mentorship opportunities, and a chance to work with cutting-edge technology.
- Other info: Dynamic role with opportunities for career growth and community-building initiatives.
- Why this job: Make a real impact by building AI-coded automated data pipelines and mentoring junior engineers.
- Qualifications: Expertise in Databricks, PySpark, Python, SQL, and strong communication skills.
The predicted salary is between 70000 - 90000 £ per year.
We are looking for a Data Engineer Tech Lead to join a world-leading Energy Trading company to lead, design and build data foundations and end-to-end solutions for the Business to maximize value from data.
The candidate is expected to be a subject matter expert who designs and builds data solutions as well as AI-coded automated data pipelines while also mentoring junior engineers.
They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.
Strong hands-on expertise in Databricks, Py Spark, Python and SQL is central to this role.
- Key Skills
- Azure Stack
- ELT Experience
- Data Modeling
- Data Integration & Ingestion
- Data Manipulation and Processing
- Git Hub, Git Hub Actions, Azure Dev Ops
- Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, Sonar Qube, Py Test
- AI based Code developed and AI-built automated data pieplines
- Key Characteristics
- Technology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.
- Deep data focus with expertise across relevant technology domains.
- A skilled communicator capable of engaging both technical developers and business managers; respected and trusted by leaders and staff.
- Actively delivers the roll-out and embedding of Data Foundation initiatives in support of key business programs.
- Coordinates the change management, incident management, and problem management processes.
- Presents reports and findings to key stakeholders and acts as the subject matter expert on Data Analysis & Design.
- Drives implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed of delivery, and maximize value.
- Contributes to community-building initiatives such as Centers of Excellence (Co E) and Communities of Practice (Co P).
- #J-18808-Ljbffr
Data Engineer : Tech Lead – Databricks employer: Eaglecliff
Eaglecliff is an exceptional employer that fosters a collaborative and innovative work culture in the heart of Greater London. With a strong focus on employee growth, you will have access to continuous learning opportunities and mentorship as you lead Agile practices within a prestigious Energy Trading & Commodities company. Join us to be part of a dynamic team where your contributions are valued and impactful.
