About the role
We are looking for a hands-on Data Engineer to run and maintain production data pipelines on Databricks and AWS. You will keep scheduled processing reliable, resolve incidents, deliver permanent fixes and improve the performance of existing data services.
The role combines L2 and L3 production support with data engineering. You will work with service management, platform teams, data owners and downstream users to keep data accurate and available within agreed service levels and delivery deadlines.
Key responsibilities
- Monitor scheduled jobs, ingestion processes and downstream loads. Identify failures, delays and unusual data volumes, assess the business impact and prioritise action against delivery deadlines.
- Own incidents from investigation through recovery and closure. Diagnose issues in Python, PySpark, SQL, Databricks jobs and AWS integrations, and provide clear progress updates and timely escalation.
- Recover failed or incomplete processing through controlled retries, reruns and backfills. Check dependencies and reconcile outputs to prevent duplicate records, missing data or inconsistent downstream results.
- Investigate data quality issues, schema changes and late or missing source files. Trace problems through pipeline stages and agree corrective action with source owners and data consumers.
- Maintain and improve existing Python, PySpark and SQL code....
Data Engineer in Leeds employer: Qualient Technology Solutions UK Limited
Qualient Technology Solutions UK Limited is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the field of banking cryptography. With a strong focus on employee growth, you will have access to ongoing training and development opportunities while working in a hybrid model that promotes work-life balance in the vibrant city of Milton Keynes. Join us to be part of a forward-thinking team dedicated to driving IT security improvements and shaping the future of cryptographic solutions.
Contact Details:
Qualient Technology Solutions UK Limited Recruitment Team
