Data Engineer (Demographic & Geospatial Data)
Location: Remote working
Type: Contract or Permanent
Day Rate: Up to £550 per day Inside IR35
Salary: Up to £90,000 package
Security Clearance: SC Eligible (Mandatory) / Active SC Preferred
Start Date: Immediate or up to 2 weeks' notice
The Opportunity
We are supporting a major programme seeking an experienced Data Engineer with strong Databricks and Geospatial Data expertise. You will play a key role in designing and delivering scalable data pipelines that combine demographic datasets with geographic reference data to support population analysis, reporting, service planning, and operational decision-making.
This is an excellent opportunity for a Data Engineer who enjoys working with large-scale data platforms, geospatial processing, and modern cloud-based technologies in a highly collaborative environment.
Key Responsibilities
Design, build and support data pipelines using Databricks, Python, PySpark and SQL
Develop reusable ingestion, transformation, validation and enrichment processes
Ingest demographic datasets, postcode data, geographic boundaries and reference datasets
Build and maintain Delta Lake datasets and manage data lineage
Perform postcode enrichment and geographic assignment processing
Implement spatial joins, point-in-polygon matching and location-based calculations
Manage geographic reference data versions and historical reproducibility
Develop automated data quality controls and reconciliation processes
Optimise Spark workloads and pipeline performance
Support production releases, monitoring and troubleshooting activities
Work closely with analysts, data owners and platform teams to define business rules and acceptance criteria
Essential Skills & Experience
Strong commercial experience with:
Databricks
Python
PySpark
SQL
Proven experience building and supporting production-grade data pipelines
Strong knowledge of Delta Lake, schema management, merge logic and...
Data Engineer employer: LMA Recruitment Careers
As an Infrastructure Engineer at our company, you will thrive in a dynamic and supportive work environment that values innovation and professional growth. We offer competitive benefits, including ongoing training opportunities and a collaborative culture that encourages knowledge sharing among team members. Located in a vibrant area, our company not only focuses on delivering cutting-edge solutions but also prioritises employee well-being and work-life balance, making it an excellent place for those seeking meaningful and rewarding employment.
