At a Glance
- Tasks: Design and optimise scalable data pipelines using Databricks and PySpark.
- Company: Join a leading tech firm focused on secure, large-scale data projects.
- Benefits: Competitive daily rate, remote work flexibility, and opportunities for professional growth.
- Other info: Opportunity to mentor others and influence technical standards in a dynamic environment.
- Why this job: Make an impact in data engineering while working with cutting-edge technologies.
- Qualifications: Strong experience with Databricks, PySpark, and cloud data platforms required.
The predicted salary is between 63000 - 77000 £ per year.
We are looking for an experienced Senior Data Engineer to work on complex, large-scale data projects within secure and highly regulated environments. This is an excellent opportunity for a Data Engineer with strong Databricks, PySpark and modern Lakehouse experience who wants to remain hands-on while taking greater ownership of technical delivery.
You'll work across modern cloud data platforms, designing and delivering scalable data pipelines that transform complex datasets into trusted, reusable data products. Alongside engineering delivery, you'll have the opportunity to influence technical standards, contribute to architectural decisions and mentor other engineers.
As a Senior Data Engineer, you'll take ownership of the design, development and optimisation of production-grade data solutions using Databricks, Apache Spark and Delta Lake. Your responsibilities will include:
- Designing, building and optimising scalable ETL/ELT data pipelines using Databricks, PySpark and Spark SQL
- Implementing Medallion Architecture patterns across data layers
- Developing robust data quality, monitoring and alerting processes
- Building and maintaining modern Lakehouse solutions
- Integrating Databricks with cloud services, data lakes, event streams and data warehouses
- Applying Unity Catalogue and wider data governance, security and quality controls
- Establishing engineering standards and patterns across ingestion, transformation, orchestration and monitoring
- Optimising Databricks workloads for performance, reliability and cost
- Supporting CI/CD and DevOps practices across data engineering workflows
- Leading technical delivery across data engineering workstreams
We're looking for an experienced Data Engineer who combines strong hands-on engineering skills with the ability to take technical ownership of complex data solutions. You'll ideally have:
- Strong commercial experience with Databricks
- Excellent PySpark, Apache Spark and Spark SQL skills
- Experience building production-grade ETL/ELT pipelines
- Strong knowledge of Delta Lake and Lakehouse architecture
- Experience implementing Medallion/Bronze-Silver-Gold architectures
- Strong experience with Azure and/or AWS data platforms
- Knowledge of Unity Catalogue, data governance, data quality and security
- Experience integrating Databricks with wider cloud and enterprise data services
- An understanding of CI/CD and DevOps practices for data workflows
- Experience with streaming or real-time data processing would be advantageous, as would previous experience working within Defence, Central Government, Security, Intelligence or another complex regulated environment.
You don't necessarily need to hold current security clearance, but you must be eligible to obtain SC Clearance.
If you would like to learn more, please apply through the advert and we will be in touch to discuss in more detail.
Data Engineer employer: JLA Resourcing Ltd
Join a dynamic and rapidly growing company in central Basingstoke as a Desktop Support Technician, where you will enjoy a hybrid work model that promotes work-life balance. With a strong focus on employee development, you'll have the chance to upskill and advance your career within a supportive team environment that values high-quality service and first-time fixes. The company fosters a collaborative culture, engaging with staff at all levels, and offers competitive compensation along with opportunities to work on exciting projects.
