Azure Databricks Technical Lead in London

Azure Databricks Technical Lead in London

London Full-Time On-site
Sogeti

Internal Role Information Grade – C1 Location -Anywhere in the UK
About the job you're considering We work closely with clients and partners to take full advantage of the opportunities of technology. We mobilize expert teams that create custom solutions from existing and emerging technology to deliver viable outcomes at speed. We call this 'Value in the making.' Part of the Capgemini Group, Sogeti makes business value through technology for organizations that need to implement innovation at speed and want a local partner with global scale. With a hands‑on culture and close proximity to its clients, Sogeti is currently looking for a Azure Databricks Engineer to join our ACT Practice, ensuring alignment with business goals and driving impactful value creation for our clients. Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time. If you are successfully offered this position, you will go through a series of pre‑employment checks, including identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)
Mandatory Skills Azure Databricks Platform Engineering Hands‑on implementation and troubleshooting of Azure Databricks
Databricks Serverless configuration and workload optimisation
Databricks SQL and Delta Lake development
Cluster management, compute policies, autoscaling, and workload monitoring
Data Engineering Strong Python, PySpark, and SQL development skills
Design and build ingestion and transformation pipelines
Full and incremental data loading
CDC (Change Data Capture) implementation
Data quality controls, schema evolution, reconciliation, and error handling
Integration Development REST API integration experience
Integration with databases, SaaS applications, cloud storage, and enterprise systems
Secure authentication and credential management
Azure Platform Services Azure Identity and Access Management
Azure Networking and Private Endpoints
Azure Security and Key Vault
Azure Monitoring and Operational Support
FinOps & Cost Optimisation Resource tagging implementation
Cost monitoring and reporting
Budget controls and usage optimisation
Essential Skills Platform Operations Experience supporting production Azure Databricks environments
Monitoring, incident management, troubleshooting, and performance tuning
Operational governance and platform standards implementation
Discovery Zone & Migration Support Experience enabling application deployment within Databricks
BI tooling integration and scheduling
Support for POSIT/RStudio migration activities
Collaboration Working with Data Engineers, Data Scientists, and Platform Teams
Technical documentation and knowledge

Azure Databricks Technical Lead in London employer: Sogeti

Capgemini is an exceptional employer that fosters a dynamic and inclusive work culture, empowering employees to thrive in their careers. With a strong focus on professional development and collaboration, particularly in the innovative field of Google Cloud solutions, team members enjoy unique opportunities for growth and engagement with industry leaders. Located in the vibrant UK market, Capgemini offers a stimulating environment where creativity and strategic thinking are highly valued, making it an ideal place for those seeking meaningful and rewarding employment.

Sogeti

Contact Details:

Sogeti Recruitment Team