Job Description
Seeking an experienced Azure Databricks Solution Architect to design, develop, architect, and deliver scalable cloud-native data platforms on Azure. The role requires strong expertise in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities.
Key Responsibilities
- Design and develop scalable data pipelines using Databricks for ETL processing across diverse data sources
- Build and optimize large-scale data workflows using PySpark and Python
- Ensure performance tuning, debugging, and optimization of data pipelines
- Collaborate with cross-functional teams to enable data integration and analytics solutions
- Support implementation of data lake architectures leveraging Delta Lake and cloud platforms
- Knowledge of CI/CD practices and Agile delivery models
- Strong analytical and problem-solving capabilities
Experience Requirements
- Relevant experience in data engineering with strong exposure to Databricks and PySpark
- Proven ability to handle large-scale structured and unstructured data pipelines
- Experience working in cloud environments, preferably Azure
- Exposure to performance optimization and scalable data processing architectures
Key Competencies
- Solution Architecture
- Databricks β Data Engineering
- Azure Data Factory
- Stakeholder Management
- Technical Leadership
- Agile Delivery
- Problem Solving & Innovation
Certification (Good to Have)
- Databricks Developer / Data Engineering certifications
- Azure Data Engineering certifications
Azure Databricks Solution Architect in Milton Keynes employer: Test Triangle
As a Project Lead L1 at our esteemed global investment banking client, you will thrive in a dynamic work culture that prioritises innovation and collaboration. We offer competitive benefits, including professional development opportunities and a supportive environment that encourages growth and advancement within the financial sector. Join us in a location that fosters both personal and professional fulfilment, where your contributions directly impact large-scale technology transformations.