Seeking an experienced Azure Databricks Solution Architect to design, develop, architect, and deliver scalable cloud-native data platforms on Azure. The role requires strong expertise in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities.
Key Responsibilities
- Design and develop scalable data pipelines using Databricks for ETL processing across diverse data sources
- Build and optimize large-scale data workflows using PySpark and Python
- Ensure performance tuning, debugging, and optimization of data pipelines
- Collaborate with cross-functional teams to enable data integration and analytics solutions
- Support implementation of data lake architectures leveraging Delta Lake and cloud platforms
- Knowledge of CI/CD practices and Agile delivery models
- Strong analytical and problem-solving capabilities
Experience Requirements
- Relevant experience in data engineering with strong exposure to Databricks and PySpark
- Proven ability to handle large-scale structured and unstructured data pipelines
- Experience working in cloud environments, preferably Azure
- Exposure to performance optimization and scalable data processing architectures
- Stakeholder Management
- Technical Leadership
- Agile Delivery
- Problem Solving & Innovation
Certification (Good to Have)
- Databricks Developer / Data Engineering certifications
Azure Databricks Solution Architect employer: Test Triangle Limited
Test Triangle Limited is an exceptional employer, offering a dynamic work environment that fosters innovation and collaboration in the heart of the United Kingdom. With a strong focus on employee growth, we provide comprehensive training and development opportunities, ensuring our team members are equipped to excel in their roles. Our commitment to regulatory excellence and risk management not only enhances professional skills but also contributes to meaningful outcomes in the financial sector.