At a Glance
- Tasks: Design and optimise Azure Databricks solutions for enterprise data platforms.
- Company: Global recruitment specialist with a focus on innovative tech solutions.
- Benefits: Competitive pay rate of £540 per day, flexible work environment.
- Other info: Opportunity for career growth and collaboration with diverse teams.
- Why this job: Join a dynamic team and make a real impact in data engineering.
- Qualifications: Experience in Azure Databricks, Python, and data engineering required.
The predicted salary is between 51750 - 63250 £ per year.
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.
- Role Title: Platform Architect
- Pay Rate: £540 per day all inc. (PAYE through Umbrella)
- Duration: Until 1/2/2027
- Role Purpose
- We are seeking a highly experienced, hands-on Azure Databricks Platform Engineer / Architect to enhance and optimise an enterprise Data Platform.
- This role combines architecture, engineering, operational support and platform optimisation.
- The successful candidate must be capable of designing, configuring, developing, troubleshooting and improving Azure Databricks solutions, rather than operating solely at a strategic or governance level.
• The role focuses on three primary outcomes
- Enabling and optimising Databricks Serverless capabilities.
- Strengthening Fin Ops practices, cost controls and platform governance.
- Enhancing the Databricks Discovery Zone to support migration and consolidation of workloads currently delivered through POSIT/RStudio.
Key Responsibilities
- Databricks Serverless Enablement and Optimisation
- Assess existing workloads and determine the most appropriate compute model, including Serverless, Jobs Compute, Interactive Compute or Classic Clusters, based on workload characteristics, SLA requirements, performance, utilisation and cost.
- Configure and implement Serverless capabilities for notebooks, jobs, SQL workloads, analytical processing and data pipelines.
- Develop workload placement standards and guidance, identifying scenarios where Serverless may not be the most cost-effective solution for predictable, long-running or continuously utilised workloads.
- Implement compute policies, autoscaling configurations, quotas, budget controls and operational guardrails.
- Monitor performance and cost, identifying oversized, underutilised or idle resources and recommending optimisation opportunities.
Fin Ops and Enterprise Platform Controls
- Define and implement a practical Fin Ops operating model covering ownership, accountability, environments, projects, applications, cost centres and teams.
- Establish mandatory tagging standards and integrate automated validation into CI/CD pipelines to prevent deployment of non-compliant resources.
- Deliver granular cost attribution and reporting across workspaces, projects, applications, workloads and business teams.
- Configure budgets, spend thresholds, alerts and usage monitoring to proactively manage platform costs.
- Analyse platform usage and billing data to identify cost anomalies, inefficient workloads, excessive storage consumption, unnecessary data movement and underutilised resources.
- Support continuous improvement through cost optimisation recommendations and governance controls.
Discovery Zone Enhancement and POSIT/RStudio Migration
- Enhance the Databricks Discovery Zone to support the migration and modernisation of analytics and data science workloads currently running on POSIT/RStudio.
• Enable capabilities including
- Secure API and external system integrations
- Application deployment and operationalisation
- External data ingestion
- BI and reporting connectivity
- Scheduling and orchestration
- Local IDE-based development
- LLM and AI integration
- Operational monitoring and reporting
- Define reusable onboarding, migration and delivery patterns that reduce technology sprawl while improving platform security, supportability and delivery speed.
- Collaborate with stakeholders to support migration planning, solution design and adoption.
Data Engineering and Integration
- Design, build and optimise scalable data ingestion and transformation solutions using Python, Py Spark, SQL and Delta Lake.
- Implement batch and incremental processing patterns, including Change Data Capture (CDC), schema evolution, reconciliation processes, data quality controls and error handling.
Develop reusable integration frameworks for
- REST APIs
- Saa S platforms
- Databases
- Files and object storage
- Document repositories
- Enterprise systems
- External and public data sources
- Implement secure authentication, secrets management and credential handling practices.
- Deliver end-to-end data flows from source ingestion through governed and curated data layers, supporting analytics, BI, machine learning and application consumption.
Required Technical Skills
Azure & Databricks Platform
- Deep hands-on Azure Databricks implementation, administration and troubleshooting experience.
- Databricks Serverless architecture, workload placement and compute optimisation.
- Azure networking, identity, security, monitoring, secrets management and private connectivity.
- Databricks SQL, Delta Lake and query/workload performance optimisation.
- Strong understanding of platform governance, operational support and best practices.
Engineering, Delivery & Operations
- Python, Py Spark and SQL development expertise.
- Data engineering and pipeline delivery within enterprise-scale environments.
- Jobs, workflows, orchestration, incremental processing and CDC implementation.
- Data quality, reconciliation and operational monitoring.
- REST API integration and external data connectivity patterns.
- Fin Ops implementation, tagging strategies, cost attribution, monitoring and budget management.
- Experience supporting production platforms and driving continual optimisation.
Experience and Candidate Profile
- Proven experience delivering and supporting enterprise-scale Azure Databricks platforms in production environments.
- Demonstrated ability to work across architecture, engineering, implementation, optimisation and operational support without dependence on specialist teams.
- Strong understanding of security, governance, compliance and controlled delivery within complex or regulated organisations.
- Experience collaborating with data engineers, data scientists, architects, security teams, platform teams and business stakeholders.
- Excellent communication skills with the ability to document standards, patterns, operational procedures and architectural decisions.
- Highly Desirable
- Experience migrating workloads from POSIT/RStudio to Databricks.
- Migration of analytical and data science solutions, including conversion of R-based workloads and libraries.
- AI/ML experience, including LLM integration, RAG/vector retrieval, model serving and model lifecycle management.
- Experience delivering large-scale platform transformation programmes.
- Strong Azure and Databricks Fin Ops experience, including cost optimisation, governance and chargeback/showback models.
- Experience operating within highly regulated or complex enterprise environments.
If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible.
Please note, candidates are often Shortlisted within 48 hours.
Platform Architect in City of London employer: eTeam
As a Global Recruitment specialist, we pride ourselves on fostering a collaborative and innovative work culture in Manchester, where our Service Designers can thrive. With a focus on employee growth, we offer opportunities for professional development and the chance to work on impactful projects across diverse regions. Our commitment to work-life balance, with a flexible onsite schedule, ensures that our team members can excel both personally and professionally.
StudySmarter Expert Advice🤫
We think this is how you could land Platform Architect in City of London
✨Get Involved in Open-Source Projects
Diving into open-source projects is a brilliant way to showcase your skills and connect with other developers in the community. Not only will you beef up your GitHub profile but you might also catch the eye of someone at eTeam who values hands-on experience over just theory.
✨Attend Local Tech Meetups
Tech meetups are gold mines for networking and discovering job opportunities, especially in the fast-paced world of software engineering. Check out local listings for events in your area and don’t shy away from introducing yourself. This could lead directly to a temporary position at eTeam!
✨Showcase Your Work Online
With temporary roles, it’s all about standing out in a short space of time. Create a portfolio website where you highlight your projects and skills. Talk about your code, and provide links to your GitHub repositories. This will not only demonstrate your abilities but will also make it easier for recruiters at eTeam to see what you bring to the table.
✨Leverage Temporary Job Boards
Don’t forget to check specialised job boards for temporary software development roles. Websites like We Work Remotely or Remote OK often list short-term gigs that can be a perfect fit. Apply directly through our website as well, making sure your application is sharp—temporary roles can move fast!
We think you need these skills to ace Platform Architect in City of London
Some tips for your application 🫡
Show Off Your Tech Skills:Make sure your CV highlights your tech stack and any programming languages you’re proficient in. Include specifics about any frameworks or technologies you’ve worked with; they can make you stand out in the sea of applicants. It’s all about showing that you have the chops we need at eTeam!
Portfolio 2.0:Since you’re applying for a temporary gig, it’s super important to showcase a portfolio that highlights your best projects. Include links to GitHub or any personal projects that demonstrate what you can do in a real-world environment. This gives us a taste of your style and your problem-solving approach!
Keep It Brief and Relevant:With a temporary position, we want to see your ability to hit the ground running. Be concise in your CV and cover letter; stick to experiences that directly relate to the role. Highlight any previous temporary roles or freelance gigs that show your adaptability and quick learning!
Tailor Your Cover Letter:Don’t just send a generic cover letter. Personalise it for Platform Architect at eTeam! Mention why this temporary role excites you and how you see yourself contributing in the short run. Show us what you've got and why you're the one for this quick turn-around!
How to prepare for a job interview at eTeam
✨Nail the Technical Skills
For a software engineering role, you'll likely face technical questions or coding tasks during your interview. Brush up on the relevant programming languages and frameworks that eTeam uses, and don’t forget to practice some coding challenges on platforms like LeetCode or HackerRank. Showing your coding prowess can really make you stand out!
✨Prepare for System Design Questions
Even for a temporary role, having a grasp of system design principles can be crucial. Be ready to discuss how you would architect a software solution, including discussing trade-offs, scalability, and performance considerations. Having examples from previous projects can really show off your analytical thinking.
✨Demonstrate Your Adaptability
Since this is a temporary role, you'll want to emphasise your ability to hit the ground running. Highlight experiences where you quickly adapted to new technologies or teams. Let’s make it clear to the interviewers at eTeam that you can learn on the job and deliver results in a short timeframe!
✨Show Off Your Portfolio
Make sure to have a portfolio or GitHub ready showcasing your projects. Having tangible evidence of what you've done—be it personal projects, contributions to open-source, or previous work—can convey how capable you are. Tailor this for what might interest eTeam, so it's relevant and sparks conversation during your interview.
