Platform Engineer AWS, Databricks in Leeds
Platform Engineer AWS, Databricks

Platform Engineer AWS, Databricks in Leeds

Leeds Full-Time 50000 - 65000 £ / year (est.) No home office possible
S

At a Glance

  • Tasks: Configure and support integration between Palantir Foundry, Databricks, and AWS data sources.
  • Company: Join a forward-thinking tech company in Leeds with a hybrid work culture.
  • Benefits: Competitive pay, flexible working, and opportunities for professional growth.
  • Other info: Dynamic role with potential for career advancement in a collaborative environment.
  • Why this job: Be at the forefront of data integration and make a real impact in tech.
  • Qualifications: Experience with Palantir Foundry, Databricks, and AWS required.

The predicted salary is between 50000 - 65000 £ per year.

Job Type: Contract Inside IR35

Location: Leeds - Hybrid

Duration: 6 Months

Role Overview

Configure and support secure integration between Palantir Foundry, Databricks on AWS and AWS-hosted data sources. The role covers data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed by Foundry using the Databricks connector or approved ingestion patterns.

Key Responsibilities

  • Configure and support Palantir Foundry integration with Databricks on AWS.
  • Set up and validate the Foundry Databricks connector for approved SQL Warehouses, tables, views and Unity Catalog-governed objects.
  • Support end-to-end access from AWS S3 sources through Hive Metastore and Unity Catalog into Foundry datasets or products.
  • Configure Foundry Data Connection, datasets, syncs, projects, permissions and lineage as required.
  • Work with AWS teams to define IAM roles, S3 bucket policies, KMS permissions and approved cross-account access patterns.
  • Troubleshoot Foundry connector failures, Databricks authentication issues, Unity Catalog grants, schema mismatches and query failures.
  • Document lineage across AWS S3, Hive Metastore, Unity Catalog and Foundry consumption layers.
  • Work with platform, data engineering, architecture, security and governance teams to deliver a secure and supportable integration.

Required Skills and Experience

  • Hands-on Palantir Foundry experience, including connectors, Data Connection, datasets, syncs, projects and permissions.
  • Experience configuring or supporting the Palantir Foundry Databricks connector.
  • Strong Databricks on AWS experience, including SQL Warehouse, clusters, tables, views and access controls.
  • Good understanding of Hive Metastore and Unity Catalog, including catalogs, schemas, grants, storage credentials and external locations.
  • Strong AWS IAM, S3, KMS, bucket policy and cross-account access experience.
  • Terraform or similar Infrastructure as Code experience.
  • Strong ability to troubleshoot access, schema, query, sync and connectivity issues across Foundry, Databricks and AWS.

Desirable Skills

  • Experience with Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder or Code Repositories.
  • Experience with Delta Lake, Parquet, Iceberg, CSV and JSON.
  • Data governance, lineage, secure data-sharing and access approval experience.
  • Python, PySpark or SQL development experience.
  • CI/CD experience using GitLab, GitHub Actions, Azure DevOps or similar.

Key Deliverables

  • Configured and validated Foundry Databricks connector.
  • Integration design covering AWS S3, Hive Metastore, Unity Catalog and Foundry consumption.
  • AWS IAM, S3 and KMS access design for source data.
  • Validated access to approved Databricks tables, views or SQL endpoints.
  • Lineage, access-control and operational support documentation.

Platform Engineer AWS, Databricks in Leeds employer: StackStudio Digital Ltd.

As a Platform Engineer at our Leeds location, you will thrive in a dynamic and collaborative work culture that prioritises innovation and professional growth. We offer competitive benefits, including flexible hybrid working arrangements, and a commitment to employee development through training and mentorship programmes, making us an excellent employer for those seeking meaningful and rewarding careers in cutting-edge technology.
S

Contact Detail:

StackStudio Digital Ltd. Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Platform Engineer AWS, Databricks in Leeds

✨Tip Number 1

Network like a pro! Reach out to folks in your industry on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can put in a good word for you.

✨Tip Number 2

Prepare for those interviews by practising common questions and scenarios related to AWS, Databricks, and Foundry. We recommend doing mock interviews with friends or using online platforms to get comfortable.

✨Tip Number 3

Showcase your skills! Create a portfolio or GitHub repository with projects that highlight your experience with Palantir Foundry, Databricks, and AWS. This gives potential employers a tangible look at what you can do.

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!

We think you need these skills to ace Platform Engineer AWS, Databricks in Leeds

Palantir Foundry
Databricks Connector
AWS
Unity Catalog
Terraform
SQL Warehouse
Hive Metastore
AWS IAM
S3
KMS
Data Connection
Troubleshooting
Data Governance
Python
CI/CD

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Platform Engineer role. Highlight your experience with AWS, Databricks, and Palantir Foundry. We want to see how your skills match what we're looking for!

Showcase Your Projects: Include specific projects where you've configured or supported integrations similar to what we do at StudySmarter. This helps us understand your hands-on experience and problem-solving skills.

Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for key achievements and responsibilities. We appreciate straightforward communication!

Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to hear from you!

How to prepare for a job interview at StackStudio Digital Ltd.

✨Know Your Tech Stack

Make sure you’re well-versed in the technologies mentioned in the job description, especially AWS, Databricks, and Unity Catalog. Brush up on your hands-on experience with Palantir Foundry and the Databricks connector, as these will likely come up during the interview.

✨Prepare for Scenario Questions

Expect to be asked about troubleshooting scenarios related to access issues, schema mismatches, or query failures. Think of specific examples from your past experiences where you successfully resolved similar problems, as this will demonstrate your practical knowledge.

✨Understand Data Governance

Familiarise yourself with data governance concepts, lineage, and secure data-sharing practices. Be ready to discuss how you’ve implemented these in previous roles, particularly in relation to AWS IAM and S3 bucket policies.

✨Showcase Your Documentation Skills

Since documentation is a key deliverable for this role, be prepared to talk about how you document processes and lineage. Bring examples of your previous documentation work, as this will highlight your attention to detail and organisational skills.

Platform Engineer AWS, Databricks in Leeds
StackStudio Digital Ltd.
Location: Leeds

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>