At a Glance
- Tasks: Lead a high-stakes migration from Palantir to Databricks, optimising data workflows.
- Company: Join Luxoft, a global tech firm transforming financial institutions.
- Benefits: Enjoy remote work flexibility, world-class training, and career development support.
- Other info: Collaborate with senior architects and broaden your career options in tech.
- Why this job: Make a real impact while gaining hands-on experience in a dynamic hedge fund environment.
- Qualifications: Deep knowledge of Databricks, proven migration experience, and expert-level PySpark skills.
The predicted salary is between 80000 - 100000 £ per year.
Take full ownership of a high-stakes data platform migration, and position yourself as the go-to expert in enterprise-scale Palantir to Databricks transitions. You’ll lead the entire migration strategy across a high-functioning data ecosystem, giving you unmatched exposure to complex pipeline redesigns, performance optimisation, and stakeholder collaboration at the highest level. This isn’t just a technical move - it’s a chance to sharpen your influence across engineering, DevOps, and business teams.
Working in a hedge fund environment means you’ll have the budget and autonomy to do things properly. There are no unnecessary blockers, so you can focus on delivering clean, scalable solutions that set new standards. You’ll also broaden your career options. Whether you want to stay deeply technical or pivot towards pre-sales or solution architecture, this migration gives you the credibility and hands-on experience to do both. Plus, you can work fully remotely or choose to spend time in the London office to stay close to the action.
On top of that, you’ll benefit from world-class internal training, structured career development support, and direct access to senior architects who’ve led similar transformations. It’s a rare chance to learn while leading.
What you’ll do
- Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.
- Analyze existing Foundry pipelines, datasets, and ontologies, redesigning them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL, ensuring high performance and cost-efficient operations.
- Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability.
What you’ll need
- Deep knowledge of Databricks architecture, job orchestration, cluster management, and performance tuning.
- Proven experience leading or executing platform migrations from Palantir to Databricks.
- Expert-level PySpark & Python skills, strong ability to design, optimise, and refactor distributed data processing workflows.
- Advanced SQL & data modelling expertise, including dimensional modelling, lakehouse architecture patterns and query optimisation.
- Hands-on experience deploying and managing data platforms in cloud environments, Azure preferred.
- Expertise in Palantir Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
About the company
Luxoft is a global technology and engineering firm (part of DXC Technology) that partners with leading financial institutions to deliver high‑impact transformation. Luxoft specialises in capital markets, banking, and wealth management, providing expertise across front‑to-back office platforms, trading systems, data and analytics, and cloud modernisation.
Please click the ‘Apply’ button. Don’t worry if your CV isn’t up to date. Just send what you have and we’ll deal with that later.
Migration Architect - Palantir to Databricks (Hedge Fund) in Shrewsbury employer: Luxoft
Luxoft is an exceptional employer, offering a dynamic work environment where innovation thrives and employees are empowered to take ownership of high-stakes projects. With a strong focus on professional development, you will have access to world-class training and mentorship from senior architects, enabling you to enhance your skills while leading transformative migrations in a hedge fund setting. The flexibility to work remotely or in the London office, combined with a culture that prioritises collaboration and autonomy, makes Luxoft a standout choice for those seeking meaningful and rewarding career opportunities.
StudySmarter Expert Advice🤫
We think this is how you could land Migration Architect - Palantir to Databricks (Hedge Fund) in Shrewsbury
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who have experience with Palantir and Databricks. A friendly chat can lead to insider info about job openings or even referrals that could give you a leg up.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your past migration projects or any relevant work. This is your chance to demonstrate your expertise in PySpark, SQL, and cloud environments, making you stand out to potential employers.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your approach to complex migrations and how you’ve collaborated with teams in the past. Confidence and clarity can make all the difference!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we’re here to help you every step of the way, so don’t hesitate to reach out if you have questions.
We think you need these skills to ace Migration Architect - Palantir to Databricks (Hedge Fund) in Shrewsbury
Some tips for your application 🫡
Show Off Your Expertise:Make sure to highlight your experience with Databricks and Palantir in your application. We want to see how you've tackled similar migrations before, so don’t hold back on the details!
Tailor Your CV:Customise your CV to reflect the skills and experiences that align with the job description. We love seeing candidates who take the time to connect their background with what we’re looking for.
Be Clear and Concise:When writing your application, keep it straightforward. We appreciate clarity, so make sure your points are easy to understand and get straight to the heart of your achievements.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity!
How to prepare for a job interview at Luxoft
✨Know Your Migration Inside Out
Make sure you thoroughly understand the migration process from Palantir to Databricks. Brush up on the specific challenges and solutions related to this transition, as well as the architecture and performance tuning aspects. Being able to discuss these in detail will show your expertise and confidence.
✨Showcase Your Technical Skills
Prepare to demonstrate your PySpark, Python, and SQL skills during the interview. You might be asked to solve a problem or optimise a workflow on the spot, so practice coding challenges that reflect real-world scenarios you might face in the role.
✨Highlight Collaboration Experience
Since this role involves working closely with data engineers and business stakeholders, be ready to share examples of how you've successfully collaborated in past projects. Discuss how you’ve minimised risks and ensured smooth transitions, as this will illustrate your ability to lead in a high-stakes environment.
✨Understand the Hedge Fund Landscape
Familiarise yourself with the hedge fund industry and its unique challenges. Knowing how data platforms can impact trading and investment strategies will help you connect your technical skills to the business needs, making you a more attractive candidate.
