At a Glance
- Tasks: Lead a high-stakes migration from Palantir to Databricks, optimising data workflows.
- Company: Join Luxoft, a global tech firm transforming financial institutions.
- Benefits: Enjoy remote work flexibility, world-class training, and career development support.
- Other info: Gain unmatched exposure to complex data ecosystems and collaborate with top architects.
- Why this job: Make a real impact while enhancing your skills in a dynamic hedge fund environment.
- Qualifications: Expertise in Databricks, PySpark, and proven migration experience required.
The predicted salary is between 80000 - 100000 £ per year.
Take full ownership of a high-stakes data platform migration, and position yourself as the go-to expert in enterprise-scale Palantir to Databricks transitions. You’ll lead the entire migration strategy across a high-functioning data ecosystem, giving you unmatched exposure to complex pipeline redesigns, performance optimisation, and stakeholder collaboration at the highest level. This isn’t just a technical move - it’s a chance to sharpen your influence across engineering, DevOps, and business teams.
Working in a hedge fund environment means you’ll have the budget and autonomy to do things properly. There are no unnecessary blockers, so you can focus on delivering clean, scalable solutions that set new standards. You’ll also broaden your career options. Whether you want to stay deeply technical or pivot towards pre-sales or solution architecture, this migration gives you the credibility and hands-on experience to do both. Plus, you can work fully remotely or choose to spend time in the London office to stay close to the action.
On top of that, you’ll benefit from world-class internal training, structured career development support, and direct access to senior architects who’ve led similar transformations. It’s a rare chance to learn while leading.
What you’ll do
- Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.
- Analyze existing Foundry pipelines, datasets, and ontologies, redesigning them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL, ensuring high performance and cost-efficient operations.
- Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability.
What you’ll need
- Deep knowledge of Databricks architecture, job orchestration, cluster management, and performance tuning.
- Proven experience leading or executing platform migrations from Palantir to Databricks.
- Expert-level PySpark & Python skills, strong ability to design, optimise, and refactor distributed data processing workflows.
- Advanced SQL & data modelling expertise, including dimensional modelling, lakehouse architecture patterns and query optimisation.
- Hands-on experience deploying and managing data platforms in cloud environments, Azure preferred.
- Expertise in Palantir Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
Luxoft is a global technology and engineering firm (part of DXC Technology) that partners with leading financial institutions to deliver high‑impact transformation. Luxoft specialises in capital markets, banking, and wealth management, providing expertise across front‑to-back office platforms, trading systems, data and analytics, and cloud modernisation.
Please click the ‘Apply’ button. Don’t worry if your CV isn’t up to date. Just send what you have and we’ll deal with that later.
Migration Architect - Palantir to Databricks (Hedge Fund) in Norwich employer: Luxoft
Luxoft is an exceptional employer, offering a dynamic work environment where innovation thrives and employees are empowered to take ownership of high-stakes projects. With a strong focus on professional development, you will have access to world-class training and mentorship from senior architects, enabling you to enhance your skills while leading transformative migrations in a hedge fund setting. The flexibility to work remotely or from the London office, combined with a culture that prioritises collaboration and autonomy, makes Luxoft a standout choice for those seeking meaningful and rewarding career opportunities.
StudySmarter Expert Advice🤫
We think this is how you could land Migration Architect - Palantir to Databricks (Hedge Fund) in Norwich
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who have experience with Palantir and Databricks. A friendly chat can lead to insider info about job openings or even referrals that could give you a leg up.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your past migration projects or any relevant work. This is your chance to demonstrate your expertise in PySpark, SQL, and cloud environments, making you stand out to potential employers.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge and soft skills. Be ready to discuss your approach to migration strategies and how you’ve collaborated with teams in the past. Confidence and clarity can make all the difference!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we’re here to help you every step of the way, so don’t hesitate to reach out if you have questions.
We think you need these skills to ace Migration Architect - Palantir to Databricks (Hedge Fund) in Norwich
Some tips for your application 🫡
Show Off Your Expertise:Make sure to highlight your experience with Databricks and Palantir in your application. We want to see how you've tackled similar migrations before, so don’t hold back on the details!
Tailor Your CV:Customise your CV to reflect the skills and experiences that align with the job description. We love seeing candidates who take the time to connect their background with what we’re looking for.
Be Clear and Concise:When writing your application, keep it straightforward. We appreciate clarity, so make sure your points are easy to understand and get straight to the heart of your achievements.
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for the role without any hiccups!
How to prepare for a job interview at Luxoft
✨Know Your Migration Inside Out
Make sure you thoroughly understand the migration process from Palantir to Databricks. Brush up on the specific challenges and solutions related to this transition, as well as the architecture and performance tuning aspects. Being able to discuss these in detail will show your expertise and confidence.
✨Showcase Your Technical Skills
Prepare to demonstrate your expert-level skills in PySpark, Python, and SQL during the interview. Have examples ready that highlight your experience with data modelling and optimising workflows. This is your chance to shine, so don’t hold back on showcasing your technical prowess!
✨Collaborate Like a Pro
Since collaboration with various teams is key in this role, be ready to discuss how you've successfully worked with data engineers, platform teams, and business stakeholders in the past. Share specific examples of how you minimised risks and ensured smooth transitions in previous projects.
✨Understand the Hedge Fund Environment
Familiarise yourself with the unique aspects of working in a hedge fund setting. Be prepared to discuss how you can leverage the budget and autonomy to deliver high-quality, scalable solutions. Showing that you understand the business context will set you apart from other candidates.