At a Glance
- Tasks: Lead a high-stakes migration from Palantir to Databricks, optimising data workflows.
- Company: Join Luxoft, a global tech firm transforming financial institutions.
- Benefits: Enjoy remote work flexibility, world-class training, and career development support.
- Other info: Gain unmatched exposure to complex data ecosystems and collaborate with top architects.
- Why this job: Make a real impact while enhancing your skills in a dynamic hedge fund environment.
- Qualifications: Expertise in Databricks, PySpark, and proven migration experience required.
The predicted salary is between 80000 - 100000 £ per year.
Take full ownership of a high-stakes data platform migration, and position yourself as the go-to expert in enterprise-scale Palantir to Databricks transitions. You’ll lead the entire migration strategy across a high-functioning data ecosystem, giving you unmatched exposure to complex pipeline redesigns, performance optimisation, and stakeholder collaboration at the highest level. This isn’t just a technical move - it’s a chance to sharpen your influence across engineering, DevOps, and business teams.
Working in a hedge fund environment means you’ll have the budget and autonomy to do things properly. There are no unnecessary blockers, so you can focus on delivering clean, scalable solutions that set new standards. You’ll also broaden your career options. Whether you want to stay deeply technical or pivot towards pre-sales or solution architecture, this migration gives you the credibility and hands-on experience to do both. Plus, you can work fully remotely or choose to spend time in the London office to stay close to the action.
On top of that, you’ll benefit from world-class internal training, structured career development support, and direct access to senior architects who’ve led similar transformations. It’s a rare chance to learn while leading.
What you’ll do
- Define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.
- Analyze existing Foundry pipelines, datasets, and ontologies, redesigning them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL, ensuring high performance and cost-efficient operations.
- Collaborate with data engineers, platform teams, and business stakeholders to minimize migration risk, ensure smooth cutover, and maintain production stability.
What you’ll need
- Deep knowledge of Databricks architecture, job orchestration, cluster management, and performance tuning.
- Proven experience leading or executing platform migrations from Palantir to Databricks.
- Expert-level PySpark & Python skills, strong ability to design, optimise, and refactor distributed data processing workflows.
- Advanced SQL & data modelling expertise, including dimensional modelling, lakehouse architecture patterns and query optimisation.
- Hands-on experience deploying and managing data platforms in cloud environments, Azure preferred.
- Expertise in Palantir Foundry pipelines, ontologies, data lineage, transformations, and platform governance.
Luxoft is a global technology and engineering firm (part of DXC Technology) that partners with leading financial institutions to deliver high‑impact transformation. Luxoft specialises in capital markets, banking, and wealth management, providing expertise across front‑to-back office platforms, trading systems, data and analytics, and cloud modernisation.
Please click the ‘Apply’ button. Don’t worry if your CV isn’t up to date. Just send what you have and we’ll deal with that later.
Migration Architect - Palantir to Databricks (Hedge Fund) in Basingstoke employer: Luxoft
Luxoft is an exceptional employer, offering a dynamic work environment where innovation thrives and employees are empowered to take ownership of high-stakes projects. With a strong focus on professional development, you will have access to world-class training and mentorship from senior architects, enabling you to enhance your skills while leading significant migrations in the hedge fund sector. The flexibility to work remotely or from the London office, combined with a culture that prioritises collaboration and autonomy, makes Luxoft a standout choice for those seeking meaningful and rewarding career opportunities.
StudySmarter Expert Advice🤫
We think this is how you could land Migration Architect - Palantir to Databricks (Hedge Fund) in Basingstoke
✨Tip Number 1
Network like a pro! Reach out to your connections in the industry, especially those who have experience with Palantir and Databricks. A friendly chat can lead to insider info about job openings or even referrals that could give you a leg up.
✨Tip Number 2
Show off your skills! Create a portfolio or a GitHub repository showcasing your projects related to data migration, PySpark, and SQL. This gives potential employers a tangible look at what you can do and sets you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your knowledge of Databricks architecture and migration strategies. Be ready to discuss your past experiences and how they relate to the role. Confidence and clarity can make all the difference!
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, we’re here to help you every step of the way, so don’t hesitate to reach out if you have questions.
We think you need these skills to ace Migration Architect - Palantir to Databricks (Hedge Fund) in Basingstoke
Some tips for your application 🫡
Show Off Your Expertise:Make sure to highlight your experience with Databricks and Palantir in your application. We want to see how you've tackled similar migrations before, so don’t hold back on the details!
Tailor Your CV:Customise your CV to reflect the skills and experiences that align with the job description. We love seeing candidates who take the time to connect their background with what we’re looking for.
Be Clear and Concise:When writing your application, keep it straightforward. We appreciate clarity, so make sure your points are easy to understand and directly related to the role.
Apply Through Our Website:We encourage you to apply through our website for a smoother process. It’s the best way for us to receive your application and get you into our system quickly!
How to prepare for a job interview at Luxoft
✨Know Your Migration Inside Out
Make sure you thoroughly understand the migration process from Palantir to Databricks. Brush up on the specific challenges and solutions related to this transition, as well as the architecture and performance tuning aspects. Being able to discuss these in detail will show your expertise and confidence.
✨Showcase Your Technical Skills
Prepare to demonstrate your PySpark, Python, and SQL skills during the interview. You might be asked to solve a problem or optimise a workflow on the spot, so practice coding challenges that reflect real-world scenarios you might face in the role.
✨Highlight Collaboration Experience
Since this role involves working closely with data engineers and business stakeholders, be ready to share examples of how you've successfully collaborated in past projects. Discuss how you’ve minimised risks and ensured smooth transitions in previous migrations.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's data ecosystem and their expectations for the migration. This not only shows your interest but also helps you gauge if the company aligns with your career goals. Plus, it gives you a chance to demonstrate your strategic thinking.
