Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join a dynamic team as a Data Engineer, developing data solutions and pipelines.
- Company: Whitehall Resources is a leading IT recruitment agency focused on delivering top talent.
- Benefits: Enjoy flexible working with 2-3 days onsite in London and a collaborative environment.
- Why this job: Work on exciting projects using cutting-edge technology like Pyspark and Palantir.
- Qualifications: 5+ years in data engineering with expertise in Pyspark, SQL, and Palantir required.
- Other info: This role is inside IR35; applicants must have an EU work permit.
The predicted salary is between 48000 - 84000 £ per year.
Whitehall Resources require a Data Engineer with experience with Pyspark & Palantir to work with a key client on an initial 6 month contract.
- Inside IR35.
- This role will require on site work in London 2-3 days per week.
Key responsibilities:
- Developing Data Stores and Data Warehouse solutions
- Design and develop data pipelines bringing data from a variety of data sources to Azure Databases and Azure Data Lake using self-integration runtime
- Work with Product owners and Solution Architect to understand the requirements and deliver in Azure platform
- Design, Estimation and Planning
- Executing the PoC/Project in Agile methodology
- Design and deliver quality solutions independently
- Leading a team of Data Engineers and deliver solutions as a team
Key skills/knowledge/experience:
- Proficient in PySpark, Python, SQL with at least 5 years of experience
- Working experience in Palantir Foundry platform is a must
- Experience designing and implementing data analytics solutions on enterprise data platforms and distributed computing (Spark/Hive/Hadoop preferred)
- Proven track record of understanding and transforming customer requirements into a best-fit design and architecture
- Demonstrated experience in end-to-end data management, data modelling, and data transformation for analytical use cases
- Proficient in SQL (Spark SQL preferred)
- Experience with JavaScript/HTML/CSS a plus
- Experience working in a Cloud environment such as Azure or AWS is a plus
- Experience with Scrum/Agile development methodologies
- At least 7 years of experience working with large scale software systems
- Bachelor's degree level or equivalent in Computer Science, Data Science or similar discipline
- K8S systems experience is a plus
Person specification:
- Knowledge of Insurance Domain or Financial Industry is a strong plus
- Experienced working in multicultural globally distributed teams
- Self-starter with a positive attitude and a willingness to learn, who can manage their own workload
- Strong analytical and problem-solving skills
- Strong interpersonal and communication skills, demonstrating a clear and articulate standard of written and verbal communication
All of our opportunities require that applicants are eligible to work in the specified country/location, unless otherwise stated in the job description. Whitehall Resources are an equal opportunities employer who value a diverse and inclusive working environment. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity or expression, sexual orientation, national origin, pregnancy, disability, age, veteran status, or other characteristics.
Data Engineer - Pyspark / Palantir employer: Whitehall Resources Ltd
Contact Detail:
Whitehall Resources Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer - Pyspark / Palantir
✨Tip Number 1
Familiarise yourself with the Palantir Foundry platform, as it's a must-have for this role. Consider taking online courses or tutorials to deepen your understanding and showcase your skills during interviews.
✨Tip Number 2
Network with professionals in the data engineering field, especially those who have experience with PySpark and Palantir. Attend industry meetups or webinars to make connections that could lead to referrals.
✨Tip Number 3
Brush up on Agile methodologies, as this role requires executing projects in an Agile environment. Being able to discuss your experience with Agile practices can set you apart from other candidates.
✨Tip Number 4
Highlight any experience you have with cloud environments like Azure or AWS. If you have worked on projects involving data pipelines or data lakes, be ready to discuss these in detail during your interview.
We think you need these skills to ace Data Engineer - Pyspark / Palantir
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with PySpark, Palantir, and any relevant data engineering projects. Use specific examples that demonstrate your skills in developing data stores and pipelines.
Craft a Strong Cover Letter: Write a cover letter that addresses the key responsibilities mentioned in the job description. Explain how your background aligns with their needs, particularly your experience in Agile methodologies and cloud environments like Azure.
Showcase Relevant Projects: Include a section in your application that showcases specific projects where you have successfully implemented data analytics solutions or led a team of data engineers. This will help illustrate your hands-on experience.
Highlight Soft Skills: In addition to technical skills, emphasise your strong analytical, problem-solving, and communication skills. Mention any experience working in multicultural teams, as this is valued by the employer.
How to prepare for a job interview at Whitehall Resources Ltd
✨Showcase Your Technical Skills
Make sure to highlight your proficiency in PySpark, Python, and SQL during the interview. Be prepared to discuss specific projects where you've used these technologies, especially in relation to data pipelines and analytics solutions.
✨Demonstrate Agile Experience
Since the role involves working in an Agile environment, be ready to share examples of how you've successfully executed projects using Agile methodologies. Discuss your experience with Scrum and how it has helped you deliver quality solutions.
✨Understand the Company’s Needs
Research the company and its key clients to understand their requirements and challenges. This will allow you to tailor your responses and demonstrate how your skills can directly address their needs, particularly in the insurance or financial sectors.
✨Prepare for Team Leadership Questions
As the role involves leading a team of Data Engineers, be prepared to discuss your leadership style and experiences. Share examples of how you've successfully led teams, managed workloads, and fostered collaboration in multicultural environments.
