Data Engineer - Pyspark / Palantir

Social network you want to login/join with:

Data Engineer – Pyspark / Palantir, City of London

col-narrow-left

Location:

City of London, United Kingdom

Job Category:

Information Technology

EU work permit required:

Yes

col-narrow-right

Job Reference:

BBBH63893_1748355123

Job Views:

5

Posted:

27.05.2025

Expiry Date:

11.07.2025

col-wide

Job Description:

Data Engineer – Pyspark / Palantir

Whitehall Resources require a Data Engineer with experience with Pyspark & Palantir to work with a key client on an initial 6 month contract.

*Inside IR35.

*This role will require on site work in London 2-3 days per week.

Data Engineer – Pyspark / Palantir

Key responsibilities:
• Developing Data Stores and Data Warehouse solutions
• Design and develop data pipelines bring data from variety of data sources to Azure Databases and Azure Data Lake using self-integration runtime
• Work with Product owners and Solution Architect to understand the requirements and deliver in Azure platform,
• Design, Estimation and Planning
• Executing the PoC/Project in Agile methodology
• Design and deliver quality solutions independently
• Leading a team of Data Engineers and deliver solutions as a team

Key skills/knowledge/experience:
• Proficient in PySpark, Python, SQL with atleast 5 years of experience
• Working experience in Palantir Foundry platform is must
• Experience designing and implementing data analytics solutions on enterprise data platforms and distributed computing (Spark/Hive/Hadoop preferred).
• Proven track record of understanding and transforming customer requirements into a best-fit design and architecture.
• Demonstrated experience in end-to-end data management, data modelling, and data transformation for analytical use cases.
• Proficient in SQL (Spark SQL preferred).
• Experience with JavaScript/HTML/CSS a plus. Experience working in a Cloud environment such as Azure or AWS is a plus.
• Experience with Scrum/Agile development methodologies.
• At least 7 years of experience working with large scale software systems.
• Bachelor\’s degree level or equivalent in Computer Science, Data Science or similar discipline.
• and K8S systems is a plus.

Person specification:
• Knowledge of Insurance Domain or Financial Industry is a strong plus.
• Experienced working in multicultural globally distributed teams.
• Self-starter with a positive attitude and a willingness to learn, who can manage their own workload.
• Strong analytical and problem-solving skills.
• Strong interpersonal and communication skills, demonstrating a clear and articulate standard of written and verbal

All of our opportunities require that applicants are eligible to work in the specified country/location, unless otherwise stated in the job description.

Whitehall Resources are an equal opportunities employer who value a diverse and inclusive working environment. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity or expression, sexual orientation, national origin, pregnancy, disability, age, veteran status, or other characteristics.

#J-18808-Ljbffr