Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Join us as a Senior Data Engineer, crafting data solutions and enhancing our Azure platform.
- Company: Be part of a forward-thinking tech company focused on innovative data engineering.
- Benefits: Enjoy flexible working options, competitive salary, and opportunities for professional growth.
- Why this job: Make an impact with cutting-edge technology while collaborating in a dynamic, agile environment.
- Qualifications: Strong Azure experience, Python skills, and a passion for data engineering are essential.
- Other info: Security clearance at SC level is required for this role.
The predicted salary is between 54000 - 84000 £ per year.
Please note that this role requires security clearance at SC level. You must be SC cleared to be considered for the role.
Tasks and Responsibilities:
- Ingestion configuration.
- Write Python/PySpark and Spark SQL code for validation/curation in notebook.
- Create data integration test cases.
- Implement or amend worker pipelines.
- Implement data validation/curation rules.
- Convert data model into technical data mapping.
- Implement integrations.
- Data migration implementation and execution.
- Data analysis (profiling, etc.).
- Azure DevOps/GitHub configurations for ADF and Databricks code.
Our Ideal Candidate:
- Strong experience in designing and delivering Azure-based data platform solutions, including: Azure ADF and Databricks, Azure Functions, App Service, Logic Apps, AKS, Azure App Service, Web App.
- Good knowledge of real-time streaming applications, preferably with experience in Kafka real-time messaging or Azure Functions, Azure Service Bus.
- Spark processing and performance tuning.
- File formats partitioning (e.g., Parquet, JSON, XML, CSV).
- Azure DevOps/GitHub.
- Hands-on experience in at least one of Python with knowledge of the others.
- Experience with synchronous and asynchronous interface approaches.
- Knowledge in data modeling (3NF/Dimensional modeling/Data Vault 2).
- Work experience in agile delivery.
- Able to provide comprehensive documentation.
- Able to set and manage realistic expectations for timescales, costs, benefits, and measures for success.
Nice to Have:
- Experience with integration and implementation of data cataloging tools like Azure Purview/Collabra.
- Experience in implementing and integrating visualization tools like Power BI/Tableau, etc.
- Experience in C# application development (ASP.NET MVP).
Senior/Lead Data Engineer employer: Cognizant
Contact Detail:
Cognizant Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior/Lead Data Engineer
✨Tip Number 1
Make sure you have a solid understanding of Azure-based data platform solutions. Familiarise yourself with Azure ADF, Databricks, and other relevant services, as this knowledge will be crucial during interviews.
✨Tip Number 2
Brush up on your Python and PySpark skills, as well as your experience with Spark SQL. Being able to demonstrate your coding abilities in these areas will set you apart from other candidates.
✨Tip Number 3
Gain hands-on experience with real-time streaming applications, particularly Kafka and Azure Functions. This practical knowledge will be beneficial when discussing your previous projects and how they relate to the role.
✨Tip Number 4
Prepare to discuss your experience with agile delivery and how you've managed expectations in past projects. Being able to articulate your approach to project management will show that you're not just technically skilled but also a great team player.
We think you need these skills to ace Senior/Lead Data Engineer
Some tips for your application 🫡
Highlight Relevant Experience: Make sure to emphasise your experience with Azure-based data platform solutions, particularly Azure ADF, Databricks, and any relevant tools mentioned in the job description. Use specific examples to demonstrate your expertise.
Showcase Technical Skills: Clearly outline your proficiency in Python, PySpark, and Spark SQL. Mention any hands-on experience with real-time streaming applications and data processing techniques, as these are crucial for the role.
Detail Your Agile Experience: Since the ideal candidate should have experience in agile delivery, provide examples of how you've successfully worked in agile environments. Highlight your ability to manage expectations and deliver on time.
Include Documentation Skills: As comprehensive documentation is a requirement, mention your experience in creating technical documentation. This could include data mapping, integration processes, or any other relevant documentation you've produced.
How to prepare for a job interview at Cognizant
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Azure-based data platforms, particularly Azure ADF and Databricks. Bring examples of projects where you've implemented data integration or migration, and be ready to explain your approach to performance tuning in Spark.
✨Demonstrate Problem-Solving Abilities
Expect scenario-based questions that assess your ability to handle real-time streaming applications and data validation. Think of specific challenges you've faced in previous roles and how you overcame them, especially in relation to Kafka or Azure Functions.
✨Understand Agile Methodologies
Since the role requires experience in agile delivery, be ready to discuss your familiarity with agile practices. Share examples of how you've contributed to agile teams, managed expectations, and delivered projects on time.
✨Prepare for Documentation Questions
As comprehensive documentation is crucial for this role, be prepared to talk about your documentation practices. Highlight any tools or methods you use to ensure clarity and thoroughness in your technical documentation.
