At a Glance
- Tasks: Lead the design and operation of scalable data pipelines using Python on Databricks.
- Company: Join J.P. Morgan, a global leader in financial services with a focus on diversity.
- Benefits: Enjoy competitive salary, health benefits, and opportunities for professional growth.
- Other info: Dynamic team environment with a commitment to innovation and responsible AI adoption.
- Why this job: Make a real impact by delivering high-quality datasets for analytics and ML use cases.
- Qualifications: 8-12+ years in data engineering, strong Python and SQL skills required.
The predicted salary is between 70000 - 90000 £ per year.
We are seeking a Senior Data Engineer to lead the design, build, and operation of scalable data pipelines and domain‑aligned data products on Databricks using Python. This role is accountable for delivering governed, discoverable, high‑quality datasets and services aligned to data mesh principles (domain ownership, product thinking, and federated governance), enabling analytics and ML use cases with strong reliability, security, and performance.
Key Responsibilities
- Architect and deliver end‑to‑end data engineering solutions on Databricks (Spark/Delta Lake) using Python and SQL.
- Build data products aligned to data mesh principles: clear contracts, documentation, metadata, lineage, access controls, and measurable SLAs/SLOs.
- Develop and optimize batch and streaming pipelines with strong data quality checks and observability.
- Implement curated data layers and models (e.g., bronze/silver/gold as appropriate), including partitioning, file sizing, clustering strategies, and query optimization.
- Establish engineering standards: code quality, unit/integration testing, CI/CD, release governance, and reusable frameworks.
- Partner with governance, security, and platform teams to ensure compliance with firm policies (RBAC, encryption, retention, auditability) and smooth onboarding of consumers.
- Provide technical leadership across squads: architecture reviews, mentoring, and hands‑on delivery for critical components.
AI-Enabled Engineering Expectations
- Be well‑versed in using AI‑assisted development tools to accelerate delivery while maintaining strong engineering rigor (secure coding, testing, and review discipline).
- Use AI tools for tasks such as code scaffolding, refactoring, test generation, documentation, and troubleshooting, with human validation and adherence to internal controls.
- Promote responsible adoption patterns within the team (prompt hygiene, avoiding sensitive data exposure, and ensuring outputs meet quality/security standards).
Required Qualifications
- 8–12+ years of experience in data engineering / software engineering with end‑to‑end delivery ownership.
- Strong hands‑on expertise with AWS, Databricks and Delta Lake.
- Strong Python engineering skills (modular design, packaging, testing, dependency management).
- Strong SQL and data modeling fundamentals.
- Solid Spark fundamentals (joins, shuffle, partitioning, caching, skew handling, cluster sizing).
- Experience implementing CI/CD and SDLC best practices (Git‑based workflows, code reviews, automated testing).
- Proven stakeholder management and ability to drive cross‑team delivery.
Software Engineer III - Senior Data Engineer employer: JPMorganChase
Contact Detail:
JPMorganChase Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Software Engineer III - Senior Data Engineer
✨Tip Number 1
Network like a pro! Reach out to folks in your industry on LinkedIn or at meetups. A friendly chat can lead to opportunities that aren’t even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects, especially those using Databricks and Python. This gives potential employers a taste of what you can do.
✨Tip Number 3
Prepare for interviews by practising common technical questions and scenarios related to data engineering. We recommend doing mock interviews with friends or using online platforms.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining us.
We think you need these skills to ace Software Engineer III - Senior Data Engineer
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the role of Senior Data Engineer. Highlight your experience with data pipelines, Python, and Databricks. We want to see how your skills align with our needs!
Showcase Your Projects: Include specific projects where you've implemented data engineering solutions. We love seeing real-world examples of your work, especially if they demonstrate your ability to deliver high-quality datasets and services.
Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for key achievements and responsibilities. We appreciate straightforward communication that gets right to the heart of your experience.
Apply Through Our Website: Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!
How to prepare for a job interview at JPMorganChase
✨Know Your Tech Stack
Make sure you’re well-versed in the technologies mentioned in the job description, especially Databricks, Python, and SQL. Brush up on your Spark fundamentals too, as they’ll likely ask you about joins, partitioning, and caching during the interview.
✨Showcase Your Projects
Prepare to discuss specific projects where you've designed and built data pipelines or products. Highlight your role, the challenges you faced, and how you ensured data quality and compliance with governance standards. Real-world examples will make you stand out!
✨Understand Data Mesh Principles
Familiarise yourself with data mesh concepts like domain ownership and product thinking. Be ready to explain how you’ve applied these principles in your previous work, as this role heavily focuses on delivering high-quality datasets aligned with these ideas.
✨Demonstrate Leadership Skills
Since this position involves providing technical leadership, think of instances where you’ve mentored others or led a project. Be prepared to discuss how you handle cross-team collaboration and stakeholder management, as these skills are crucial for success in this role.