Senior Lead Software Engineer - Databricks & Python in Glasgow

Senior Lead Software Engineer - Databricks & Python in Glasgow

Glasgow Full-Time 80000 - 100000 £ / year (est.) No working from home possible
F

At a Glance

  • Tasks: Lead an agile team to build secure, scalable software solutions using Python and Databricks.
  • Company: Join JPMorgan Chase, a leader in global finance technology with a focus on innovation.
  • Benefits: Enjoy competitive pay, diverse culture, and opportunities for professional growth.
  • Other info: Inclusive environment with mentorship opportunities and a commitment to continuous improvement.
  • Why this job: Make a real impact by optimising big data pipelines and developing high-quality applications.
  • Qualifications: Strong experience in Python, Java, and AWS; passion for data engineering and software development.

The predicted salary is between 80000 - 100000 £ per year.

Join an agile team delivering high-quality technology products. As a Senior Lead Software Engineer (Python/Java, Spring, API, AWS) at JPMorgan Chase in Global Finance Technology, you'll build secure, scalable solutions, write production code and tests, review code, and pair program. In Regulatory Reporting, you'll develop and optimize Python/PySpark big data pipelines across asset classes.

Job responsibilities:

  • Lead by example: contribute production‑quality code daily, write tests, perform code reviews, and pair program.
  • Design and deliver secure, high‑quality microservices and web applications with Java/Spring Boot and React; own deep debugging, root‑cause analysis, and performance tuning for high-availability services.
  • Own end‑to‑end build‑and‑run: design, implement, test, deploy, and operate services ("you build it, you run it").
  • Design, develop, and maintain robust big data pipelines using Python and PySpark on Databricks platform on AWS, optimizing complex queries and data processing workflows to ensure efficient performance at scale.
  • Provide technical leadership and act as SME for microservices, CI/CD, observability, performance engineering, and data modelling.
  • Champion SDLC practices: test automation, CI/CD, security‑by‑default, quality gates, and disciplined change management.
  • Embed non‑functional requirements (security, scalability, reliability, observability, cost) into designs; implement logging, metrics, tracing, SLOs, error budgets, alerting, and runbooks.
  • Foster an inclusive team culture; mentor engineers and drive continuous improvement and craftsmanship.
  • Participate in the full Software Development Life Cycle (SDLC), including requirements gathering, design, development, testing, deployment, and maintenance, working with our partners Product Owners and end users to support their business use cases.
  • Implement data quality checks, monitoring, and alerting mechanisms to ensure data accuracy and pipeline reliability and act as both Production Support and SRE function as part of daily responsibilities.
  • Hands‑on use of AI coding assistants to accelerate delivery (e.g., Claude Code/Claude CoWork, IDE Copilot): prompt design, code/test generation, refactoring, and documentation synthesis; ability to validate outputs for correctness, security, performance, and licensing compliance.

Required qualifications, capabilities, and skills:

  • Strong hands‑on experience in data engineering or related roles.
  • Strong proficiency in Python and PySpark for large‑scale data processing.
  • Advanced proficiency in Java and Spring Boot; strong fundamentals, design patterns, and secure coding.
  • Full‑stack delivery with React (component/state management) and secure RESTful API design.
  • Demonstrated experience with AWS, Databricks and Apache Spark ecosystem.
  • Reliability and performance engineering: concurrency, thread management, caching, and resiliency patterns (circuit breakers, retries, backoff), with cost awareness.
  • Proven track record shipping and operating production systems; comfortable troubleshooting in Kubernetes, CI/CD, and cloud environments.
  • Relational and NoSQL databases: schema design, performance tuning, and secure data access.
  • Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).
  • Strong analytical skills with ability to investigate data issues, identify root causes, and implement solutions.
  • Experience with the complete SDLC, Jules/Jenkins, Spinnaker, Sonar and Agile methodologies.

Preferred qualifications, capabilities, and skills:

  • Understanding of regulatory finance/external reporting (workflows, aggregations, reconciliations, controls).
  • Cloud certifications; proven cloud‑native delivery on AWS.
  • Experience with large‑scale distributed systems, event‑driven architectures, and messaging/streaming patterns.
  • Observability/SRE depth: telemetry pipelines, alerting strategies, incident response, post‑mortems, and continuous improvement.
  • Experience with data orchestration tools (Airflow, Step Functions, etc.).
  • Understanding of financial services industry and regulatory requirements.
  • Databricks or AWS certifications.
  • Automated testing frameworks, e.g. Playwright, Cucumber, Gherkin etc.
  • Experience with Parquet, JSON, CSV, Avro, Delta Lake.

We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs.

Senior Lead Software Engineer - Databricks & Python in Glasgow employer: Fairygodboss

At JPMorgan Chase, we pride ourselves on fostering a dynamic and inclusive work environment where innovation thrives. As a Senior Lead Software Engineer in our Global Finance Technology team, you'll not only have the opportunity to work with cutting-edge technologies like Databricks and AWS but also benefit from a culture that prioritises employee growth through mentorship and continuous improvement. With a commitment to diversity and a focus on delivering high-quality solutions, we offer a rewarding career path in a supportive atmosphere that values your contributions.

F

Contact Details:

Fairygodboss Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Lead Software Engineer - Databricks & Python in Glasgow

Tip Number 1

Network like a pro! Reach out to your connections in the industry, attend meetups, and engage in online forums. You never know who might have the inside scoop on job openings or can refer you directly.

Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those involving Python, Databricks, and AWS. This gives potential employers a taste of what you can do and sets you apart from the crowd.

Tip Number 3

Prepare for interviews by practicing common technical questions and coding challenges. Use platforms like LeetCode or HackerRank to sharpen your skills. Remember, confidence is key!

Tip Number 4

Apply through our website! It’s the best way to ensure your application gets noticed. Plus, we love seeing candidates who are proactive about their job search.

We think you need these skills to ace Senior Lead Software Engineer - Databricks & Python in Glasgow

Python
PySpark
Java
Spring Boot
React
AWS
Databricks

Some tips for your application 🫡

Tailor Your CV:Make sure your CV reflects the skills and experiences that match the job description. Highlight your Python, PySpark, and AWS experience, as well as any leadership roles you've had. We want to see how you can contribute to our agile team!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background aligns with our needs. Don’t forget to mention your experience with microservices and CI/CD practices!

Showcase Your Projects:If you've worked on relevant projects, make sure to include them in your application. Whether it's big data pipelines or secure web applications, we love seeing real-world examples of your work and how you’ve tackled challenges.

Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It’s super easy, and you’ll be one step closer to joining our fantastic team at StudySmarter!

How to prepare for a job interview at Fairygodboss

Know Your Tech Stack

Make sure you’re well-versed in Python, PySpark, Java, and Spring Boot. Brush up on your knowledge of AWS and Databricks too. Be ready to discuss how you've used these technologies in past projects, especially in building scalable solutions.

Showcase Your Problem-Solving Skills

Prepare to share specific examples of how you've tackled complex data issues or performance tuning challenges. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight your analytical skills.

Demonstrate Leadership and Teamwork

As a Senior Lead Software Engineer, you'll need to show that you can mentor others and foster an inclusive team culture. Think of instances where you've led a project or helped a colleague overcome a technical hurdle.

Be Ready for Technical Challenges

Expect to face some coding challenges or system design questions during the interview. Practice coding problems related to data pipelines and microservices, and be prepared to explain your thought process as you solve them.