Senior Software Engineer - ETL Pipeline Orchestration Platform
Senior Software Engineer - ETL Pipeline Orchestration Platform

Senior Software Engineer - ETL Pipeline Orchestration Platform

Full-Time 36000 - 60000 £ / year (est.) No home office possible
Go Premium
Bloomberg L.P.

At a Glance

  • Tasks: Design and develop a user-friendly orchestration platform for data transformation.
  • Company: Join Bloomberg, a global leader in financial information and technology.
  • Benefits: Enjoy competitive salary, health benefits, and opportunities for remote work.
  • Why this job: Make an impact on innovative projects using cutting-edge technologies.
  • Qualifications: Experience in building scalable distributed systems and coding in Python or Go.
  • Other info: Collaborative environment with mentorship opportunities and career growth.

The predicted salary is between 36000 - 60000 £ per year.

Senior Software Engineer – ETL Pipeline Orchestration Platform

Location

London

Business Area

Engineering and CTO

Ref #

Description & Requirements

Bloomberg is a global leader in business and financial information, delivering trusted data, news, and insights that bring transparency, efficiency, and fairness to capital markets. Bloomberg\’s Data Technology Infrastructure Department designs and builds large-scale platforms to acquire financial reference and pricing data globally from various sources, delivering billions of data points daily to clients for investment analysis.

The ETL Pipeline Orchestration Platform team owns a low code platform that helps engineers and analysts author and manage data transformation, derivation, validation and database loading themselves. As adoption accelerates, we are redesigning key components to support further throughput and resiliency while maintaining the availability of the system.

What’s in it for you?

We are the connecting tissue across the various core capabilities offered by our sibling teams. If you join our team, you will be working on solving the fundamental problems in event-driven orchestration systems using both open source technologies as well as in-house ones. We are a multi-lingual team taking care of python applications, performant queue broker in Go to C-based Python extensions and everything in between. If you have a knack for distributed systems or a love for orchestration platforms, join us!

Future Initiatives

We would like to work on the following in this year and next:

  • Develop, deploy and integrate our internal priority queue system to mitigate head-of-line blocking issues and optimize the time to market for the most important tasks
  • Deprecate the on-cloud orchestration system by unifying with on-prem system
  • Component registration / management faculty to make the onboarding processing easier for the service owners
  • Introduce multi-tenancy with granular privileging for both pipeline creation and edit time as well as runtime
  • Better support and capability for creation of DAG in orchestration
  • Programmatic recipe creation, modification and interaction to be API first
  • LLM integration to assist in authoring ETL tasks

We’ll trust you to:

  • Work with us to design the user-friendly, fault tolerant and scalable orchestration platform
  • Participate in the full SDLC of various components and systems that make up of the orchestration platform
  • Familiarize yourself with the Data Processing / Analysis tasks taken on by the Data Department and systems developed by our sister teams
  • Have your antenna up and bring the latest development in OSS and capabilities into our stack
  • Mentor less experienced members of the team

You’ll need to have:

  • Demonstrable experience building fault tolerant and horizontally scalable distributed applications / systems dealing with distributed system specific concerns
  • Demonstrable experience writing production code in either Python, Go, Rust, JavaScript/TypeScript or Java
  • Strong problem solving skills

We’d love to see:

  • Knowledge of Database Systems and trade offs in the distributed systems
  • Familiarity with API Designs
  • Familiarity with Orchestration Frameworks such as Apache Airflow, Argo Workflows, Conductor etc.
  • Experience working with and designing systems utilizing AWS

Discover what makes Bloomberg unique – watch our for an inside look at our culture, values, and the people behind our success.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email

#J-18808-Ljbffr

Senior Software Engineer - ETL Pipeline Orchestration Platform employer: Bloomberg L.P.

Bloomberg is an exceptional employer, offering a dynamic work environment in the heart of London where innovation thrives. With a strong focus on employee growth, we provide opportunities for mentorship and collaboration within a diverse team dedicated to solving complex challenges in data technology. Our commitment to inclusivity and professional development, combined with the chance to work on cutting-edge projects in ETL pipeline orchestration, makes Bloomberg a rewarding place to advance your career.
Bloomberg L.P.

Contact Detail:

Bloomberg L.P. Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Software Engineer - ETL Pipeline Orchestration Platform

✨Tip Number 1

Network like a pro! Reach out to current employees at Bloomberg or in similar roles on LinkedIn. A friendly chat can give you insider info and might even lead to a referral, which is always a bonus!

✨Tip Number 2

Prepare for the technical interview by brushing up on your coding skills. Practice common algorithms and data structures, especially in Python or Go, as these are key for the role. We recommend using platforms like LeetCode or HackerRank to sharpen your skills.

✨Tip Number 3

Showcase your passion for distributed systems and orchestration platforms during interviews. Share your personal projects or contributions to open-source software that relate to the job. This will demonstrate your enthusiasm and expertise!

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team at Bloomberg.

We think you need these skills to ace Senior Software Engineer - ETL Pipeline Orchestration Platform

Python
Go
Rust
JavaScript
TypeScript
Java
Distributed Systems
Fault Tolerance
Scalability
API Design
Orchestration Frameworks
Database Systems
AWS
Problem-Solving Skills
Mentoring

Some tips for your application 🫡

Tailor Your CV: Make sure your CV reflects the skills and experiences that match the Senior Software Engineer role. Highlight your experience with distributed systems and any relevant technologies like Python or Go. We want to see how you can contribute to our ETL Pipeline Orchestration Platform!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to tell us why you're passionate about orchestration platforms and how your background aligns with our team's goals. Be genuine and let your personality come through – we love seeing the real you!

Showcase Your Problem-Solving Skills: In your application, don’t just list your skills; give us examples of how you've tackled complex problems in the past. We’re looking for those strong problem-solving skills that will help us design a fault-tolerant and scalable platform.

Apply Through Our Website: We encourage you to apply directly through our website. It’s the best way to ensure your application gets into the right hands. Plus, you’ll find all the details you need about the role and our team there!

How to prepare for a job interview at Bloomberg L.P.

✨Know Your Tech Stack

Make sure you’re well-versed in the technologies mentioned in the job description, especially Python, Go, and any orchestration frameworks like Apache Airflow. Brush up on your knowledge of distributed systems and be ready to discuss how you've tackled similar challenges in the past.

✨Showcase Problem-Solving Skills

Prepare to share specific examples of how you've solved complex problems in your previous roles. Use the STAR method (Situation, Task, Action, Result) to structure your answers, focusing on your contributions to building fault-tolerant systems.

✨Understand the Business Context

Familiarise yourself with Bloomberg’s role in the financial data landscape. Understanding how the ETL Pipeline Orchestration Platform fits into their broader business goals will help you articulate how you can contribute to their success.

✨Ask Insightful Questions

Prepare thoughtful questions that demonstrate your interest in the team and the projects they’re working on. Inquire about future initiatives or challenges they face, which shows you’re not just interested in the role but also in the company’s direction.

Senior Software Engineer - ETL Pipeline Orchestration Platform
Bloomberg L.P.
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>