At a Glance
- Tasks: Lead the design of a cutting-edge cloud-native data platform using Databricks and Snowflake.
- Company: Join BestX, a forward-thinking company at the forefront of data engineering.
- Benefits: Enjoy flexible work-life support, paid volunteer days, and inclusive development opportunities.
- Other info: Collaborate with diverse teams and drive innovation in a dynamic environment.
- Why this job: Shape the future of data architecture and make a real impact in financial services.
- Qualifications: Strong experience with Databricks, Snowflake, and modern data engineering technologies required.
The predicted salary is between 72000 - 88000 £ per year.
We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities. The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies. You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementations.
Key Responsibilities
- Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform.
- Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies.
- Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services.
- Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads.
- Establish best practices for data governance, lineage, security, metadata management, and platform observability.
- Build and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasets.
- Work closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutions.
- Define architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloads.
- Drive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practices.
- Develop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIR.
- Mentor engineering teams and provide technical leadership across strategic platform initiatives.
- Take ownership of architecture decisions from concept through production delivery.
Core Skills and Experience
- Experience in designing and implementing enterprise-scale data platforms.
- Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture.
- Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities.
- Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks.
- Proven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patterns.
- Experience designing large-scale analytical platforms supporting high-volume and high-velocity datasets.
- Strong understanding of data architecture principles including dimensional modelling, Data Vault, Lakehouse methodologies, and distributed computing.
- Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services.
- Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent.
- Deep understanding of data governance, security, lineage, and regulatory controls in financial services environments.
- Strong software engineering and DevOps mindset, including CI/CD and Infrastructure-as-Code.
- Excellent stakeholder management and communication skills, capable of influencing architecture decisions across multiple teams.
Preferred Skills
- Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives.
- Knowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructure.
- Experience with AI/ML platforms, feature stores, and MLOps frameworks.
- Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures.
- Experience with data catalogue and governance platforms.
- Exposure to modern visualisation and BI tools such as Power BI, Tableau, Sigma, or ThoughtSpot.
- Experience leading cloud migration or platform modernisation initiatives.
- Experience operating in highly regulated financial services environments.
About State Street
Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most.
Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.
Discover more information on jobs at /careers.
Senior Databricks / Snowflake Data Architect – BestX in Vauxhall employer: State Street Bank
State Street Global Technology Services is an exceptional employer that prioritises employee growth and inclusivity, offering a dynamic work environment in London. With a strong commitment to professional development, flexible work-life balance, and vibrant employee networks, we empower our team members to thrive while driving impactful change in the financial services sector. Join us to be part of a culture that values collaboration, accountability, and innovation, ensuring that every voice is heard and every contribution matters.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Databricks / Snowflake Data Architect – BestX in Vauxhall
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like State Street Bank!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Databricks / Snowflake Data Architect – BestX at State Street Bank.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like State Street Bank.
✨Apply Directly through Our Website
When you find a suitable opening like Senior Databricks / Snowflake Data Architect – BestX at State Street Bank, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Senior Databricks / Snowflake Data Architect – BestX in Vauxhall
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at State Street Bank, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at State Street Bank. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at State Street Bank
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at State Street Bank!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
