At a Glance
- Tasks: Lead the design of BestX's next-gen cloud-native data platform using Databricks and Snowflake.
- Company: Join BestX, a forward-thinking company shaping the future of data architecture.
- Benefits: Enjoy flexible work-life support, inclusive development opportunities, and vibrant employee networks.
- Other info: Be part of a collaborative environment that values innovation and personal growth.
- Why this job: Make a real impact in the financial services sector with cutting-edge technologies.
- Qualifications: Strong experience in data architecture, Databricks, Snowflake, and modern data engineering.
The predicted salary is between 72000 - 88000 £ per year.
We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities. The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies. You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementations.
Key Responsibilities
- Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform.
- Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies.
- Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services.
- Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads.
- Establish best practices for data governance, lineage, security, metadata management, and platform observability.
- Build and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasets.
- Work closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutions.
- Define architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloads.
- Drive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practices.
- Develop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIR.
- Mentor engineering teams and provide technical leadership across strategic platform initiatives.
- Take ownership of architecture decisions from concept through production delivery.
Core Skills and Experience
- Experience in designing and implementing enterprise-scale data platforms.
- Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture.
- Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities.
- Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks.
- Proven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patterns.
- Experience designing large-scale analytical platforms supporting high-volume and high-velocity datasets.
- Strong understanding of data architecture principles including dimensional modelling, Data Vault, Lakehouse methodologies, and distributed computing.
- Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services.
- Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent.
- Deep understanding of data governance, security, lineage, and regulatory controls in financial services environments.
- Strong software engineering and DevOps mindset, including CI/CD and Infrastructure-as-Code.
- Excellent stakeholder management and communication skills, capable of influencing architecture decisions across multiple teams.
Preferred Skills
- Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives.
- Knowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructure.
- Experience with AI/ML platforms, feature stores, and MLOps frameworks.
- Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures.
- Experience with data catalogue and governance platforms.
- Exposure to modern visualisation and BI tools such as Power BI, Tableau, Sigma, or ThoughtSpot.
- Experience leading cloud migration or platform modernisation initiatives.
- Experience operating in highly regulated financial services environments.
About State Street: Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.
Senior Databricks / Snowflake Data Architect – BestX employer: Statestreet
Statestreet provides a collaborative work environment that emphasizes mentorship and professional development. Employees have the opportunity to work with cutting-edge technologies and contribute to significant projects in the financial services sector. The company's focus on innovation and strategic direction makes it an attractive employer for those passionate about data architecture.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Databricks / Snowflake Data Architect – BestX
✨Get Involved in Data Science Meetups
Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Statestreet!
✨Show Off Your Projects
Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Databricks / Snowflake Data Architect – BestX at Statestreet.
✨Leverage Professional Networks
Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Statestreet.
✨Apply Directly through Our Website
When you find a suitable opening like Senior Databricks / Snowflake Data Architect – BestX at Statestreet, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!
We think you need these skills to ace Senior Databricks / Snowflake Data Architect – BestX
Some tips for your application 🫡
Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!
Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!
Craft a Tailored Cover Letter:For a full-time role at Statestreet, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.
Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Statestreet. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!
How to prepare for a job interview at Statestreet
✨Brush Up on Your Statistics
For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!
✨Showcase Your Projects
Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!
✨Get Comfortable with Python and R
Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Statestreet!
✨Prepare for Case Studies
Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.
