We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities.The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies. You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementationsKey ResponsibilitiesDesign and develop the architecture for BestX's next-generation multi-asset TCA and analytics platformLead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologiesArchitect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native servicesDesign high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloadsEstablish best practices for data governance, lineage, security, metadata management, and platform observabilityBuild and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasetsWork closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutionsDefine architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloadsDrive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practicesDevelop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIRMentor engineering teams and provide technical leadership across strategic platform initiativesTake ownership of architecture decisions from concept through production deliveryCore Skills and ExperienceExperience in designing and implementing enterprise-scale data platforms.Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architectureStrong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilitiesExpertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworksProven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patternsExperience designing large-scale analytical platforms supporting high-volume and high-velocity datasetsStrong understanding of data architecture principles including dimensional modelling, Data Vault, Lakehouse methodologies, and distributed computingExperience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics servicesExperience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalentDeep understanding of data governance, security, lineage, and regulatory controls in financial services environmentsStrong software engineering and DevOps mindset, including CI/CD and Infrastructure-as-CodeExcellent stakeholder management and communication skills, capable of influencing architecture decisions across multiple teamsPreferred SkillsExperience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or DerivativesKnowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructureExperience with AI/ML platforms, feature stores, and MLOps frameworksExperience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architecturesExperience with data catalogue and governance platformsExposure to modern visualisation and BI tools such as Power BI, Tableau, Sigma, or ThoughtSpotExperience leading cloud migration or platform modernisation initiativesExperience operating in highly regulated financial services environmentsAbout State StreetAcross the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.Discover more information on jobs at StateStreet.com/careersRead our CEO StatementSummaryLocation: London, EnglandType: Full time
Senior Databricks / Snowflake Data Architect – BestX employer: State Street Bank
State Street Global Technology Services is an exceptional employer that prioritises employee growth and inclusivity, offering a dynamic work environment in London. With a strong commitment to professional development, flexible work-life balance, and vibrant employee networks, we empower our team members to thrive while driving impactful change in the financial services sector. Join us to be part of a culture that values collaboration, accountability, and innovation, ensuring that every voice is heard and every contribution matters.
