At a Glance
- Tasks: Design and build scalable data pipelines using Databricks and cloud-native platforms.
- Company: Join a leading tech firm in London with a focus on innovation.
- Benefits: Competitive salary, bonuses, and opportunities for professional growth.
- Other info: Dynamic work environment with a focus on collaboration and career advancement.
- Why this job: Make an impact by integrating legacy systems with modern data architectures.
- Qualifications: Strong experience with Databricks, data lakes, and streaming technologies.
The predicted salary is between 80000 - 100000 £ per year.
Senior Databricks Architect
Technology: Databricks (Spark, Py Spark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus).
Job Description
We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture.
The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products.
- Primary Skills
- Strong experience with Databricks (Spark, Py Spark/SQL) and data lake architectures.
- Hands‑on experience with streaming technologies, especially Kafka / Confluent Kafka.
- Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.
- Working knowledge of AWS data services, especially S3.
- Understanding of data product thinking, data mesh concepts, and modern data engineering best practices.
Key Responsibilities
- Build and maintain batch and streaming data pipelines from legacy mainframe DB2 and on‑prem SQL Server systems into an AWS‑based data lake.
- Implement real‑time ingestion using Confluent Kafka and land data in Amazon S3.
- Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold).
- Design and deliver high‑quality, reusable data products aligned to data mesh principles.
- Ensure data quality, reliability, security, and governance across pipelines.
- Collaborate with domain teams, platform teams, and stakeholders to enable self‑serve analytics and consumption.
- Good to Have
- Experience in banking or financial services data platforms.
- Familiarity with data governance, metadata management, and regulatory reporting.
- Personal Qualities
- High analytical skills.
- A high degree of initiative and flexibility.
- High customer orientation.
- High quality awareness.
- Excellent verbal and written communication skills.
Facts of employment at Infosys are based on merit, competence and performance. Infosys is proud to be an equal opportunity employer.
#J-18808-Ljbffr
Senior Technology Architect_ Databricks in London employer: Infosys Limited
At Infosys, we pride ourselves on being an exceptional employer, particularly for the Quality Engineering Lead role in Leeds. Our vibrant work culture fosters collaboration and innovation, while our commitment to employee growth ensures that you will have ample opportunities to develop your skills and advance your career. With competitive compensation, including bonuses, and a focus on diversity and inclusion, we create a rewarding environment where you can thrive both personally and professionally.
