At a Glance
- Tasks: Design and develop high-performance data pipelines using Databricks, PySpark, and SQL.
- Company: Join a leading analytics firm transforming the financial sector with innovative solutions.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborate with a diverse team and make a real impact in the finance industry.
- Why this job: Be at the forefront of cloud migration and data engineering in a dynamic environment.
- Qualifications: Experience in data pipeline development and cloud technologies, especially Azure.
The predicted salary is between 70000 - 90000 £ per year.
Crisil Integral IQ delivers solutions and analytics to top financial institutions, driving strategic transformation, risk optimization, and operational excellence. Our offerings across research, risk, lending, analytics and operations have empowered clients to navigate complex markets, mitigate risks and unlock new opportunities. Our domain expertise, innovative solutions, and future-ready technologies such as AI and data science give clients the confidence to accelerate growth and achieve sustainable competitive advantage. Our globally diverse workforce operates in the Americas, Asia-Pacific, Europe, Australia and the Middle East.
We are looking for a Databricks Senior Developer who will join our Team supporting one of the biggest investment banks.
Key responsibilities:- Design and Develop Data Pipelines: Build scalable, high-performance data pipelines using Databricks, PySpark, and SQL. Develop and optimize ETL/ELT workflows for batch and streaming data processing.
- Lead Cloud Migration Initiatives: Drive and support the migration of on-premises data platforms to cloud environments (preferably Azure). Refactor legacy data pipelines and ensure seamless transition to modern cloud-based architectures. Convert and optimize legacy SQL dialects into Spark SQL for improved performance and scalability.
- Data Platform Engineering: Develop and manage data solutions within the Databricks Lakehouse architecture. Ensure reliability, scalability, and performance of data processing workloads in production environments.
Collaboration
Databricks Senior Developer employer: Crisil Integral IQ
Crisil Integral IQ is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration among a globally diverse workforce. With a strong focus on employee growth, we provide ample opportunities for professional development and the chance to work with cutting-edge technologies in a supportive environment. Located in a vibrant financial hub, our team members enjoy not only competitive benefits but also the unique advantage of contributing to transformative projects for leading investment banks.
