Data Engineer ( Python ) in Glasgow

Senior Delivery Manager (UK & Europe) at Smartedge Solutions, London, UK

Job Description: Data Engineer with strong experience to join our team to help a strategic banking client in various data transformation activities.

Role Location: Glasgow, Scotland, UK / Hybrid
Role Type: Contract

Key Responsibilities

• Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
• Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure.
• Demonstrate proficiency in coding skills, utilizing languages Python & SQL, to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations.
• Collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc.
• Develop various components in Python of our unified data pipeline framework.
• Contribute towards the establishment of best practices for the optimal and efficient usage of data across various on‑prem and cloud platforms.
• Assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.
• Monitor the performance of queries and data loads and perform tuning as necessary.
• Provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.
• Develop SQL-based data validation, reporting, analysis, etc. as required; generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
• Adhere to Agile practices throughout the solution development process.
• Design, build, and deploy databases and data stores to support organizational requirements.

Skills / Qualifications

• Experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
• Experience in data development and solutions in highly complex data environments with large data volumes.
• SQL / PLSQL experience with the ability to write ad‑hoc and complex queries to perform data analysis.
• Experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
• Experience developing solutions in a hybrid data environment (on‑Prem and Cloud).
• Hands‑on experience with developing data pipelines for structured, semi‑structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files, etc.).
• Experience with performance tuning SQL queries, Spark job, and stored procedures.
• An understanding of E‑R data models (conceptual, logical, and physical).
• Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
• Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
• Self‑starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever‑changing priority list and resolve conflicts to competing priorities.
• Strong problem‑solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

Contact

Connect with me or email me at mohit.r@smartedgesolutions.co.uk

Alternatively, you can call me on Tel: 44 2035002132