We are hiring: Data Engineer – Spark & Scala
Location: Glasgow, UK – Hybrid (2–3 days onsite)
- Strong hands-on experience with Apache Spark and Scala for processing, transforming and validating large-scale datasets.
- Experience developing and maintaining data pipelines and orchestration workflows using Apache Airflow.
- Proficiency in Python, SQL and PostgreSQL for data processing, validation, reconciliation and troubleshooting.
- Experience with production support, investigating failed workflows, data mismatches, missing files and pipeline failures.
- Familiarity with GitLab, CI/CD, Docker and controlled software release practices.
- Understanding of data quality, monitoring, logging, auditability and operational resilience.
- Experience with Starburst/Trino, AWS S3, Kubernetes or OpenShift would be an advantage.
Key Skills: Apache Spark / Scala / Python / Apache Airflow / SQL / PostgreSQL / Starburst / Trino / GitLab / CI/CD / Docker / Data Engineering / Production Support
#J-18808-Ljbffr
Data Engineer - Spark & Scala in Glasgow employer: GIOS Technology
Join our dynamic team in Salisbury as a Human Resources Administrator, where we prioritise employee well-being and professional growth. Our hybrid work model promotes a healthy work-life balance, while our supportive culture fosters collaboration and innovation. With opportunities for development and a commitment to excellence in customer service, we are dedicated to creating a rewarding environment for all employees.
