Salary: £105,000 - 130,000 per year
Requirements
- Bachelors Degree in Computer Science, Engineering, or related field (or equivalent practical experience).
- 4-6 years of relevant experience in Data Engineering.
- Expertise in SQL, especially within cloud-based data warehouses like Snowflake, API-integrated data pipelines using Python.
- Hands-on experience with AWS technologies such as AWS Lambda/Glue, S3, and CloudFormation.
- Familiarity with cloud data warehouse platforms such as Snowflake, developing data pipelines in DBT (Data Build Tool); or other ETL/ELT tools, languages, and frameworks is a plus.
- Working knowledge of version controlling tools, CI/CD processes and deployments using tools such as GitHub, Git Actions, Terraform.
- Experience working with semi-structured and unstructured data formats such as JSON and XML.
- Familiarity with Data orchestration tools such as Airflow.
- Experience working in Agile/Scrum environments is preferred.
- Experience within GenAI space is a plus.
Responsibilities
- Design, build, test, and maintain data pipelines while managing the data platform.
- Develop integrations from diverse data sources including on-premises systems and external APIs.
- Support and troubleshoot production processes.
- Contribute to scalable pipeline design and resolve data discrepancies.
- Ensure SLAs are met while continuously improving data models, code efficiency, and data quality.
- Adhere to best practices in data integrity, testing, security, and documentation.
- Continuously expand technical expertise and stay current with evolving tools and platforms.
Technologies
- Airflow
- API
- AWS
- Lambda
- CI/CD
- Cloud
- Data Warehouse
- ETL
- Git
- GitHub
- JSON
- Python
- SQL
- Security
- Snowflake
- Terraform
- XML
- dbt
- Spark
Global IT Data Engineer in England employer: Boston Consulting Group
Boston Consulting Group is an exceptional employer that offers a unique Medical Elective Internship in London, providing medical students with invaluable insights into healthcare management. With a strong focus on employee growth and collaboration, BCG fosters a dynamic work culture where diverse perspectives drive innovation and transformation in the healthcare sector. Interns will benefit from exposure to industry leaders, cutting-edge technologies, and the opportunity to tackle real-world challenges, all while being part of a globally respected firm committed to shaping a sustainable future.
