Junior Data Engineer

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment

Key Responsibilities

Data Pipeline Development

• Contribute to the design, building, and maintenance of scalable data pipelines

• Implement ETL (Extract, Transform, Load) processes to ingest data from various sources

• Ensure data quality, integrity, and reliability through thorough testing and validation

Database Management

• Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes)

• Monitor and assist in maintaining database performance and security

Data Integration:

• Collaborate with data analysts and scientists to integrate and consolidate data from multiple sources

• Assist in developing APIs and other interfaces for data access and manipulation

Documentation and Reporting:

• Document data processes, pipelines, and architectures

• Generate reports and visualisations to communicate data insights and pipeline performance

Technical Support:

• Provide technical support for data-related issues and troubleshoot problems as they arise

• Assist in the implementation of data governance and compliance policies

Continuous Improvement:

• Actively learn about and stay up to date with emerging trends and technologies in data engineering

• Participate in code reviews and contribute to the continuous improvement of data engineering practices within the team

Qualifications, Skills and Experience Educational Background:

• Bachelor’s degree in computer science, Engineering, Information Technology, or a related field

• Relevant certifications in data engineering or cloud platforms (e.g., AWS, Azure, Google Cloud, Databricks) are a strong plus

Technical Skills:

• Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL)

• Familiarity with data pipeline and workflow management tools (e.g., Apache Airflow)

• Experience with programming languages such as Python, Java, or Scala. Python is highly preferred

• Basic understanding of cloud platforms and services (e.g., AWS, Azure, Google Cloud)

• Knowledge of big data technologies (e.g., Spark) is a plus

Analytical Skills:

• Strong problem-solving skills and attention to detail

• Ability to analyse data sets and identify patterns or anomalies

Soft Skills:

• Excellent communication and teamwork skills, with a collaborative mindset.

• Eagerness to learn, adapt to new technologies, and grow within the data engineering field.

• Ability to manage multiple tasks effectively and meet deadlines.

Experience:

• 0-2 years of experience in data engineering, data analysis, or a related technical field

• Internship, co-op, significant project experience in data engineering or building data pipelines is highly desirable