At a Glance
- Tasks: Develop and maintain ETL jobs on large datasets using Python and SQL.
- Company: Join a forward-thinking tech company focused on innovation and collaboration.
- Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
- Other info: Collaborative team culture with mentorship and career advancement opportunities.
- Why this job: Make an impact by creating scalable data solutions in a dynamic environment.
- Qualifications: 1+ years of SQL and Python experience; eagerness to learn and grow.
The predicted salary is between 60000 - 80000 £ per year.
Responsibilities
- Develop and maintain a mix of real time and batch ETL jobs on a large and complex dataset.
- Use and continue to develop your Python and SQL skills to ensure data accuracy, integrity, and scalability.
- Engage in continuous improvements to develop innovate and scalable data solutions.
- Participate in code reviews, pairing and mentoring with experienced engineers.
- Work with the team to understand requirements and manage and organise priorities effectively.
- Continually review and measure the performance of the data pipeline and evaluate improvements in design, architecture and tooling.
- Design and develop ETL, infrastructure as code and automation scripts that follow industry best practices and standards.
- Support and identify improvements to the deployed production systems to ensure high application uptime and stability.
- Monitor application performance to handle increases in scale and data volumes.
- Maintain clear documentation for datasets, logic, processes and known issues.
- Collaborate with internal engineering, product and operations teams to align on scope and deliverables.
- Adhere to Company Policies and Procedures with respect to Security, Quality and Health & Safety.
Requirements
- 1+ years of SQL and Python professional development experience as a Data Engineer, preferably using AWS or Google Cloud Platform.
- A self-motivated and proactive learner with a growth mindset, who is keen to develop and progress their data engineering career.
- Strong analytical and communication skills to take a data driven approach in presenting decisions to stakeholders.
- The ability to problem-solve and break down complex problems, whilst working on large and complex datasets.
- Someone who is flexible and agile, ready to adapt to changes when things don’t go to plan.
- Knowledge of agile software development best practices including continuous integration, automated testing and working with software engineering requirements and specifications.
- Good interpersonal skills, positive can-do attitude and willing to help other members of the team.
- Experience using Apache Spark (scala or python) is preferred, however training will be provided.
- Exposure to using AI tools to enhance productivity and quality of coding, reviews and documentation.
- #J-18808-Ljbffr
We think you need these skills to ace Junior Data Engineer in Manchester
Python
SQL
Problem-Solving Skills
Communication Skills
Data Engineering
Data Pipeline Development
API Integration
