At a Glance
- Tasks: Build and optimise data pipelines using AWS and Databricks for innovative projects.
- Company: Join a forward-thinking company investing in technology and new products.
- Benefits: Enjoy 22-25 days holiday, staff discounts, and fun team events.
- Other info: Dynamic work environment with opportunities for growth and learning.
- Why this job: Make an impact in data engineering while collaborating with passionate teams.
- Qualifications: Proficient in AWS, Databricks, Python, Scala, and SQL.
The predicted salary is between 50000 - 60000 £ per year.
This is an exciting opportunity for a Data Engineer to join a company who are constantly investing in new products and using technology to increase their market share! They are looking for someone to join their team who is enthusiastic about new ideas which they can't wait to share with their team and bring to life. As a Data Engineer, you'll focus on building and maintaining robust data pipelines within the AWS ecosystem, with a primary focus on the Delta Lakehouse Platform on Databricks.
Responsibilities:
- Data Ingestion: Build and optimize data ingestion pipelines using AWS services such as Lambda, Kinesis, and Glue.
- Data Transformation: Develop, maintain, and optimize transformation pipelines within our Delta Lake on Databricks.
- Data Modelling: Design and implement efficient and reliable data models to store and retrieve data.
- Collaboration: Work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver optimal solutions.
- Data Quality: Ensure the reliability, integrity, and timeliness of data by implementing best practices and quality checks.
- Performance Optimization: Optimize queries and improve performance of data retrieval operations.
- Technology Stewardship: Stay updated with the latest advancements in AWS, Databricks, and the data engineering field in general. Provide recommendations on the adoption of new tools and technologies.
Requirements:
- AWS Services: Proficiency in AWS services like Lambda, Kinesis, and Glue.
- Databricks & Delta Lake: Hands-on experience with Databricks and Delta Lakehouse architectures.
- Programming: Proficient in Python, Scala, and SQL for data engineering tasks.
- ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.
- Data Modelling: Experience in logical and physical data modelling with large datasets.
- Problem Solving: Strong analytical and problem-solving skills, with a focus on troubleshooting data issues.
Preferred Qualifications:
- Certification in AWS and/or Databricks.
- Experience in a similar role in the online retail industry.
- Knowledge of best practices in data governance and data security.
Benefits:
- 22 days holiday rising to 25
- Staff discounts & Friends and Family discounts
- Cycle to work scheme and Tech Scheme
- Breakfast and drinks provided
- Charity day per annum supported
- Summer and Christmas Parties
- Street food days
- Access to Perkbox portal
Apply now to find out more!
Location: Newcastle upon Tyne, Tyne and Wear, NE12 8BX
Salary: £50,000 - £60,000
Sector: Data
Type: Permanent
Posted: 10/23/2023
Data Engineer in Newcastle upon Tyne employer: Ronald James
As an Information Security Manager at our fast-growing B2B technology business, you'll thrive in a dynamic work culture that prioritises innovation and collaboration. We offer competitive benefits, including professional development opportunities and a commitment to employee growth, ensuring you can advance your career while making a meaningful impact on our governance and compliance strategies. Join us in a location that fosters creativity and teamwork, where your expertise will be valued and your contributions will drive our success.
