At a Glance
- Tasks: Design and develop data pipelines, manage data ingestion, and support data infrastructure.
- Company: Leading tech consultancy in Edinburgh with a focus on innovation.
- Benefits: Competitive pay, flexible working hours, and opportunities for professional growth.
- Why this job: Join a dynamic team and work on impactful data projects that shape the future.
- Qualifications: Experience in data engineering, programming skills, and knowledge of data tools required.
- Other info: 6-month contract with potential for career advancement in a fast-paced environment.
The predicted salary is between 44 - 66 £ per hour.
Overview
Location: Edinburgh
Contract Duration: 6-Month contract
Pay: Up to £55p/h (Inside IR35)
Please note - due to the nature of the work, you will need to hold or be eligible to obtain a high level of UK Security clearance - please only apply if suitable.
Responsibilities:
- Orchestration ingestion and storage of raw data into structured or unstructured solutions.
- Design, Develop, Deploy and Support data infrastructure, pipelines and architecture.
- Implement reliable, scalable, and tested solutions to automate data ingestion.
- Development of systems to manage batch processing and real-time streaming of data.
- Evaluate business needs and objectives.
- Support the implementation of data governance requirements.
- Facilitate pipelines, which prepare data for prescriptive and predictive modelling.
- Working with domain teams to scale the processing of data.
- Identify opportunities for data acquisition.
- Combine raw information from different sources.
- Manage and maintain automated tools for data quality and reliability.
- Explore ways to enhance data quality and reliability.
- Collaborate with data scientists, IT and architects on several projects.
Qualifications:
- Technical expertise in designing, building, and maintaining data pipelines, data warehouses, and leveraging data services.
- Proficient in DataOps methodologies and tools, including experience with CI/CD pipelines, containerisation, and workflow orchestration.
- Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.)
- Knowledge of programming languages (e.g. Java, Python, SQL).
- Hands-on experience with SQL/NoSQL database design.
- Degree in STEM, or similar field; a master's is a plus.
- Data engineering certification (e.g. IBM Certified Data Engineer) is a plus.
Data Engineer in Edinburgh employer: Advanced Resource Managers Ltd
Contact Detail:
Advanced Resource Managers Ltd Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer in Edinburgh
✨Tip Number 1
Network like a pro! Reach out to folks in the data engineering field on LinkedIn or at local meetups. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your data pipelines and projects. This is a great way to demonstrate your expertise and make a lasting impression during interviews.
✨Tip Number 3
Prepare for technical interviews by brushing up on your DataOps methodologies and tools. Practice coding challenges and be ready to discuss your experience with ETL/ELT frameworks and big data processing tools.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might just be the perfect fit for you. Plus, it’s a straightforward way to get your application noticed.
We think you need these skills to ace Data Engineer in Edinburgh
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the Data Engineer role. Highlight your experience with data pipelines, ETL/ELT frameworks, and any relevant programming languages like Python or SQL. We want to see how your skills match what we're looking for!
Showcase Your Projects: Include specific projects where you've designed or maintained data infrastructure. If you've worked with tools like Spark or Airflow, let us know! Real-world examples can really make your application stand out.
Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points for your skills and experiences to make it easy for us to read. We appreciate a well-structured application that gets straight to the good stuff!
Apply Through Our Website: Don't forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, it’s super easy to do!
How to prepare for a job interview at Advanced Resource Managers Ltd
✨Know Your Data Tools
Make sure you brush up on your knowledge of data tools like Spark, Airflow, and Hive. Be ready to discuss how you've used these in past projects, as well as any challenges you faced and how you overcame them.
✨Showcase Your Coding Skills
Since programming is key for a Data Engineer, be prepared to demonstrate your proficiency in languages like Java, Python, and SQL. You might even be asked to solve a coding problem on the spot, so practice some common algorithms and data structures beforehand.
✨Understand Data Governance
Familiarise yourself with data governance principles and be ready to discuss how you've implemented these in previous roles. Companies want to know that you can ensure data quality and compliance, so have examples ready to share.
✨Prepare for Scenario Questions
Expect scenario-based questions where you'll need to evaluate business needs and propose data solutions. Think about past experiences where you identified opportunities for data acquisition or improved data processing, and be ready to explain your thought process.