At a Glance
- Tasks: Design and develop data pipelines to manage and automate data ingestion.
- Company: Join a leading talent acquisition consultancy with a focus on tech innovation.
- Benefits: Competitive salary, flexible working options, and opportunities for professional growth.
- Why this job: Make an impact by enhancing data quality and collaborating with top tech professionals.
- Qualifications: Experience in data engineering, programming, and familiarity with Big Data tools.
- Other info: Dynamic work environment with a focus on career advancement and skill development.
The predicted salary is between 28800 - 48000 £ per year.
Responsibilities:
- Orchestration ingestion and storage of raw data into structured or unstructured solutions.
- Design, develop, deploy and support data infrastructure, pipelines and architecture.
- Implement reliable, scalable, and tested solutions to automate data ingestion.
- Development of systems to manage batch processing and real-time streaming of data.
- Evaluate business needs and objectives.
- Support the implementation of data governance requirements.
- Facilitate pipelines, which prepare data for prescriptive and predictive modelling.
- Work with domain teams to scale the processing of data.
- Identify opportunities for data acquisition.
- Combine raw information from different sources.
- Manage and maintain automated tools for data quality and reliability.
- Explore ways to enhance data quality and reliability.
- Collaborate with data scientists, IT and architects on several projects.
Required Skillset:
- Technical expertise in designing, building, and maintaining data pipelines, data warehouses, and leveraging data services.
- Proficient in DataOps methodologies and tools, including experience with CI/CD pipelines, containerisation, and workflow orchestration.
- Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.).
- Knowledge of programming languages (e.g. Java, Python, SQL).
- Hands-on experience with SQL/NoSQL database design.
- Degree in STEM, or similar field; a master's is a plus.
- Data engineering certification (e.g. IBM Certified Data Engineer) is a plus.
Data Engineer in Edinburgh employer: Advanced Resource Managers
Contact Detail:
Advanced Resource Managers Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer in Edinburgh
✨Tip Number 1
Network like a pro! Reach out to folks in the data engineering field on LinkedIn or at meetups. We can’t stress enough how personal connections can lead to job opportunities that aren’t even advertised.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your data pipelines, projects, and any cool stuff you’ve built. We love seeing practical examples of what you can do, so make sure to highlight your best work.
✨Tip Number 3
Prepare for those interviews! Brush up on your technical knowledge and be ready to discuss your experience with tools like Spark and Airflow. We recommend practicing common data engineering interview questions to boost your confidence.
✨Tip Number 4
Apply through our website! It’s the easiest way to get your application noticed. We’re always on the lookout for talented data engineers, so don’t hesitate to throw your hat in the ring!
We think you need these skills to ace Data Engineer in Edinburgh
Some tips for your application 🫡
Tailor Your CV: Make sure your CV speaks directly to the Data Engineer role. Highlight your experience with data pipelines, ETL/ELT frameworks, and any relevant tools like Spark or Airflow. We want to see how your skills match our needs!
Showcase Your Projects: Include specific examples of projects you've worked on that demonstrate your technical expertise. Whether it's building a data warehouse or automating data ingestion, we love seeing real-world applications of your skills.
Keep It Clear and Concise: When writing your application, clarity is key! Use straightforward language and avoid jargon unless it’s relevant. We appreciate a well-structured application that gets straight to the point.
Apply Through Our Website: Don’t forget to submit your application through our website! It’s the best way for us to receive your details and ensures you’re considered for the role. We can’t wait to hear from you!
How to prepare for a job interview at Advanced Resource Managers
✨Know Your Data Tools
Make sure you brush up on your knowledge of data tools like Spark, Airflow, and Hive. Be ready to discuss how you've used these in past projects, as well as any challenges you faced and how you overcame them.
✨Showcase Your Pipeline Skills
Prepare to talk about your experience with designing and maintaining data pipelines. Have specific examples ready that demonstrate your ability to implement reliable and scalable solutions, especially in relation to CI/CD methodologies.
✨Understand the Business Needs
Familiarise yourself with the company's objectives and how your role as a Data Engineer can support them. Think about how you can evaluate business needs and translate them into technical requirements during the interview.
✨Collaboration is Key
Be prepared to discuss your experience working with cross-functional teams, including data scientists and IT professionals. Highlight any successful collaborations and how they contributed to project outcomes, as teamwork is crucial in this role.