At a Glance
- Tasks: Develop ETL/ELT processes and migrate services to microservices for better design.
- Company: Join a forward-thinking tech company focused on big data solutions.
- Benefits: Competitive salary, flexible working hours, and opportunities for professional growth.
- Other info: Dynamic team culture with a focus on innovation and continuous learning.
- Why this job: Make an impact by working with cutting-edge technologies in a collaborative environment.
- Qualifications: 4+ years of Java experience and strong knowledge of ETL/ELT processes required.
The predicted salary is between 55000 - 70000 £ per year.
- Your Job
- Develop ETL and ELT jobs and processes.
- Support data analysis and design efforts within the wider team
- Migrate existing services to microservices, with the goal of reducing complexity at the design and architecture level
- Write unit and integration tests for your Java code
- Collaborate with testers in development of functional test cases
- Develop deployment systems for Java based systems
- Collaborate with product owners on user story generation and refinement
- Monitor and support the operation of production systems
- Participate in knowledge sharing activities with colleagues
- Pair programming and peer reviews
About You
- Required Experience
- Minimum 4 years of Java development experience in an Agile environment, building scalable applications and services with a focus on big data solutions and analytics
- 3+ year experience in developing ETL / ELT processes using relevant technologies and tools
- Experienced in working with data lakes and data warehouse platforms for both batch and streaming data sources
- ANSI SQL experience or other flavours of SQL
- Experience of unstructured, semi-structured and structured data processing
- A good understanding of ETL/ELT principles, best practices and patterns used
- Experienced in some big data technologies such as Hadoop, Spark and other Apache platform products
- Experience with RESTful services
- Passion for Test Driven Development
- CI/CD
- Exposure to data visualisation and Business Intelligence solutions
- Splunk
- CI/CD Build tools (Maven, Git, Jenkins)
- Text search engines (Lucene, Elastic Search)
- #J-18808-Ljbffr
We think you need these skills to ace Data Engineer (Java)
Java Development
ETL Processes
ELT Processes
Agile Methodologies
Big Data Solutions
Data Lakes
Data Warehousing
