Location-Basildon, UK -5 days from Office
JD:
Mandatory Skills :
AWS Lambda, Datalake house Architecture, ETL Concepts
Overview
- We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build
- Data Lakehouse Engineer and optimize scalable Lakehouse and data platform solutions that enable data driven decision-making across the organization.
- You will collaborate closely with cross functional teams to create resilient ingestion and transformation pipelines while ensuring reliability performance and highquality data across the ecosystem
Key Responsibilities
- Contribute to the design and implementation of Lakehouse integration architectures including data flows process flows and ELT/ETL patterns
- Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers
- Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle
- Monitor troubleshoot and finetune data workflows compute jobs and storage layers to ensure high performance and reliability
- Provide production support ensuring robust system observability with proactive detection and resolution of issues
- Collaborate with platform analytics and engineering teams to ensure efficient data modeling table design and storage optimization eg Iceberg Delta patterns
Technical Qualifications
- 7 years of experience in a data engineering or similar role within a fast paced enterprise scale environment
- Bachelors or Masters degree in Computer Science Data Engineering or a related technical field
- Strong Proficiency in SQL and Data Integration Platforms such as IBM Streamsets or Informatica with thorough understanding of data transformation and orchestration processes
- Extensive Experience with AWS services including IAM Lambda EKS S3 Data Lake EMR PySpark MWAA and Lakehouse technologies, Apache Iceberg
- Proven expertise with Snowflake including performance tuning and efficient query design Experience with batch pipelines eg StreamSets and streaming technologies eg Kafka
Nice to have
- Data Transformation Frameworks such as DBT
- Experience with both batch StreamSets and streaming Kafka data solutions
- Familiarity with data modelling concepts Inmon Kimball Data Vault etc
- Exposure to CICD or Infrastructure a scode Terraform or any other is a plus
- Application Performance Monitoring Framework experience is a plus
- Knowledge of data quality and security best practices is advantageous
- Ability to understand complex architecture solutions and make sound estimates for the implementation
Non Technical Skills
- Strong attention to detail with a proactive approach to identifying and resolving problems
- A genuine interest in emerging data technologies and a curiosity about continuous improvements
- Excellent verbal and written communication skills
- Attention to detail mindset proactively identify problems evaluate solutions
- Comfort working in an AI empowered automation driven environment
Skills
Mandatory Skills :
AWS Lambda, Data lakehouse Architecture, ETL Concepts
#J-18808-Ljbffr
AWS Data Engineer in Basildon employer: PURVIEW
Purview is an excellent employer that fosters a collaborative and innovative work culture, where mobile engineers can thrive while developing cutting-edge applications for workplace solutions. With a strong focus on employee growth, Purview offers opportunities for professional development and skill enhancement, all within a supportive environment that values teamwork and creativity. Located in a vibrant area, employees enjoy a dynamic atmosphere that encourages work-life balance and engagement with the community.
