Data Engineer/Architect - Apache Airflow - Astronomer
Location: London - 3 days a week onsite (non-negotiable)
Duration: 6 Months
Rate: £700-£800 per day Inside IR35
The Role
We're supporting a highly reputable client in the Financial Services industry who are seeking an experienced Data Engineer to support them through a period of significant change across their Technology Delivery function.
The team are in the early stages of adopting Apache Airflow and Astronomer as their core orchestration platform/tooling for their DBT projects. To move forward with the process and maximise the tooling, the team require an Engineer with expertise in this field to take technical ownership of establishing Astronomer as a production-ready, scalable, observable and cost-effective orchestration capability, working alongside our existing Data Engineering and platform teams. Responsibilities will include:
- Defining reusable Architectural and Orchestration patterns for DBT and Snowflake Workloads
- Establishing appropriate security, secrets, RBAC and environment controls
- Implement monitoring, alerting and observability covering platform and workload health.
- Defining reliable integration patterns between Airflow and our client's wider enterprise scheduling environment (Autosys etc)
- Provide upskilling and documentation to the wider team to aid with the option of Apache Airflow / Astronomer Cosmos
Essential Experience
- Highly experienced Data Engineer/Architect with a broad range of enterprise environment experience
- Strong background with DBT, Snowflake and Python
- Previous experience working with Apache Airflow and Astronomer, with a strong preference towards Astronomer Cosmos experience
- Experience on an Airflow/Astronomer implementation would be preferred
- Excellent communication and stakeholder engagement skills
Desirable Experience
- Experience supporting client's in the Financial Services sector
- Enterprise scheduler tooling experience, with a preference towards AutoSys
- CI/CD, testing and deployment experience
- Azure DevOps and/or Github Actions experience
Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.
#J-18808-Ljbffr
Data Engineer/Architect - Apache Airflow - Astronomer in City of London employer: Akkodis
As a Power Platform Architect with us, you'll join a forward-thinking organisation in London that values innovation and collaboration. We offer a dynamic hybrid work environment, competitive daily rates, and a culture that fosters professional growth through challenging projects and continuous learning opportunities. Our commitment to employee development and a supportive atmosphere makes us an excellent employer for those seeking meaningful and rewarding careers in business intelligence.
