The financial domain/banking is a must in recent projects. Infrastructure & Deployment Pipelines: Build, automate, and maintain CI/CD pipelines for data ingestion and processing workflows. Set up efficient deployment pipelines for data pipelines in development and production. Provide DevOps support and expertise to optimize the development lifecycle. Implement tools and processes for continuous monitoring, logging, and performance tuning of data pipelines. Develop fault-tolerant and scalable solutions for managing terabytes of data daily. Environment Automation: Utilize Infrastructure as Code (IaC) to ensure repeatable and consistent infrastructure deployment (e.g., Develop and maintain comprehensive documentation of DevOps workflows, processes, and systems. Security & Compliance: Ensure deployment infrastructure meets data security and compliance standards. Implement role-based access control and security policies for development and production environments. 5+ years as Azure DevOps ~ Strong experience with Azure DevOps tools (Azure Pipelines, Repos, etc.). ~ Azure Data Lake, Azure Event Hubs, Azure Databricks ~ CI/CD pipeline design for data workflows ~ Performance monitoring and tuning for data engineering ~ Understanding of data governance and role-based access control (RBAC) ~
Contact Detail:
Vallum Associates Recruiting Team