MS Purview Engineer

We are looking for a hands‑on Microsoft Purview Engineer with strong Data Governance and Data Catalogue experience. The ideal candidate will possess deep expertise in API integrations, configuration management, metadata governance and Azure DevOps, EKS AKS implementation, CI/CD automation. They must be capable of implementing and supporting Microsoft Purview across development and production environments, maintaining configuration repositories and rollback procedures, developing custom connectors, enabling data lineage, documenting manual configurations, and producing comprehensive operational knowledge articles and support documentation. This is a highly technical role requiring strong Azure, automation, governance, and production support experience.

Role Summary

We are seeking an experience and expertise in Microsoft Purview, Azure DevOps, Data Governance, and Data Catalog solutions. The successful candidate will be responsible for the deployment, automation, configuration management, operational support, and continuous improvement of the Microsoft Purview platform.

The role requires someone who can perform hands‑on technical implementation, manage infrastructure and configuration changes, automate deployments through CI/CD pipelines, configure APIs and custom connectors, support data lineage capabilities, maintain configuration repositories, document manual changes, and provide production support across development, test, and production environments.

Key Responsibilities

• Ability to implement Multi‑cloud Integration primarily with AWS hosted Datasets.
• Configure, administer, and support Microsoft Purview environments.
• Implement and manage Data Catalog, Data Governance, Metadata Management, and Data Lineage solutions.
• Configure Collections, Data Sources, Classifications, Glossaries, Domains, and Governance Assets.
• Support Purview scanning, metadata ingestion, and discovery processes.
• Troubleshoot Purview platform issues and perform root cause analysis.

DevOps & Automation

• Design and maintain Azure DevOps CI/CD pipelines.
• Automate deployment and configuration using Infrastructure as Code (IaC).
• Create automated release pipelines across Development, Test, UAT, and Production environments.
• Implement version‑controlled configuration management and rollback mechanisms.
• Maintain deployment artefacts and release documentation.
• Support automated validation and testing of Purview configurations.

Configuration Management

• Maintain repository of Purview configuration files.
• Record and track manual configuration changes.
• Create configuration baselines and environment comparisons.
• Support rollback and recovery of previous configurations.
• Manage release approvals and change control processes.

API & Integration Development

• Configure and integrate REST APIs with Microsoft Purview.
• Develop custom connectors and metadata ingestion solutions.
• Integrate Purview with Datasets:
• Microsoft Fabric
• Databricks
• SQL Server
• Synapse Analytics
• Power BI
• Third‑party data sources
• AWS RDS
• MongoDB
• AWS S3 buckets
• Support API authentication, service principals, managed identities, and security controls.
• Configure and maintain end‑to‑end data lineage.
• Support business and technical data cataloguing.
• Improve visibility of data assets and data flows.
• Collaborate with data architects and governance teams.

Production Support

• Monitor platform health and operational performance.
• Proactively identify platform risks and optimisation opportunities.
• Participate in incident management and recovery activities.
• Support disaster recovery and business continuity procedures.

Documentation & Knowledge Management

• Create and maintain:
• Knowledge Base Articles
• Configuration Guides
• Standard Operating Procedures
• Runbooks
• Support Documentation
• Deployment Guides
• Technical Design Documents
• Document manual configurations and ensure knowledge transfer across teams.

Microsoft Technologies

• Microsoft Purview
• Microsoft Fabric
• Power BI

DevOps & Automation

• CI/CD
• Git
• Infrastructure as Code
• ARM Templates
• Bicep
• Terraform
• PowerShell

Data Governance

• Data Governance
• Metadata Management
• Data Classification
• Data Quality
• Information Governance

Integration Development

• REST APIs
• Microsoft Graph API
• Purview APIs
• OAuth 2.0
• Managed Identities
• Custom Connectors

Scripting & Development

• PowerShell
• Python
• JSON
• YAML

Required Experience

• 5+ years working in DevOps or Platform Engineering.
• 3+ years implementing and supporting Microsoft Purview.
• Experience implementing automated deployment and rollback processes.
• Experience configuring APIs and custom metadata connectors.
• Experience supporting data lineage and metadata ingestion.
• Experience working within Agile delivery teams.
• Experience supporting production environments.
• Microsoft Fabric implementation experience.
• Knowledge of DAMA‑DMBOK principles.
• Experience with Databricks.
• Experience with Informatica, Collibra, Alation, or similar cataloguing tools.
• Experience working within UK Government or highly regulated organisations.

The successful candidate will be able to:

Deploy and manage Microsoft Purview environments

Build and maintain Azure DevOps deployment pipelines

Implement version‑controlled Purview configuration management

Roll back configurations safely when required

Develop and maintain custom connectors and API integrations

Configure and support Data Lineage capabilities

Record and document all manual configuration activities

Produce high‑quality Knowledge Base and operational documentation

Support production deployments and platform stability

#J-18808-Ljbffr