In order to make an application, simply read through the following job description and make sure to attach relevant documents.
Experience: 6–10+ Years
Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance
Role Summary
We are looking for an experienced MDM / Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records, entity resolution, data quality, governance, and cross-platform data integration.
Key Responsibilities
· Design and implement MDM solutions, including common IDs, Golden Records, entity matching, deduplication, and survivorship rules.
- Integrate data from multiple source systems into the Databricks Lakehouse.
- Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake.
- Build and enhance Bronze, Silver, and Gold data layers.
- Implement data quality, standardization, reconciliation, and validation processes.
- Support Unity Catalog, data lineage, access controls, cataloguing, and data governance.
- Implement data masking and anonymization for sensitive data.
- Build trusted, reusable data layers for cross-platform analytics and intelligence.
- Collaborate with business, architecture, and engineering teams to define MDM and data integration requirements.
Required Skills
· Strong experience in Master Data Management (MDM) and data engineering.
- Hands-on expertise in Databricks, PySpark, SQL, Delta Lake, and Lakehouse architecture.
- Experience with Golden Records, common IDs, entity resolution, deduplication, and data quality.
- Good understanding of Unity Catalog, data governance, metadata, and lineage.
- Experience integrating data from multiple enterprise platforms.
- Knowledge of Medallion Architecture and data privacy/anonymization.
Good to Have
· Experience with Informatica MDM/IDMC, Reltio, Profisee, Semarchy, or similar MDM platforms. xgikmsk
- Cloud experience with Azure, AWS, or GCP.
- E Please click on the apply button to read the full job description
Databricks Data Engineer employer: Response Informatics
As a Credit Collections Specialist at our company, you will thrive in a dynamic work environment that prioritises employee development and collaboration. We offer competitive benefits, a supportive culture that encourages innovation, and ample opportunities for professional growth, all while being located in a vibrant area that fosters both personal and career advancement.
