Implementing a data product catalog, data lineage and data quality tests in Microsoft Purview.

Role: Data Quality Engineer Meridian Energy.

Achievements:

  • Minimised Time-to-Value: new analysts brought up to speed in minutes rather than months.

Responsibilities:

  • Built a data product catalog.
  • Identified critical data elements, defined business rules, ran data quality scans.
  • Mapped organisational structure, business processes, and technical assets.
  • Mapped business glossary to data domains.

Technology:

  • Microsoft Purview
  • Python
  • Databricks.

2024

Updated: