Add notebook-governance-sempy: tenant-wide lakehouse table inventory using SemPy - #604
Open
dataassets1 wants to merge 4 commits into
Open
Add notebook-governance-sempy: tenant-wide lakehouse table inventory using SemPy#604dataassets1 wants to merge 4 commits into
dataassets1 wants to merge 4 commits into
Conversation
9 tasks
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a new SemPy-based governance notebook sample that inventories lakehouse tables tenant-wide (scoped to the executing identity) and exposes the results as a Spark temp view (fabric_lakehouse_inventory) for ad-hoc SQL querying inside Microsoft Fabric notebooks.
Changes:
- Added
get-tables.pyto enumerate workspaces → lakehouses → tables viasempy.fabricand publish the inventory as a Spark temp view. - Added README documentation describing usage, output, example query, and known limitations.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 4 comments.
| File | Description |
|---|---|
| samples/notebook-governance-sempy/get-tables.py | New SemPy-driven inventory notebook script that builds and registers the fabric_lakehouse_inventory temp view. |
| samples/notebook-governance-sempy/README.md | Documentation for running the notebook and querying the resulting inventory view. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
…1/fabric-toolbox into fabric-notebook-sempy
Author
|
Copilot's comments are resolved. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pull Request (PR) description
Supersedes #509 — same tool, rewritten with Semantic Link (SemPy) instead of raw Fabric REST API calls. All review feedback from #509 and #483 is incorporated.
Adds
samples/notebook-governance-sempy/— the first of a planned set of governance notebooks built on SemPy / the Fabric REST API. This notebook builds a tenant-wide inventory of all lakehouse tables and registers it as a Spark temp view (fabric_lakehouse_inventory) for direct SQL querying.Why the rewrite:
sempy.fabrichandles auth, pagination, and retries natively, reducing the code to a fraction of the REST version while staying aligned with the library Microsoft ships in Fabric notebooks.Added
samples/notebook-governance-sempy/— notebook + README (usage, output schema, example queries, known limitations)Task list