Skill v1.0.0
currentTrusted Publisher100/100version: "1.0.0" name: mlv-operations-cli description: > Manage refresh schedules, selected-lineage execution definitions, and job execution for existing Microsoft Fabric Materialized Lake Views (MLVs) via REST APIs. Configure, update, and delete schedules and execution definitions; trigger on-demand refreshes; monitor job status; and cancel running jobs. Use spark-authoring-cli to author MLV definitions. Discovery, visual lineage, and data quality metrics require the Lakehouse UI. Triggers: "schedule MLV refresh", "manage MLV refresh schedule", "trigger MLV refresh", "MLV job status", "cancel MLV refresh", "monitor MLV refresh", "recurring MLV refresh", "daily MLV refresh".
Telemetry — MANDATORY. Everyapi.fabric.microsoft.comcall must carryx-ms-fabric-skill: mlv-operations-cli(az rest:--headers "x-ms-fabric-skill=mlv-operations-cli"),including every LRO poll,fabric_lroand retry. Snippets omit it — add it anyway.
Update Check — ONCE PER SESSION (mandatory)The first time this skill is used in a session, run the check-updates skill before proceeding.- GitHub Copilot CLI / VS Code: invoke thecheck-updatesskill.- Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version.- Skip if the check was already performed earlier in this session.
CRITICAL NOTES1. To find the workspace details (including its ID) from workspace name: list all workspaces and, then, use JMESPath filtering2. To find the lakehouse details (including its ID) from workspace ID and lakehouse name: list all lakehouses in that workspace and, then, use JMESPath filtering3. MLV Discovery Gap: No public REST API currently lists MLVs in a lakehouse. For schedule CRUD/trigger/status, only workspace ID and lakehouse ID are needed. To refresh a subset of the lineage, first create or reuse an MLV execution definition and pass itsmlvExecutionDefinitionIdinexecutionData.
MLV Operations — CLI Skill
Terminology Mapping
Fabric has three materialized view concepts. Disambiguate by context:
| User context | User says | Actually means | Route to | |
|---|---|---|---|---|
| Spark / Lakehouse | "materialized view" | Materialized Lake View (MLV) | This skill (mlv-operations-cli) | |
| Spark / Lakehouse | "materialized lake view" | MLV | This skill | |
| Spark / Lakehouse | "spark materialized view" | MLV | This skill | |
| Spark / Lakehouse | "MV" or "MLV" | MLV | This skill | |
| Spark / Lakehouse | "CREATE MATERIALIZED LAKE VIEW" | MLV DDL (authoring) | spark-authoring-cli | |
| Spark / Lakehouse | "schedule my materialized view" | MLV scheduling | This skill | |
| Spark / Lakehouse | "refresh my views" | MLV on-demand refresh | This skill | |
| KQL / Eventhouse | "materialized view" | KQL Materialized View | eventhouse-cli | |
| SQL DW / Warehouse | "materialized view" | Not supported in Fabric | Explain unsupported |
Disambiguation rule: If the user mentions lakehouse, notebook, Spark, Delta, or MLV → it's a Materialized Lake View (this skill). If they mention KQL, Eventhouse, or Kusto → it's a KQL Materialized View (different skill). If they mention Warehouse or SQL DW → explain it's not supported.
Default: If context is unclear (no mention of lakehouse, Spark, KQL, or Warehouse), ask the user: "Are you working with a Lakehouse (Materialized Lake View) or an Eventhouse (KQL Materialized View)?" before proceeding.
Manage MLV refresh scheduling, execution definitions, and monitoring using Fabric REST APIs. This skill provides public API coverage (Preview) for scheduling, subset refresh configuration, and monitoring operations, enabling automation of MLV refresh workflows.
What This Skill Can Do
✅ Fully Supported (14 REST APIs)
- Schedule Management (per lakehouse — refreshes entire MLV lineage by default)
- Create refresh schedules (Cron interval, Daily, Weekly, Monthly)
- List schedules for a lakehouse
- Get schedule details by ID
- Update existing schedules (change frequency, enabled state)
- Delete schedules
- Attach an
executionData.mlvExecutionDefinitionIdto refresh a subset of the lineage
- Job Execution
- Trigger on-demand refresh (immediate execution)
- List job run history with filtering
- Get job status and progress
- Cancel running jobs
- Attach an
executionData.mlvExecutionDefinitionIdto refresh a subset of the lineage on demand
- MLV Execution Definitions
- Create reusable execution definitions for selected MLVs, selected upstream lakehouses, refresh mode, and Spark environment
- List execution definitions
- Get execution definition details
- Patch execution definitions (partial update; omitted fields retain existing values)
- Delete execution definitions; linked schedules are removed by the API
- Safety & UX
- Human-in-the-loop confirmations before creating schedules or triggering refreshes
- Step-by-step planning for complex multi-MLV operations
- Iterative error handling with helpful suggestions
- Preview schedule impact before execution
❌ Not Supported (Requires UI — No REST APIs)
- MLV Discovery: Cannot list MLVs in a lakehouse (API returns 404)
- Visual Lineage Inspection: Cannot fetch the portal dependency graph directly
- Data Quality Metrics: Cannot retrieve DQ metrics (API returns 404)
- Schema Verification: Cannot check if schemas are enabled (property missing)
Workaround: User provides lakehouse ID and MLV table names explicitly. Use Fabric Lakehouse UI for discovery tasks, then encode selected MLV names and selected upstream lakehouses in an MLV execution definition.
Table of Contents
| Task | Reference | Notes | |
|---|---|---|---|
| RULES — Read these first, follow them always | SKILL.md § Must | MUST read — 6 rules for this skill | |
| Finding Workspaces and Items in Fabric | COMMON-CLI.md § Finding Workspaces and Items in Fabric | Mandatory — READ link first [needed for finding workspace id by its name or item id by its name, item type, and workspace id] | |
| Fabric Topology & Key Concepts | COMMON-CORE.md § Fabric Topology & Key Concepts | ||
| Environment URLs | COMMON-CORE.md § Environment URLs | ||
| Authentication & Token Acquisition | COMMON-CORE.md § Authentication & Token Acquisition | Wrong audience = 401; read before any auth issue | |
| Job Scheduling | COMMON-CLI.md § Job Scheduling | URL is /jobs/{jobType}/schedules; endDateTime required | |
| Job Execution | COMMON-CLI.md § Job Execution | ||
Fabric Control-Plane API via az rest | COMMON-CLI.md § Fabric Control-Plane API via az rest | Always pass `--resource https://api.fabric.microsoft.com` or az rest fails | |
| Pagination Pattern | COMMON-CLI.md § Pagination Pattern | ||
| Gotchas & Troubleshooting (CLI-Specific) | COMMON-CLI.md § Gotchas & Troubleshooting (CLI-Specific) | az rest audience, shell escaping, token expiry | |
Quick Reference: az rest Template | COMMON-CLI.md § Quick Reference: az rest Template | ||
| MLV Public API Reference | MS Learn: Manage Fabric materialized lake views with public APIs | Official documentation for schedules, on-demand refresh, job instances, and MLV execution definitions |
Eval mode: When the user prompt contains "I pre-approve" or "proceed without confirmation",skip the human-in-the-loop gate and execute directly. This allows automated testing.
Must
1. Human-in-the-loop confirmations
Before executing any operation, show a preview and ask for confirmation:
- Creating schedules: Show schedule type, interval/times, lakehouse ID, start/end time, and full-lineage or execution-definition scope
- Creating execution definitions: Show selected MLVs, selected upstream lakehouses, refresh mode, and Spark environment
- Triggering refreshes: Show lakehouse ID and whether this refreshes the full lineage or a named execution definition subset
- Deleting schedules: Show schedule ID and confirm deletion
- Deleting execution definitions: Show definition ID and warn that linked schedules are also removed
Confirmation options:
Allow— Execute this single operationDecline— Skip this operationAllow in this thread— Auto-allow all operations in current conversation
Example:
I'm about to create a refresh schedule:Lakehouse ID: abc-123-defType: DailyTime: 02:00 UTCStart: 2026-06-20End: 2027-06-20Scope: Full MLV lineage (default)Proceed? [Allow / Decline / Allow in this thread]
2. Use REST APIs exactly as documented
Base URL: https://api.fabric.microsoft.com/v1
IMPORTANT: Schedule, on-demand trigger, execution-definition, and history-list endpoints are workspace + lakehouse scoped. An on-demand trigger returns an item-scoped Location URL for status polling and cancellation. A schedule or on-demand run refreshes the entire MLV lineage by default. To refresh selected MLVs or selected upstream lakehouses, create an MLV execution definition and pass its mlvExecutionDefinitionId in executionData.
Schedule endpoints:
POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules— Create scheduleGET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules— List schedulesGET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules/{id}— Get schedulePATCH /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules/{id}— Update scheduleDELETE /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules/{id}— Delete schedule
Job instance endpoints:
POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/instances— Trigger on-demand refresh (optionalexecutionData; returns 202 + Location header with job ID)GET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/instances— List job historyGET /workspaces/{workspaceId}/items/{lakehouseId}/jobs/instances/{jobInstanceId}— Get job status from the triggerLocationPOST /workspaces/{workspaceId}/items/{lakehouseId}/jobs/instances/{jobInstanceId}/cancel— Cancel the running job
MLV execution definition endpoints:
POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions— Create selected-lineage execution definitionGET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions— List execution definitionsGET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions/{mlvExecutionDefinitionId}— Get execution definitionPATCH /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions/{mlvExecutionDefinitionId}— Partially update execution definitionDELETE /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions/{mlvExecutionDefinitionId}— Delete execution definition and any linked schedules
Job type mismatch trap: Job history can expose scheduled MLV runs as jobType: "MaterializedLakeViews", but the public job scheduler path uses refreshMaterializedLakeViews. Do not copy the history value into POST /workspaces/{workspaceId}/items/{lakehouseId}/jobs/instances?jobType=MaterializedLakeViews; that item-level call returns InvalidJobType.
See: MS Learn: MLV Background Jobs
3. Authentication
All scheduling operations (create/update/delete, trigger, status, cancel) support both User identity (az login) and Service Principal / Managed Identity. Requires Workspace Contributor or Admin role.
4. Lakehouse schedule limits and execution-definition scopes
The Preview REST scheduler supports refresh schedules at lakehouse scope. A lakehouse can have at most 20 schedules, and an MLV lineage can have only one active refresh schedule. If the user asks for a subset schedule, create an MLV execution definition with selected MLVs/upstream lakehouses and pass its mlvExecutionDefinitionId in schedule or on-demand executionData. Execution definitions scope a refresh; they don't bypass scheduler limits.
5. MLV Discovery — User must provide names
GET /materializedLakeViews returns 404. Ask user for lakehouse ID and table names upfront.
6. Run History diagnostic workflow
When a user asks "why did my refresh fail?" or "show me run history", follow this sequence:
- List recent runs:
GET /instances— returns job instances with status, start/end times - Show run summary: Display table with run ID, status, start/end time, duration
- Select failed run: If multiple, ask user which one to investigate
- Read error code: Extract
failureReason.errorCodeandfailureReason.messagefrom the failed instance - Suggest next steps: Based on error code:
MLV_SPARK_SESSION_REQUEST_SUBMISSION_FAILED→ Check capacity availability, Spark pool configMLV_SELECTED_NOT_FOUND→ MLV table was deleted or renamed, verify it exists- Other Spark errors → Route to
spark-operations-clifor OOM, skew, shuffle spill diagnosis
- Per-view details: The API returns lineage-level status only. Per-view status (which individual MLVs failed) is available in the UI Recent runs page — direct the user there for view-level breakdown
Run statuses (from API): NotStarted, InProgress, Completed, Failed, Cancelled, Deduped
Note: Run history retention may be limited. If older runs are missing, check the Recent runs page in the Lakehouse UI.
Prefer
- Lakehouse schedules for recurring refreshes — for an interactive workflow, direct users to Lakehouse → Materialized lake views → Manage → Schedules. Use the REST API only when the user needs programmatic automation or CI/CD.
- Daily/Weekly types for precise time-of-day scheduling (e.g., "2 AM daily")
- Cron type with interval only for sub-daily frequencies (e.g., "every 60 minutes")
- Step-by-step planning — clarify intent, propose schedule, show preview, execute on approval
- Iterative error handling — on failure, explain what went wrong and suggest actionable fixes
- Explicit timezone in every schedule (
localTimeZoneId) - Cross-lakehouse scheduling from extended lineage — when MLVs span multiple lakehouses, schedule from the downstream lakehouse's lineage view. Extended lineage refreshes upstream dependencies automatically in dependency order. Prefer this over creating separate schedules on each lakehouse individually.
Avoid
- Per-table scheduling claims without an execution definition — full-lineage is the default; selected subsets require a saved execution definition
- Cron string expressions (e.g.,
0 2 * * *) — the API uses structured types, not cron strings - Assuming JSON response from on-demand refresh — returns 202 with job ID in Location header only
- Silent failures — always explain errors
- Scheduling from notebooks or pipelines — recurring MLV refresh belongs to Lakehouse schedules. SQL
REFRESH ... FULLis for one-time manual troubleshooting only.
Schedule Payload Structure
Create Schedule (POST /schedules)
Endpoint: POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules
{"enabled": true,"configuration": {"type": "Cron","interval": 60,"startDateTime": "2026-06-20T00:00:00","endDateTime": "2027-06-20T23:59:59","localTimeZoneId": "UTC"}}
Subset lineage schedule: include executionData when the user wants to refresh only the MLVs/upstream lakehouses captured in an execution definition:
{"enabled": true,"configuration": {"type": "Cron","interval": 60,"startDateTime": "2026-06-20T00:00:00","endDateTime": "2027-06-20T23:59:59","localTimeZoneId": "UTC"},"executionData": {"mlvExecutionDefinitionId": "<mlvExecutionDefinitionId>"}}
Key fields:
enabled:trueto enable schedule on creationtype: One of"Cron","Daily","Weekly","Monthly"interval: (Cron only) Refresh interval in minutes (e.g.,60= hourly,120= every 2 hours)times: (Daily/Weekly/Monthly) Array of times in"HH:MM"format, e.g.,["02:00"]weekdays: (Weekly only) e.g.,["Monday", "Wednesday", "Friday"]— PascalCase day namesrecurrence: (Monthly only) Recurrence interval, e.g.,1(every month)occurrence: (Monthly only) e.g.,{"occurrenceType": "DayOfMonth", "dayOfMonth": 1}localTimeZoneId: Windows time zone names —"UTC","Central Standard Time","India Standard Time", etc.startDateTime: When schedule becomes active (ISO 8601 local time;localTimeZoneIdsupplies the time zone)endDateTime: REQUIRED — When schedule expiresexecutionData.mlvExecutionDefinitionId: Optional; refreshes only the selected lineage captured in that execution definition
Daily example (preferred for "2 AM every day"):
{ "enabled": true, "configuration": { "type": "Daily", "times": ["02:00"], "startDateTime": "2026-06-20T00:00:00", "endDateTime": "2027-06-20T23:59:59", "localTimeZoneId": "UTC" } }
Weekly example (weekdays at 6 AM):
{ "enabled": true, "configuration": { "type": "Weekly", "times": ["06:00"], "weekdays": ["Monday", "Friday"], "startDateTime": "2026-06-20T00:00:00", "endDateTime": "2027-06-20T23:59:59", "localTimeZoneId": "UTC" } }
Monthly example (1st of each month at midnight):
{ "enabled": true, "configuration": { "type": "Monthly", "recurrence": 1, "occurrence": {"occurrenceType": "DayOfMonth", "dayOfMonth": 1}, "times": ["00:00"], "startDateTime": "2026-06-20T00:00:00", "endDateTime": "2027-06-20T23:59:59", "localTimeZoneId": "UTC" } }
WARNING: Do NOT use"days": [1, 15]for Monthly — this returns400 InvalidConfiguration. Userecurrence+occurrenceas shown above.
Update Schedule (PATCH /schedules/{id})
Endpoint: PATCH /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/schedules/{id}
{"enabled": true,"configuration": {"type": "Cron","interval": 120,"startDateTime": "2026-06-20T00:00:00","endDateTime": "2027-06-20T23:59:59","localTimeZoneId": "UTC"}}
Note: The update API requires both enabled and a complete configuration (full replacement, not partial patch). Always send all fields.
MLV Execution Definitions
Use execution definitions when the user wants to refresh specific MLVs, include selected upstream lakehouses, pin a Spark environment, or choose a refresh mode independently from the default full-lineage refresh.
Create MLV Execution Definition
Endpoint: POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/mlvexecutiondefinitions
{"displayName": "Gold Chain - Sales","description": "Nightly refresh for selected gold-layer MLVs","settings": {"environment": {"referenceType": "ById","itemId": "<environmentId>","workspaceId": "<environmentWorkspaceId>"},"refreshMode": "Optimal"},"currentLakehouseExecutionContext": {"mode": "Selected","selectedMlvs": ["dbo.gold_sales_summary","dbo.gold_sales_daily"]},"extendedLineageExecutionContext": {"mode": "All"}}
Execution context modes:
currentLakehouseExecutionContext.mode:"All"or"Selected"; when"Selected", provideselectedMlvsas fully qualified MLV names.extendedLineageExecutionContext.mode:"All"or"Selected"; when"Selected", provideselectedLakehousesobjects withreferenceType,itemId, andworkspaceId.settings.refreshMode:"Optimal"or"Full".settings.environment: Optional Spark environment reference by ID.
Update semantics: PATCH /mlvexecutiondefinitions/{id} is a partial update. Only provided fields change; omitted fields retain their existing values. This differs from schedule PATCH, which requires enabled and a complete configuration.
Delete semantics: DELETE /mlvexecutiondefinitions/{id} also removes schedules linked to that execution definition. Warn before deleting.
Trigger On-Demand Refresh (POST /instances)
Endpoint: POST /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/instances
Request body: None for full-lineage refresh. Refreshes the entire MLV lineage in dependency order.
Subset refresh body:
{"executionData": {"mlvExecutionDefinitionId": "<mlvExecutionDefinitionId>"}}
Do not use job history as the trigger contract: recent runs may list jobType: "MaterializedLakeViews", but that value is only a history/status label. For on-demand refresh, always call this lakehouse-scoped endpoint. Reusing the history label with the generic item job API (POST /workspaces/{workspaceId}/items/{lakehouseId}/jobs/instances?jobType=MaterializedLakeViews) is a known InvalidJobType dead end.
The trigger response returns an item-scoped Location URL (/items/{lakehouseId}/jobs/instances/{jobInstanceId}). Use it as-is for polling and cancellation. The lakehouse-scoped GET (/lakehouses/{lakehouseId}/jobs/instances/{jobInstanceId}) is documented as an alternative and returns the same instance, but the service does not return that shape in the Location header today.
Response: 202 Accepted — job instance ID is in the Location response header:
Location: https://api.fabric.microsoft.com/v1/workspaces/{wsId}/items/{lakehouseId}/jobs/instances/{jobInstanceId}Retry-After: 60
Poll for status using the URL from the Location header (or its lakehouse-scoped equivalent):
GET /workspaces/{workspaceId}/items/{lakehouseId}/jobs/instances/{jobInstanceId}
Job instance status values:
| Status | Meaning | |
|---|---|---|
NotStarted | Job is queued but hasn't begun | |
InProgress | Job is actively running | |
Completed | Job finished successfully | |
Failed | Job failed (check failureReason) | |
Cancelled | Job was cancelled by user | |
Deduped | Skipped because another refresh was already in progress |
Note: Job instances returned by public GET /lakehouses/{id}/jobs/refreshMaterializedLakeViews/instances use jobType: "RefreshMaterializedLakeViews" per MS Learn. Some item-level history surfaces have returned jobType: "MaterializedLakeViews" in live testing; filter on either value when diagnosing legacy history, but never use MaterializedLakeViews as an on-demand trigger jobType.
Status display limitation: job instance status reflects Monitor hub status and can differ from the MLV run-history UI. For example, an MLV run-history Skipped status can appear as Cancelled/Canceled in Monitor hub APIs.
Schedule settings (additional options via UI or API):
- Optimal Refresh (default: On) — Fabric picks incremental or full refresh per MLV automatically
- Extended lineage — refreshes chains across multiple lakehouses in dependency order from a single schedule
Example Workflows
Workflow 1: Schedule Nightly Refresh
User prompt: "Schedule sales_monthly MLV in CustomerVoice lakehouse to refresh at 2 AM daily"
Agent steps:
- Find workspace ID for "CustomerVoice" via
GET /workspaces+ JMESPath - Find lakehouse ID via
GET /workspaces/{id}/lakehouses+ JMESPath - Clarify scope: "Do you want the default full-lineage schedule, or should I create an MLV execution definition for only
sales_monthly?" - If the user chooses subset scope, create an execution definition with
currentLakehouseExecutionContext.mode = "Selected"andselectedMlvs = ["dbo.sales_monthly"](or the user's actual fully qualified MLV name), then include itsmlvExecutionDefinitionIdin scheduleexecutionData. - Show preview:
``` Creating schedule: Lakehouse: CustomerVoice (ID: xyz-456-ghi) Scope: Full lineage OR execution definition <id> Type: Daily, Time: 02:00 UTC Start: Now End: 1 year from now
Proceed? [Allow / Decline] ```
- On "Allow": POST schedule payload, return schedule ID
- Report: "Schedule created (ID: sched-789). Scope: full lineage OR execution definition <id>."
Workflow 2: Trigger Immediate Refresh
User prompt: "Refresh inventory_daily MLV now in lakehouse xyz-456-ghi"
Agent steps:
- Confirm lakehouse ID is valid (GET /lakehouses/{id})
- Clarify scope and show preview:
``` Triggering on-demand refresh: Lakehouse ID: xyz-456-ghi Scope: Full lineage OR execution definition <id>
Do you want the default full-lineage refresh, or only inventory_daily through an execution definition? Proceed? [Allow / Decline] ```
- If the user chooses a subset, create or reuse an execution definition for
inventory_dailyand send its ID inexecutionData; otherwise POST/instanceswith no body. Capture the job ID from the Location header. - Poll using the item-scoped URL returned in the
Locationheader, or its documented lakehouse-scoped equivalentGET /workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/instances/{jobId}, and show progress. - Report: "✅ Refresh completed in 2m 34s" or "❌ Refresh failed: [error message]"
Workflow 3: User Asks for Per-MLV Scheduling (Explain Limitation)
User prompt: "Schedule bronze_sales, silver_sales, gold_sales to refresh at 2 AM, 3 AM, 4 AM respectively"
Agent steps:
- Explain limitation:
``` These views are a dependency chain, so schedule them as one lineage refresh rather than at separate times. Lakehouse scheduling refreshes dependencies in the required order.
Options:
- Single Daily schedule at 2 AM (refreshes all 3 in order)
- If the MLVs are independent, create separate execution definitions and
schedules within the lakehouse's 20-schedule limit
- If they're in separate lakehouses, create one schedule per lakehouse
Which would you prefer? ```
- If user picks option 1: Create one Daily schedule with
"times": ["02:00"] - If user picks option 2: Confirm the MLVs are independent, then create the execution definitions and schedules
- If user picks option 3: Confirm lakehouse IDs for each, then create schedules
Workflow 4: List and Delete Schedules
User prompt: "Show my schedule and delete it if it's outdated"
Agent steps:
- Ask user for workspace and lakehouse (cannot list schedules globally)
GET /workspaces/{wsId}/lakehouses/{lhId}/jobs/refreshMaterializedLakeViews/schedules- Parse response (usually 1 schedule per lineage), show details:
``` Active schedule on lakehouse 'CustomerVoice':
- ID: sched-111 (created 2025-10-15, type: Daily, time: 02:00)
Delete this schedule? [Allow / Decline] ```
- On "Allow": DELETE /schedules/{id}, confirm
- Report: "✅ Schedule deleted"
Common Errors & Fixes
Error: 400 Bad Request — Invalid Interval
Message: "The interval '0' is invalid. Interval must be between 1 and 5270400 (10 years in minutes)."
Fix:
Interval must be a valid number of minutes between 1 and 5,270,400 (10 years).Common intervals:60 = hourly1440 = daily (24 hours)10080 = weekly (7 days)Would you like me to adjust the interval to a valid value?
Error: 409 Conflict — Schedule Already Exists
Message: "A schedule already exists for this lakehouse"
Fix:
A schedule is already active for this lakehouse. Options:1. Update existing schedule (change interval/time)2. Delete and recreate (replaces schedule)3. Leave as-is (no change)Which would you prefer?
Error: 404 Not Found — Lakehouse ID Invalid
Message: "Lakehouse 'wrong-id-123' not found in workspace 'abc-456'"
Fix:
The lakehouse ID you provided doesn't exist. Let me list available lakehouses:[Call GET /workspaces/{id}/lakehouses, show table]Which lakehouse should I use?
Error: 403 Forbidden — Permission Denied
Message: "User does not have permission to create schedules in this workspace"
Fix:
You need Workspace Contributor or Admin role to create schedules.Current permissions: Viewer (read-only)Required: Contributor or AdminContact your workspace admin to request elevated permissions.
Tips for Users
1. Find Your Lakehouse ID
Option A: Via REST API
az rest --resource https://api.fabric.microsoft.com \--url "https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/lakehouses" \--method GET
Extract id from the response for your lakehouse.
Option B: Via Fabric UI
- Open lakehouse in Fabric portal
- Click Settings (gear icon)
- Copy "Lakehouse ID" from properties
2. Common Schedule Configurations
| Need | Type | Key field | |
|---|---|---|---|
| Every hour | Cron | "interval": 60 | |
| Daily at 2 AM | Daily | "times": ["02:00"] | |
| Weekdays at 6 AM | Weekly | "times": ["06:00"], "weekdays": ["Monday","Friday"] | |
| 1st of each month | Monthly | "recurrence": 1, "occurrence": {"occurrenceType": "DayOfMonth", "dayOfMonth": 1} |
3. Monitor Job History
List recent refresh jobs (authenticate per COMMON-CLI.md § Quick Reference: az rest Template):
# See COMMON-CLI.md for authentication setupaz rest --resource https://api.fabric.microsoft.com \--url "https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/lakehouses/{lakehouseId}/jobs/refreshMaterializedLakeViews/instances" \--method GET
Note: The list instances API does not support OData query parameters ($top,$orderby,$filter). Sort and filter results client-side after retrieval. UsecontinuationTokenfor pagination.
4. Time Zone Considerations
Default: Schedules use UTC unless specified.
Best practice: Always specify timezone explicitly to avoid confusion:
{"configuration": {"localTimeZoneId": "Central Standard Time"}}
Valid time zones: Windows time zone names (e.g., "Central Standard Time", "Pacific Standard Time", "India Standard Time"). Use the Windows Default Time Zones registry.
Related Skills
- spark-authoring-cli: Create MLVs in Fabric Notebooks (authoring side)
- check-updates: Verify skill package is up-to-date (run once per session)
Limitations & Future Roadmap
Current Limitations (as of 2026-06-18)
| Feature | Status | Workaround | |
|---|---|---|---|
| List MLVs in lakehouse | ❌ API returns 404 | User provides table names manually | |
| Refresh selected MLVs / subset lineage | ✅ Use MLV execution definitions | Create /mlvexecutiondefinitions, then pass executionData.mlvExecutionDefinitionId | |
| Get visual lineage graph | ❌ No public graph API | Use Fabric Lakehouse UI | |
| Check data quality metrics | ❌ API returns 404 | Use Fabric Lakehouse UI | |
| Verify schema support | ❌ Property missing | Assume schemas enabled if MLVs work |
What Works Today (public MLV API coverage (Preview))
- ✅ Create/list/update/delete schedules (5 APIs)
- ✅ Trigger/monitor/cancel refresh jobs (4 APIs)
- ✅ Create/list/get/update/delete MLV execution definitions (5 APIs)
- ✅ Full-lineage or selected-lineage refresh via
executionData.mlvExecutionDefinitionId - ✅ Full automation of refresh workflows
- ✅ Human-in-the-loop safety confirmations
- ✅ Iterative error handling
Planned (When REST APIs Ship)
- MLV Discovery: Auto-list MLVs in a lakehouse
- Visual Lineage Tracing: Show dependency graphs
- Data Quality: Fetch DQ metrics programmatically
- Schema Verification: Check
enableSchemasproperty
Agent design is forward-compatible: When APIs become available, add discovery capabilities without changing scheduling logic.
Conclusion
This skill provides validated automation for MLV refresh scheduling, execution definitions, and monitoring using public REST APIs. While MLV discovery and visual lineage inspection still require UI workarounds today, scheduling, selected-lineage execution definitions, and job execution work as documented.
Design philosophy (inspired by Databricks Data Engineering Agent):
- Human-in-the-loop confirmations for safety
- Step-by-step planning for complex tasks
- Iterative error handling with helpful suggestions
- Transparent about limitations (no speculative workarounds)
Next steps: Use this skill to automate MLV refresh workflows. When discovery APIs ship, we'll extend the skill to eliminate manual lakehouse ID + table name input.