p00318821-eng/skills-plugins-hooks-agents/synapse-migration
Claude Code and agent skill by p00318821-eng/skills-plugins-hooks-agents
- community
Checking that the SKILL.md file is still in the repository.
Port Azure Synapse Analytics Spark workloads to Microsoft Fabric. Translates mssparkutils calls to notebookutils (including the env→runtime namespace change), replaces Linked Services with Fabric Data Connections and OneLake Shortcuts. Covers Spark Pools, Lake Databases, Notebooks, and Spark Job Definitions. Use when the user wants to: (1) port Synapse Spark notebooks to Fabric Lakehouse or Spark Job Definitions, (2) replace mssparkutils or Linked Services in Synapse code. Triggers: "migrate from synapse", "synapse to fabric", "mssparkutils to notebookutils", "synapse linked service replacement", "port synapse notebooks", "synapse workspace migration".
Install
npx vskill@latest install p00318821-eng/skills-plugins-hooks-agents/synapse-migrationSKILL.md
The same SKILL.md was published earlier as microsoft/skills-for-fabric/synapse-migration.
Update Check — ONCE PER SESSION (mandatory)The first time this skill is used in a session, run the check-updates skill before proceeding.- GitHub Copilot CLI / VS Code: invoke thecheck-updatesskill.- Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version.- Skip if the check was already performed earlier in this session.
CRITICAL NOTES1. To find workspace details (including its ID) from a workspace name: list all workspaces, then use JMESPath filtering2. To find item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace, then use JMESPath filtering3.mssparkutilsandnotebookutilsshare the same API surface in most cases — the namespace is the primary change4. Linked Services have no direct REST API equivalent in Fabric — they are replaced by Data Connections (for external sources) and OneLake Shortcuts (for storage mounts)
Synapse Analytics → Microsoft Fabric Migration
Prerequisite Knowledge
These companion documents provide general Fabric REST patterns. Do NOT read them upfront — reference only when a specific phase requires a pattern not already covered in this skill's resource files:
- COMMON-CORE.md — General Fabric REST API patterns, authentication & token audiences, item discovery via JMESPath
- COMMON-CLI.md —
az rest/az loginCLI patterns, authentication recipes - SPARK-AUTHORING-CORE.md — Notebook/lakehouse creation (already covered in spark-item-migration.md and lake-database-migration.md)
- SQLDW-AUTHORING-CORE.md — Fabric Warehouse T-SQL (delegate to
sqldw-authoring-cliskill)
Auth, API endpoints, and item payloads are fully documented in this skill's own files. The common docs above are fallback references only.
Table of Contents
| Topic | Reference | |
|---|---|---|
| Migration Orchestrator | migration-orchestrator.md | |
| API-Driven Migration Workflow | § API-Driven Migration Workflow | |
| Migration Workload Map | § Migration Workload Map | |
| Spark Pool → Environment Migration | spark-pool-migration.md | |
| Lake Database → Lakehouse Migration | lake-database-migration.md | |
| External Hive Metastore → Lakehouse Migration | external-hms-migration.md | |
| Notebook & SJD Migration | spark-item-migration.md | |
| Library Compatibility (Synapse vs. Fabric RT 1.3) | library-compatibility.md | |
| Connector Refactoring (Kusto, Cosmos DB, ADLS OAuth) | connector-refactoring.md | |
mssparkutils → notebookutils API Mapping | utility-api-mapping.md | |
| Linked Services → Data Connections / Shortcuts | connectivity-migration.md | |
| Before/After Code Patterns (incl. Catalog API gaps) | code-patterns.md | |
| Migration Report (with Fabric portal links) | migration-report.md | |
| Migration Troubleshooting Guide | migration-gotchas.md | |
| Validation & Testing | validation-testing.md | |
| Security & Governance (Production Readiness) | security-governance.md | |
| T-SQL & Spark Configuration Differences | § T-SQL & Spark Configuration Differences | |
| Capacity Sizing Reference | § Capacity Sizing Reference | |
| Must / Prefer / Avoid | § Must / Prefer / Avoid | |
| Feature Parity Reference | § Feature Parity Reference | |
| Migration Gotchas — Quick Reference | § Migration Gotchas + migration-gotchas.md | |
| Post-Migration: What's Next | § Post-Migration: What's Next |
Context Loading Guide
IMPORTANT — Load only what you need. Do NOT read all resource files upfront. Load the specific file for the phase you are executing:
| When | Read This File | Lines | |
|---|---|---|---|
| User asks to migrate a workspace (full orchestration) | migration-orchestrator.md | ~1264 | |
| Phase 0: Spark Pools → Environments | spark-pool-migration.md | ~290 | |
| Phase 1: Databases → Lakehouses (built-in HMS) | lake-database-migration.md | ~574 | |
| Phase 1: Databases → Lakehouses (external HMS) | external-hms-migration.md | ~388 | |
| Phase 2–3: Notebooks & SJDs | spark-item-migration.md | ~326 | |
| Code refactoring (mssparkutils, connectors) | utility-api-mapping.md + connector-refactoring.md + code-patterns.md | ~588 | |
| Post-migration validation | validation-testing.md | ~487 | |
| Troubleshooting failures | migration-gotchas.md | ~225 | |
| Production security setup | security-governance.md | ~926 | |
| Library version gaps | library-compatibility.md | ~106 | |
| Generating migration report | migration-report.md | ~360 | |
| Capacity sizing & SKU planning | capacity-sizing.md | ~85 | |
| Feature parity matrix | feature-parity.md | ~65 |
API-Driven Migration Workflow
This skill supports programmatic migration of Synapse Spark items via REST APIs (no UI-based Migration Assistant required).
Authentication
| Target | Token Audience | |
|---|---|---|
| Synapse ARM (management plane) | https://management.azure.com | |
| Synapse Data Plane | https://dev.azuresynapse.net | |
| Fabric REST API | https://api.fabric.microsoft.com |
Use the token-acquisition recipe in COMMON-CLI § Authentication Recipes with the audiences above.
Migration Phases (Execute in Order)
| Phase | Synapse Source | Fabric Target | Resource | |
|---|---|---|---|---|
| Phase 0 | Spark Pool | Environment | spark-pool-migration.md | |
| Phase 1 | Lake Database (built-in HMS) | Lakehouse | lake-database-migration.md | |
| Phase 1 | External Hive Metastore | Lakehouse | external-hms-migration.md | |
| Phase 1b | Ad-hoc abfss:// storage paths | OneLake Shortcuts | migration-orchestrator.md (migrate-and-modernize only) | |
| Phase 2 | Notebooks | Notebook | spark-item-migration.md | |
| Phase 3 | Spark Job Definitions | SJD | spark-item-migration.md | |
| Final | Validation & Testing | — | validation-testing.md | |
| Optional | Security & Governance | — | security-governance.md |
Phase order matters: Environments (Phase 0) must exist before notebooks/SJDs can bind to them. Lakehouses (Phase 1) must exist before notebooks can bind to them (Phase 2).
For the full execution flow with sub-steps, decision points, lift-and-shift vs. modernize paths, and error recovery, see migration-orchestrator.md.
REST API Quick Reference
All Synapse and Fabric API endpoints with request/response examples are in migration-orchestrator.md (Steps 2a–2e). Authentication tokens:
| Target | Token Audience | |
|---|---|---|
| Synapse ARM | https://management.azure.com | |
| Synapse Data Plane | https://dev.azuresynapse.net | |
| Fabric REST API | https://api.fabric.microsoft.com |
API docs: Synapse ARM · Synapse Data Plane · Fabric Items · Fabric Shortcuts · Fabric Connections · Fabric Environments
Migration Workload Map
Use this table to determine the correct Fabric target for each Synapse component:
| Synapse Component | Fabric Target | Notes | |
|---|---|---|---|
| Spark Pool (notebooks, jobs) | Fabric Spark (Lakehouse / Notebooks / SJD) | Starter Pool replaces on-demand pools for most workloads | |
| Dedicated SQL Pool | Fabric Warehouse | T-SQL surface area differences apply — see § T-SQL & Spark Configuration Differences. Procedural migration guide not yet available — separate migration track. For T-SQL authoring, delegate to `sqldw-authoring-cli`. | |
| Serverless SQL Pool | Lakehouse SQL Endpoint | Read-only Delta/Parquet queries; no DDL required | |
| Synapse Pipelines | Fabric Data Pipelines | Activity types, triggers, and expressions are broadly compatible. Pipeline migration resource not yet available — separate migration track. | |
| Synapse Link for Cosmos DB / SQL | Fabric Mirroring | Native mirroring replaces the Synapse Link connector pattern. Not covered by this skill. | |
| Linked Services | Data Connections (external) / OneLake Shortcuts (storage) | See connectivity-migration.md | |
| Integration Datasets | Fabric Pipeline source/sink config | Dataset definitions are inlined into pipeline activities in Fabric. Not covered by this skill. | |
| Managed Virtual Networks | Fabric Managed Private Endpoints | Configure in Fabric capacity settings | |
| Synapse Studio | Fabric workspace | All artifact types live in a single workspace with Git integration |
Decision Tree: Which Fabric Spark Workload?
T-SQL & Spark Configuration Differences
For detailed T-SQL surface area gaps (PolyBase → COPY INTO, distribution hints, result set caching) and Spark configuration mappings (pools, %%configure, runtime versions), see feature-parity.md.
Key actions: RemoveDISTRIBUTION = HASH(col)hints, replaceCREATE EXTERNAL TABLEwithCOPY INTO, replacespark.read.synapsesql()with OneLake shortcuts or JDBC. Delegate T-SQL authoring tosqldw-authoring-cli.
Capacity Sizing Reference
For Synapse pool → Fabric SKU mapping tables, sizing decision guide, and cost model comparison, see capacity-sizing.md.
Quick guide: Dev/test = F8–F16 with Starter Pool; standard production = F32–F64; enterprise = F128+. Use Fabric Trial (free F64, 60 days) for migration validation.
Must / Prefer / Avoid
This is the start of the file. Read the full SKILL.md on GitHub.
Security
- Security scanPassed, 100 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/synapse-migration/SKILL.md
Popularity
- 7-day trend score
- 5
Not refreshed yet.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/p00318821-eng/skills-plugins-hooks-agents/synapse-migration)