p00318821-eng/skills-plugins-hooks-agents/synapse-migration

Claude Code and agent skill by p00318821-eng/skills-plugins-hooks-agents

Trust tier 2
  • community
LLM review pending
Source check pending

Checking that the SKILL.md file is still in the repository.

Port Azure Synapse Analytics Spark workloads to Microsoft Fabric. Translates mssparkutils calls to notebookutils (including the env→runtime namespace change), replaces Linked Services with Fabric Data Connections and OneLake Shortcuts. Covers Spark Pools, Lake Databases, Notebooks, and Spark Job Definitions. Use when the user wants to: (1) port Synapse Spark notebooks to Fabric Lakehouse or Spark Job Definitions, (2) replace mssparkutils or Linked Services in Synapse code. Triggers: "migrate from synapse", "synapse to fabric", "mssparkutils to notebookutils", "synapse linked service replacement", "port synapse notebooks", "synapse workspace migration".

Install

npx vskill@latest install p00318821-eng/skills-plugins-hooks-agents/synapse-migration

SKILL.md

The same SKILL.md was published earlier as microsoft/skills-for-fabric/synapse-migration.

Update Check — ONCE PER SESSION (mandatory)
The first time this skill is used in a session, run the check-updates skill before proceeding.
- GitHub Copilot CLI / VS Code: invoke the check-updates skill.
- Claude Code / Cowork / Cursor / Windsurf / Codex: compare local vs remote package.json version.
- Skip if the check was already performed earlier in this session.
CRITICAL NOTES
1. To find workspace details (including its ID) from a workspace name: list all workspaces, then use JMESPath filtering
2. To find item details (including its ID) from workspace ID, item type, and item name: list all items of that type in that workspace, then use JMESPath filtering
3. mssparkutils and notebookutils share the same API surface in most cases — the namespace is the primary change
4. Linked Services have no direct REST API equivalent in Fabric — they are replaced by Data Connections (for external sources) and OneLake Shortcuts (for storage mounts)

Synapse Analytics → Microsoft Fabric Migration

Prerequisite Knowledge

These companion documents provide general Fabric REST patterns. Do NOT read them upfront — reference only when a specific phase requires a pattern not already covered in this skill's resource files:

Auth, API endpoints, and item payloads are fully documented in this skill's own files. The common docs above are fallback references only.

Table of Contents

TopicReference
Migration Orchestratormigration-orchestrator.md
API-Driven Migration Workflow§ API-Driven Migration Workflow
Migration Workload Map§ Migration Workload Map
Spark Pool → Environment Migrationspark-pool-migration.md
Lake Database → Lakehouse Migrationlake-database-migration.md
External Hive Metastore → Lakehouse Migrationexternal-hms-migration.md
Notebook & SJD Migrationspark-item-migration.md
Library Compatibility (Synapse vs. Fabric RT 1.3)library-compatibility.md
Connector Refactoring (Kusto, Cosmos DB, ADLS OAuth)connector-refactoring.md
mssparkutils → notebookutils API Mappingutility-api-mapping.md
Linked Services → Data Connections / Shortcutsconnectivity-migration.md
Before/After Code Patterns (incl. Catalog API gaps)code-patterns.md
Migration Report (with Fabric portal links)migration-report.md
Migration Troubleshooting Guidemigration-gotchas.md
Validation & Testingvalidation-testing.md
Security & Governance (Production Readiness)security-governance.md
T-SQL & Spark Configuration Differences§ T-SQL & Spark Configuration Differences
Capacity Sizing Reference§ Capacity Sizing Reference
Must / Prefer / Avoid§ Must / Prefer / Avoid
Feature Parity Reference§ Feature Parity Reference
Migration Gotchas — Quick Reference§ Migration Gotchas + migration-gotchas.md
Post-Migration: What's Next§ Post-Migration: What's Next
Context Loading Guide
IMPORTANT — Load only what you need. Do NOT read all resource files upfront. Load the specific file for the phase you are executing:
WhenRead This FileLines
User asks to migrate a workspace (full orchestration)migration-orchestrator.md~1264
Phase 0: Spark Pools → Environmentsspark-pool-migration.md~290
Phase 1: Databases → Lakehouses (built-in HMS)lake-database-migration.md~574
Phase 1: Databases → Lakehouses (external HMS)external-hms-migration.md~388
Phase 2–3: Notebooks & SJDsspark-item-migration.md~326
Code refactoring (mssparkutils, connectors)utility-api-mapping.md + connector-refactoring.md + code-patterns.md~588
Post-migration validationvalidation-testing.md~487
Troubleshooting failuresmigration-gotchas.md~225
Production security setupsecurity-governance.md~926
Library version gapslibrary-compatibility.md~106
Generating migration reportmigration-report.md~360
Capacity sizing & SKU planningcapacity-sizing.md~85
Feature parity matrixfeature-parity.md~65

API-Driven Migration Workflow

This skill supports programmatic migration of Synapse Spark items via REST APIs (no UI-based Migration Assistant required).

Authentication
TargetToken Audience
Synapse ARM (management plane)https://management.azure.com
Synapse Data Planehttps://dev.azuresynapse.net
Fabric REST APIhttps://api.fabric.microsoft.com
Use the token-acquisition recipe in COMMON-CLI § Authentication Recipes with the audiences above.
Migration Phases (Execute in Order)
PhaseSynapse SourceFabric TargetResource
Phase 0Spark PoolEnvironmentspark-pool-migration.md
Phase 1Lake Database (built-in HMS)Lakehouselake-database-migration.md
Phase 1External Hive MetastoreLakehouseexternal-hms-migration.md
Phase 1bAd-hoc abfss:// storage pathsOneLake Shortcutsmigration-orchestrator.md (migrate-and-modernize only)
Phase 2NotebooksNotebookspark-item-migration.md
Phase 3Spark Job DefinitionsSJDspark-item-migration.md
FinalValidation & Testing—validation-testing.md
OptionalSecurity & Governance—security-governance.md
Phase order matters: Environments (Phase 0) must exist before notebooks/SJDs can bind to them. Lakehouses (Phase 1) must exist before notebooks can bind to them (Phase 2).
For the full execution flow with sub-steps, decision points, lift-and-shift vs. modernize paths, and error recovery, see migration-orchestrator.md.
REST API Quick Reference

All Synapse and Fabric API endpoints with request/response examples are in migration-orchestrator.md (Steps 2a–2e). Authentication tokens:

TargetToken Audience
Synapse ARMhttps://management.azure.com
Synapse Data Planehttps://dev.azuresynapse.net
Fabric REST APIhttps://api.fabric.microsoft.com

Migration Workload Map

Use this table to determine the correct Fabric target for each Synapse component:

Synapse ComponentFabric TargetNotes
Spark Pool (notebooks, jobs)Fabric Spark (Lakehouse / Notebooks / SJD)Starter Pool replaces on-demand pools for most workloads
Dedicated SQL PoolFabric WarehouseT-SQL surface area differences apply — see § T-SQL & Spark Configuration Differences. Procedural migration guide not yet available — separate migration track. For T-SQL authoring, delegate to `sqldw-authoring-cli`.
Serverless SQL PoolLakehouse SQL EndpointRead-only Delta/Parquet queries; no DDL required
Synapse PipelinesFabric Data PipelinesActivity types, triggers, and expressions are broadly compatible. Pipeline migration resource not yet available — separate migration track.
Synapse Link for Cosmos DB / SQLFabric MirroringNative mirroring replaces the Synapse Link connector pattern. Not covered by this skill.
Linked ServicesData Connections (external) / OneLake Shortcuts (storage)See connectivity-migration.md
Integration DatasetsFabric Pipeline source/sink configDataset definitions are inlined into pipeline activities in Fabric. Not covered by this skill.
Managed Virtual NetworksFabric Managed Private EndpointsConfigure in Fabric capacity settings
Synapse StudioFabric workspaceAll artifact types live in a single workspace with Git integration
Decision Tree: Which Fabric Spark Workload?
text
Synapse Spark workload
├── Interactive notebook with data exploration → Fabric Notebook (attached to Lakehouse)
├── Scheduled/production job → Spark Job Definition (SJD)
├── T-SQL over files/Delta → Lakehouse SQL Endpoint (no migration needed — just point to OneLake)
└── Real-time ingest → Fabric Eventstream + Lakehouse

T-SQL & Spark Configuration Differences

For detailed T-SQL surface area gaps (PolyBase → COPY INTO, distribution hints, result set caching) and Spark configuration mappings (pools, %%configure, runtime versions), see feature-parity.md.

Key actions: Remove DISTRIBUTION = HASH(col) hints, replace CREATE EXTERNAL TABLE with COPY INTO, replace spark.read.synapsesql() with OneLake shortcuts or JDBC. Delegate T-SQL authoring to sqldw-authoring-cli.

Capacity Sizing Reference

For Synapse pool → Fabric SKU mapping tables, sizing decision guide, and cost model comparison, see capacity-sizing.md.

Quick guide: Dev/test = F8–F16 with Starter Pool; standard production = F32–F64; enterprise = F128+. Use Fabric Trial (free F64, 60 days) for migration validation.

Must / Prefer / Avoid

This is the start of the file. Read the full SKILL.md on GitHub.

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewNot runA model review is scheduled for the next rescan.

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

Source

Popularity

7-day trend score
5

Not refreshed yet.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/p00318821-eng/skills-plugins-hooks-agents/synapse-migration/badge)](https://verified-skill.com/skills/p00318821-eng/skills-plugins-hooks-agents/synapse-migration)

Something wrong with this skill or its page? Tell us.