pramoddutta/qaskills/changelog-test-mapper

Trust tier 2
  • community
Source check pending

Checking that the SKILL.md file is still in the repository.

Map changelog entries and release notes to affected test cases, ensuring every user-facing change has corresponding test coverage verification.

Install

npx vskill@latest install pramoddutta/qaskills/changelog-test-mapper

SKILL.md

Changelog Test Mapper

Every user-facing change in a software release should have corresponding test coverage that verifies the change works as intended. In practice, this mapping between changelog entries and test cases is rarely maintained, leading to releases where features ship without adequate verification and bug fixes lack regression tests. The Changelog Test Mapper bridges this gap by programmatically analyzing changelog entries, release notes, and commit histories, then mapping them to existing test cases and identifying coverage gaps. This skill covers the full pipeline: parsing changelogs in various formats, extracting change metadata, building a bidirectional mapping between changes and tests, scoring coverage completeness, and integrating the analysis into release workflows to prevent untested changes from reaching production.

Core Principles

1. Every Shipped Change Deserves a Test

The fundamental premise of changelog-test mapping is that if a change is important enough to appear in the changelog, it is important enough to have a test. Bug fixes need regression tests. New features need functional tests. Performance improvements need benchmark tests. Changes without tests are unverified promises.

2. Bidirectional Traceability

The mapping must work in both directions. Given a changelog entry, you should be able to find all related tests. Given a test, you should be able to find which changelog entries it covers. This bidirectional traceability enables both forward analysis ("is this release well-tested?") and backward analysis ("what does this test protect?").

3. Automation Over Manual Tracking

Manually maintaining a spreadsheet of change-to-test mappings does not scale. The mapping should be derived automatically from commit messages, PR descriptions, issue tracker links, and file-level change analysis. Manual annotations should supplement, not replace, automated discovery.

4. Coverage Scoring Is Contextual

Not all changelog entries need the same level of test coverage. A breaking API change requires more comprehensive testing than a documentation fix. The coverage scoring model must account for change severity, affected surface area, and historical defect rates.

5. Integrate at Release Time

The mapping analysis should run as part of the release process, not as an afterthought. A release checklist that includes "all changelog entries have mapped tests" prevents untested changes from shipping.

Project Structure

changelog-test-mapper/
src/
parsers/
changelog-parser.ts
conventional-commits-parser.ts
github-releases-parser.ts
keep-a-changelog-parser.ts
analyzers/
change-classifier.ts
test-finder.ts
coverage-mapper.ts
gap-detector.ts
mappers/
file-change-mapper.ts
semantic-mapper.ts
annotation-mapper.ts
reporters/
coverage-reporter.ts
gap-reporter.ts
release-readiness-reporter.ts
config/
mapper-config.ts
index.ts
scripts/
map-release.ts
check-coverage.ts
generate-report.ts
tests/
parsers/
analyzers/
mappers/
package.json
tsconfig.json

Changelog Parsing

Multi-Format Changelog Parser

Changelogs come in many formats. The parser supports Keep a Changelog, conventional commits, and GitHub release formats:

typescript
// src/parsers/changelog-parser.ts
export interface ChangelogEntry {
id: string;
type: 'added' | 'changed' | 'deprecated' | 'removed' | 'fixed' | 'security' | 'performance';
description: string;
version: string;
date: string;
scope?: string;
breakingChange: boolean;
issueRefs: string[];
prRefs: string[];
commitShas: string[];
affectedFiles: string[];
severity: 'critical' | 'major' | 'minor' | 'patch';
}
export interface ParsedChangelog {
versions: Array<{
version: string;
date: string;
entries: ChangelogEntry[];
}>;
}
export function parseKeepAChangelog(content: string): ParsedChangelog {
const versions: ParsedChangelog['versions'] = [];
const versionRegex = /^## \[([^\]]+)\](?: - (\d{4}-\d{2}-\d{2}))?/gm;
const typeRegex = /^### (Added|Changed|Deprecated|Removed|Fixed|Security)/gm;
const entryRegex = /^- (.+)$/gm;
const sections = content.split(/^## /gm).filter(Boolean);
for (const section of sections) {
const versionMatch = section.match(/^\[([^\]]+)\](?: - (\d{4}-\d{2}-\d{2}))?/);
if (!versionMatch) continue;
const version = versionMatch[1];
const date = versionMatch[2] || '';
const entries: ChangelogEntry[] = [];
const typeSections = section.split(/^### /gm).filter(Boolean);
for (const typeSection of typeSections.slice(1)) {
const typeMatch = typeSection.match(/^(Added|Changed|Deprecated|Removed|Fixed|Security)/);
if (!typeMatch) continue;
const type = typeMatch[1].toLowerCase() as ChangelogEntry['type'];
const lines = typeSection.split('\n').filter((l) => l.startsWith('- '));
for (const line of lines) {
const description = line.replace(/^- /, '').trim();
const issueRefs = extractIssueRefs(description);
const prRefs = extractPRRefs(description);
const breakingChange = /breaking|BREAKING/.test(description);
entries.push({
id: generateEntryId(version, type, description),
type,
description,
version,
date,
breakingChange,
issueRefs,
prRefs,
commitShas: [],
affectedFiles: [],
severity: classifySeverity(type, breakingChange),
});
}
}
versions.push({ version, date, entries });
}
return { versions };
}
function extractIssueRefs(text: string): string[] {
const matches = text.match(/#(\d+)/g) || [];
return matches.map((m) => m.replace('#', ''));
}
function extractPRRefs(text: string): string[] {
const matches = text.match(/\bPR[: ]?#?(\d+)/gi) || [];
return matches.map((m) => m.replace(/\bPR[: ]?#?/i, ''));
}
function generateEntryId(version: string, type: string, description: string): string {
const hash = description
.toLowerCase()
.replace(/[^a-z0-9]/g, '')
.substring(0, 20);
return `${version}-${type}-${hash}`;
}
function classifySeverity(
type: ChangelogEntry['type'],
breakingChange: boolean
): ChangelogEntry['severity'] {
if (breakingChange) return 'critical';
if (type === 'security') return 'critical';
if (type === 'fixed') return 'major';
if (type === 'removed' || type === 'deprecated') return 'major';
if (type === 'changed') return 'minor';
return 'patch';
}
Conventional Commits Parser
typescript
// src/parsers/conventional-commits-parser.ts
import type { ChangelogEntry } from './changelog-parser';
interface ConventionalCommit {
sha: string;
type: string;
scope?: string;
description: string;
body?: string;
breaking: boolean;
issueRefs: string[];
files: string[];
}
export function parseConventionalCommits(
commits: ConventionalCommit[],
version: string
): ChangelogEntry[] {
const typeMapping: Record<string, ChangelogEntry['type']> = {
feat: 'added',
fix: 'fixed',
perf: 'performance',
security: 'security',
refactor: 'changed',
deprecate: 'deprecated',
};
return commits
.filter((commit) => typeMapping[commit.type])
.map((commit) => ({
id: `${version}-${commit.sha.substring(0, 8)}`,
type: typeMapping[commit.type] || 'changed',
description: commit.description,
version,
date: new Date().toISOString().split('T')[0],
scope: commit.scope,
breakingChange: commit.breaking,
issueRefs: commit.issueRefs,
prRefs: [],
commitShas: [commit.sha],
affectedFiles: commit.files,
severity: classifyCommitSeverity(commit),
}));
}
function classifyCommitSeverity(commit: ConventionalCommit): ChangelogEntry['severity'] {
if (commit.breaking) return 'critical';
if (commit.type === 'security') return 'critical';
if (commit.type === 'fix') return 'major';
if (commit.type === 'feat') return 'minor';
return 'patch';
}

Test Discovery and Mapping

File-Based Change-to-Test Mapper

The file-based mapper connects changelog entries to tests by analyzing which source files changed and finding tests that import or reference those files:

typescript
// src/mappers/file-change-mapper.ts
import { execSync } from 'child_process';
import { readFileSync, existsSync } from 'fs';
import { join, basename, dirname } from 'path';
interface TestMapping {
changeEntryId: string;
changeDescription: string;
mappedTests: Array<{
testFile: string;
testName: string;
confidence: 'high' | 'medium' | 'low';
reason: string;
}>;
unmappedFiles: string[];
coverageScore: number;
}
export function mapChangesToTests(
affectedFiles: string[],
testFiles: string[],
changeEntryId: string,
changeDescription: string
): TestMapping {
const mappedTests: TestMapping['mappedTests'] = [];
const mappedSourceFiles = new Set<string>();
const unmappedFiles: string[] = [];
for (const sourceFile of affectedFiles) {
// Skip test files themselves
if (isTestFile(sourceFile)) continue;
let hasMapping = false;
// Strategy 1: Co-located test files
const colocatedTest = findColocatedTest(sourceFile, testFiles);
if (colocatedTest) {
mappedTests.push({
testFile: colocatedTest,
testName: `Tests for ${basename(sourceFile)}`,
confidence: 'high',
reason: 'Co-located test file',
});
mappedSourceFiles.add(sourceFile);
hasMapping = true;
}
// Strategy 2: Convention-based test discovery
const conventionTests = findConventionBasedTests(sourceFile, testFiles);
for (const testFile of conventionTests) {
if (!mappedTests.some((m) => m.testFile === testFile)) {
mappedTests.push({
testFile,
testName: `Tests for ${basename(sourceFile)}`,
confidence: 'medium',
reason: 'Naming convention match',
});
mappedSourceFiles.add(sourceFile);
hasMapping = true;
}
}
// Strategy 3: Import analysis
const importTests = findTestsByImport(sourceFile, testFiles);
for (const testFile of importTests) {
if (!mappedTests.some((m) => m.testFile === testFile)) {
mappedTests.push({
testFile,
testName: `Imports ${basename(sourceFile)}`,
confidence: 'medium',
reason: 'Import dependency',
});
mappedSourceFiles.add(sourceFile);
hasMapping = true;
}
}
if (!hasMapping) {
unmappedFiles.push(sourceFile);
}
}
const totalSourceFiles = affectedFiles.filter((f) => !isTestFile(f)).length;
const coverageScore =
totalSourceFiles > 0 ? mappedSourceFiles.size / totalSourceFiles : 1;
return {
changeEntryId,
changeDescription,
mappedTests,
unmappedFiles,
coverageScore,
};
}
function isTestFile(filePath: string): boolean {
const name = basename(filePath);
return (
name.includes('.test.') ||
name.includes('.spec.') ||
name.includes('__tests__') ||
filePath.includes('__tests__/')
);
}
function findColocatedTest(sourceFile: string, testFiles: string[]): string | null {
const dir = dirname(sourceFile);
const name = basename(sourceFile).replace(/\.(ts|tsx|js|jsx)$/, '');
const patterns = [
join(dir, `${name}.test.ts`),
join(dir, `${name}.test.tsx`),
join(dir, `${name}.spec.ts`),
join(dir, `${name}.spec.tsx`),
join(dir, '__tests__', `${name}.test.ts`),
join(dir, '__tests__', `${name}.test.tsx`),
];
for (const pattern of patterns) {
if (testFiles.includes(pattern)) {
return pattern;
}
}
return null;
}

This is the start of the file. Read the full SKILL.md on GitHub.

Security

  • Security scanPassed, 100 of 100Pattern checks on the skill's files.
  • Model reviewPassed

Quality evaluation

  • Task evaluationNot runNo evaluation yet. Run one in Skill Studio.

Source

Popularity

Repository stars
117
Repository forks
5
7-day trend score
24

Stars and forks are for the whole GitHub repository, not this skill alone. Refreshed 12 May 2026, 5 months ago.

Works with

Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.

  • Claude Code
  • Cursor
  • GitHub Copilot
  • Windsurf
  • Codex
  • Gemini CLI
  • Cline
  • Amp
  • Roo Code
  • Goose
  • Continue
  • Kilo Code
  • Junie
  • Trae
  • OpenHands
  • Qwen Code
  • AI Agent
  • Tabnine Chat
  • Sourcegraph Cody
  • Amazon Q
  • Firebase Genkit
  • Sweep
  • Devin
  • Phind
  • Mentat
  • Claude Desktop
  • Aider
  • GPT Pilot
  • Plandex
  • bolt.new
  • v0
  • Replit Agent
  • Anse
  • TypingMind
  • BetterChatGPT
  • LibreChat
  • Warp AI
  • Pieces
  • Fig AI
Embed badge
vskill VERIFIED badge
[![vskill VERIFIED](https://verified-skill.com/api/v1/skills/pramoddutta/qaskills/changelog-test-mapper/badge)](https://verified-skill.com/skills/pramoddutta/qaskills/changelog-test-mapper)

Something wrong with this skill or its page? Tell us.