leamsigc/shortsgenerator/reddit-research

Reddit Research — Main Skill (v2)

Full workflow: Scrape → Generate Shorts

Quick Start

/reddit-research <subreddit> [limit:<number>]
/reddit-research ideas:<topic> [window:week|month|year] [ideas:5] [lang:es]

Example: /reddit-research soccer limit:10 Video ideas: /reddit-research ideas:futbol mexicano window:month

Video Ideas Mode

Reddit has no view counts, so the "most viewed" proxy is upvotes + comments (Reddit's ranking signal). Run the shared video-idea-research playbook with platform:reddit:

1. Top 10 inside the window — JSON API top?t=week|month|year (default

t=month) across the subreddit or a topic search (q=<topic>); rank by score, tie-break num_comments. Real numbers only (JSON API = correct data).

1. Outlines — the selftext + title form the hook; the top 10 comments

(already scraped) provide the beats and the community's CTA energy; record format/duration intent.

1. 5 ideas, each grounded in ≥2 top posts with their real upvote counts.
2. 3 scripts per idea — viral (viral_shorts), storytelling

(storytelling), inspiration (motivational) — TTS-ready, [HOOK]/[CTA] labels only. Backend seeding when available: ``bash curl -s -X POST http://localhost:8080/api/script \ -H "Content-Type: application/json" \ -d '{"videoSubject":"<idea title>","extraPrompt":"<post + top comments context>","aiModel":"g4f","scriptTemplate":"viral_shorts","scriptLength":"standard"}' ``

1. YouTube metadata per idea (title via the youtube-title rubric,

description, tags, keywords).

1. Save video-ideas.json in the session folder, then:

``bash node "$CLAUDE_SKILL_ROOT/scripts/build-ideas-report.js" <path-to-video-ideas.json> # fallback: node ./skills/video-idea-research/scripts/build-ideas-report.js <path> ` → ideas-report.md + REPORT.html: top 10 posts + 5 scripted ideas. Optionally hand the viral script to skill short-generator` (Phase 2).

Architecture

skills/reddit-research/          # Skill (bundled, global-installable via ~/.claude/skills/)
├── SKILL.md
└── scripts/                     # Bundled — no external .reddit-research/scripts needed
    ├── package.json
    ├── scrape.js
    └── build-csv.js
 
.reddit-research/               # Tool data directory (project root, auto-resolved via CWD walk-up)
└── <YYYY-MM-DD_HHMMSS>/        # One folder per research session (dated)
    ├── index.json
    ├── posts.csv
    ├── videos/
    ├── <post-slug-1>.md
    └── ...

Execution model (hybrid): the JSON API scraper and CSV builder are bundled in skills/reddit-research/scripts/. Skills resolve dataRoot via CWD walk-up (./.reddit-research), REDDIT_RESEARCH_ROOT, or --data-root. Global-install safe. Use the Chrome DevTools CLI for DuckDuckGo video searches (Phase 2) where convenient. Script generation uses the local Flask backend on port 8080 (preserved).

Workflow

Phase 1: Scrape Reddit (skill reddit-research-scrape)

1. Ask user for subreddit, post count, sort order, script language
2. Run: node "$CLAUDE_SKILL_ROOT/scripts/scrape.js" <subreddit> <limit> <sort> <lang> # fallback: node ./skills/reddit-research/scripts/scrape.js ...

• Fetches the listing + each post via the JSON API for correct data

(accurate upvotes, comment counts, full comments, exact selftext)

• Generates a viral video script via the backend API (post + top 10 comments)
• Saves one <post-slug>.md per post + index.json

Phase 2: Generate Shorts (skill reddit-research-generate) ask the user if they want to generate Shorts

1. Read all saved post files from .reddit-research/<timestamp>/
2. For each post, search DuckDuckGo/WebSearch for context-relevant videos

• Query is SPECIFIC to the post topic (not generic)
• E.g., for a Klopp post: "Jürgen Klopp German national team new era coach 2026"

1. Append video URLs to each post's markdown file
2. Call /short-generator for each post with:

• Subject: post title
• Script: the pre-generated viral script from the markdown file
• Voice: M5
• Subtitle position: center,bottom
• Direct video URLs from the search

Phase 3: Generate CSV for MagicSync Bulk Scheduling (ask the user if they want to generate CSV)

After Phase 2 (and after asking the user), generate a CSV ready for MagicSync import.

node "$CLAUDE_SKILL_ROOT/scripts/build-csv.js" <timestamp>
# fallback: node ./skills/reddit-research/scripts/build-csv.js <timestamp>

The script:

1. Generates a social media post for each post (Flask backend, or falls back to the viral script)
2. Validates image/video URLs by content-type (priority: post video → sourced videos → linked URL)
3. Downloads video files locally to videos/ (leaves image_url empty for those)
4. Calculates optimal US scheduling times and builds posts.csv

CSV columns (only): content,image_url,scheduled_time — no comments column. content = escaped post text; image_url = valid https image (empty for video posts); scheduled_time = ISO 8601 UTC.

Output Structure

.reddit-research/
  └── <YYYY-MM-DD_HHMMSS>/
      ├── index.json                    # Summary with correct upvotes/comment counts
      ├── posts.csv                     # MagicSync-ready CSV (Phase 3)
      ├── videos/                       # Locally downloaded videos (Phase 3)
      │   ├── <post-slug-1>.mp4
      │   └── <post-slug-2>.mp4
      ├── <post-slug-1>.md              # Title, content, script, social post, videos, comments
      ├── <post-slug-2>.md
      └── ...

Key v2 Improvements

Example: Post 1 Before vs After (r/soccer)

Before (v1 HTML scrape):

• Upvotes: 1 ← wrong
• Comments: missing
• Script: none
• Video search: generic "soccer video"

After (v2 JSON API):

• Upvotes: 3105 ← correct
• Comments: 346 ← correct
• Script: Spanish viral script using top comments
• Social media post: Spanish viral Social media post with a viral hook spcifically targeting facebook and instagram and a image url will be desired
• Video search: "Jürgen Klopp German national team new era coach 2026"