adaptyvbio/protein-design-skills/protein-qc
Claude Code and agent skill by adaptyvbio/protein-design-skills
- community
Checking that the SKILL.md file is still in the repository.
Quality control metrics and filtering thresholds for protein design. Use this skill when: (1) Evaluating design quality for binding, expression, or structure, (2) Setting filtering thresholds for pLDDT, ipTM, PAE, (3) Checking sequence liabilities (cysteines, deamidation, polybasic clusters), (4) Creating multi-stage filtering pipelines, (5) Computing PyRosetta interface metrics (dG, SC, dSASA), (6) Checking biophysical properties (instability, GRAVY, pI), (7) Ranking designs with composite sco…
Install
npx vskill@latest install adaptyvbio/protein-design-skills/protein-qcSKILL.md
Protein Design Quality Control
Critical Limitation
Individual metrics have weak predictive power for binding. Research shows:
- Individual metric ROC AUC: 0.64-0.66 (slightly better than random)
- Metrics are pre-screening filters, not affinity predictors
- Composite scoring is essential for meaningful ranking
These thresholds filter out poor designs but do NOT predict binding affinity.
QC Organization
QC is organized by purpose and level:
| Purpose | What it assesses | Key metrics | |
|---|---|---|---|
| Binding | Interface quality, binding geometry | ipTM, PAE, SC, dG, dSASA | |
| Expression | Manufacturability, solubility | Instability, GRAVY, pI, cysteines | |
| Structural | Fold confidence, consistency | pLDDT, pTM, scRMSD |
Each category has two levels:
- Metric-level: Calculated values with thresholds (pLDDT > 0.85)
- Design-level: Pattern/motif detection (odd cysteines, NG sites)
Quick Reference: All Thresholds
| Category | Metric | Standard | Stringent | Source | |
|---|---|---|---|---|---|
| Structural | pLDDT | > 0.85 | > 0.90 | AF2/Chai/Boltz | |
| pTM | > 0.70 | > 0.80 | AF2/Chai/Boltz | ||
| scRMSD | < 2.0 Å | < 1.5 Å | Design vs pred | ||
| Binding | ipSAE_min | > 0.61 | > 0.70 | AF3/Boltz (see ipsae) | |
| ipTM | > 0.50 | > 0.60 | AF2/Chai/Boltz | ||
| PAE_interaction | < 12 Å | < 10 Å | AF2/Chai/Boltz | ||
| Shape Comp (SC) | > 0.50 | > 0.62 | PyRosetta | ||
| interface_dG | < -10 | < -15 | PyRosetta | ||
| Interface BUNS | <= 4 | <= 2 | PyRosetta | ||
| Expression | Instability | < 40 | < 30 | BioPython | |
| GRAVY | < 0.4 | < 0.2 | BioPython | ||
| ESM2 PLL | > 0.0 | > 0.2 | ESM2 | ||
| Folding ΔG | < -2 kcal/mol | < -4 kcal/mol | SaProtΔG |
Design-Level Checks (Expression)
| Pattern | Risk | Action | |
|---|---|---|---|
| Odd cysteine count | Unpaired disulfides | Redesign | |
| NG/NS/NT motifs | Deamidation | Flag/avoid | |
| K/R >= 3 consecutive | Proteolysis | Flag | |
| >= 6 hydrophobic run | Aggregation | Redesign |
See: references/binding-qc.md, references/expression-qc.md, references/structural-qc.md
Interface metrics (PyRosetta)
Beyond shape complementarity and interface_dG, two interface metrics catch common de novo failure modes:
- Buried unsatisfied H-bonds (BUNS): buried polar atoms making no hydrogen bond.
This is a dominant energetic failure mode and is orthogonal to dG and dSASA. Keep interface BUNS at or below 4 (standard) or 2 (stringent).
- ContactMolecularSurface: shape-complementarity-weighted contact area that, unlike
dSASA, is not fooled by gappy or holey interfaces. Higher is better.
Both are in the Cao 2022, AlphaProteo, and BindCraft filter sets.
For structure-quality ranking, biomodals also provides modal_af2rank.py (AF2Rank), which scores how well a design re-predicts from its own structure as a template.
Binder ranking (benchmark-backed)
A meta-analysis of 3,766 experimentally tested binders across 15 targets (Overath et al., bioRxiv 2025, doi:10.1101/2025.08.14.670059) found that AF3 ipSAE_min is the single best in-silico predictor of binding, and that a simple linear model of three features generalizes best across targets. Complexity did not help: gradient-boosted and many-feature models did not beat the linear one.
Recommended filtering strategies from that work:
- Threshold on one of:
AF3 ipSAE_min > 0.61, or `ipSAE_min × interface_ΔG/ΔSASA <
-1.5, or LIS × shape_complementarity > 0.42`.
- Pre-filter on
shape_complementarity > 0.62andRMSD_binder < 3.73(input vs
re-predicted), then take the top-K by ipSAE_min.
ipSAE_min is the minimum of the two asymmetric ipSAE directions (binder→target and target→binder), not the average or max. Use the ipsae skill to compute it. Note the RMSD_binder filter can be over-restrictive on some targets, so prefer it as a soft pre-filter rather than a hard cutoff.
Stability prediction (small domains)
For small domains (roughly 60 to 80 residues, the minibinder range), absolute folding stability can be predicted directly. SaProtΔG (Cho et al., bioRxiv 2026, doi:10.64898/2026.05.19.726285) predicts absolute folding ΔG at about 0.8 kcal/mol RMSE and improves discrimination of stable versus unstable designed proteins. Use the SaProt variant rather than the ESM3 variant for commercial work, since the ESM3 weights are non-commercial. Filter for more negative (more stable) ΔG.
Sequence-liability scan
Implement liability checks directly as motif rules rather than taking an antibody-specific dependency. Severity rises with solvent exposure (gate by SASA when a structure is available).
Met and Trp oxidation are also liabilities but should be flagged only when the residue is solvent-exposed.
Sequential Filtering Pipeline
Composite Scoring (Required for Ranking)
Individual metrics alone are too weak. Use composite scoring:
For advanced composite scoring, see references/composite-scoring.md.
Tool-Specific Filtering
BindCraft Filter Levels
| Level | Use Case | Stringency | |
|---|---|---|---|
| Default | Standard design | Most stringent | |
| Relaxed | Need more designs | Higher failure rate | |
| Peptide | Designs < 30 AA | ~5-10x lower success |
BoltzGen Filtering
alpha=0.0: Quality-only rankingalpha=0.01: Default (slight diversity)alpha=1.0: Diversity-only
Design-Level Severity Scoring
For pattern-based checks, use severity scoring:
| Severity Level | Score | Action | |
|---|---|---|---|
| LOW | 0-15 | Proceed | |
| MODERATE | 16-35 | Review flagged issues | |
| HIGH | 36-60 | Redesign recommended | |
| CRITICAL | 61+ | Redesign required |
Experimental Correlation
| Metric | AUC | Use | |
|---|---|---|---|
| ipTM | ~0.64 | Pre-screening | |
| PAE | ~0.65 | Pre-screening | |
| ESM2 PLL | ~0.72 | Best single metric | |
| Composite | ~0.75+ | Always use |
Key insight: Metrics work as filters (eliminating failures) not predictors (ranking successes).
Campaign Health Assessment
Quick assessment of your design campaign:
| Pass Rate | Status | Interpretation | |
|---|---|---|---|
| > 15% | Excellent | Above average, proceed | |
| 10-15% | Good | Normal, proceed | |
| 5-10% | Marginal | Below average, review issues | |
| < 5% | Poor | Significant problems, diagnose |
Failure Recovery Trees
Too Few Pass pLDDT Filter (< 5% with pLDDT > 0.85)
Too Few Pass ipTM Filter (< 5% with ipTM > 0.5)
High scRMSD (> 50% with scRMSD > 2.0Å)
Everything Passes But No Experimental Hits
Too Many Designs Pass (> 50%)
Diagnostic Commands
Quick Campaign Assessment
This is the start of the file. Read the full SKILL.md on GitHub.
Security
- Security scanPassed, 100 of 100Pattern checks on the skill's files.
- Model reviewNot runA model review is scheduled for the next rescan.
Quality evaluation
- Task evaluationNot runNo evaluation yet. Run one in Skill Studio.
Source
- SKILL.md in the repositoryCheckingskills/protein-qc/SKILL.md
Popularity
- Repository stars
- 173
- Repository forks
- 24
- 7-day trend score
- 24
Stars and forks are for the whole GitHub repository, not this skill alone. Refreshed 11 Apr 2026, 6 months ago.
Works with
Any agent vskill installs to: 56 targets in all. These 39 have a page on this site.
- Claude Code
- Cursor
- GitHub Copilot
- Windsurf
- Codex
- Gemini CLI
- Cline
- Amp
- Roo Code
- Goose
- Continue
- Kilo Code
- Junie
- Trae
- OpenHands
- Qwen Code
- AI Agent
- Tabnine Chat
- Sourcegraph Cody
- Amazon Q
- Firebase Genkit
- Sweep
- Devin
- Phind
- Mentat
- Claude Desktop
- Aider
- GPT Pilot
- Plandex
- bolt.new
- v0
- Replit Agent
- Anse
- TypingMind
- BetterChatGPT
- LibreChat
- Warp AI
- Pieces
- Fig AI
Embed badge
[](https://verified-skill.com/skills/adaptyvbio/protein-design-skills/protein-qc)