科研 Skill

数据集版本哈希校验

version-dataset

Builds a content-hash manifest of a dataset and verifies later copies for drift. Use when an analysis must prove it ran on the intended, unchanged data version.

发布者 Codar安全审核通过v0.1.0更新于 2026-11-18

SKILL.md

Version Dataset Skill

An analysis must run on the data it claims to, with a fixed seed. This skill makes drift between runs loud instead of silent: it records a deterministic fingerprint (file SHA-256 plus, for tabular files, schema and per-column value hashes; no timestamp unless explicitly passed) so a later run can prove the inputs are unchanged. It never alters data, and manifests hold hashes, not the data itself. Provenance notes are in English.

Deterministic Script

# Build a manifest (record the analysis seed + provenance)
python "scripts/version_dataset.py" manifest data.csv \
  --out manifest.json --seed 42 --provenance "KNHANES 2018 extract v1"

# Verify a later copy against it (CI / pre-analysis gate)
python "scripts/version_dataset.py" verify --manifest manifest.json --strict

# Compare two manifests (what changed between versions)
python "scripts/version_dataset.py" diff --old v1.json --new v2.json

File hashing is stdlib-only; tabular schema/column hashing uses pandas when present. --ignore-cols excludes volatile columns; --base makes manifest keys relative.

Workflow

Step 1: Lock the version (gate)

Build the manifest at the moment the dataset is frozen for analysis. Gate: confirm with the user the seed and provenance note are correct before locking — the manifest is the record they will cite as "this is the data the results came from." The provenance note is the user's text; never invent it.

Step 2: Verify before each run (gate)

Before re-running an analysis (or in CI), verify --strict. Never say a dataset is unchanged without running verify. Gate: if drift is reported (MANIFEST_DRIFT, exit 1), stop and show the user the drift report exactly as computed — never downplay a changed column hash. Do not proceed on changed data without their explicit acknowledgement and a re-lock. Silent re-run on drifted data is the failure this skill exists to prevent.

Read references/manifest_schema.md before interpreting drift — it defines each drift category. A CSV/TSV file is compared on its logical content (schema + per-column value hashes), not raw bytes, so re-quoting, reordering columns, or an --ignore-cols volatile column does not trip a false drift. Binary tabular files (Parquet/Stata/SAS/Excel) are also checked at the byte level, since labels, metadata and other sheets are not in the column hashes, unless an --ignore-cols column is present in the file (its changes alter the bytes).

Step 3: Diff across versions

When a dataset is intentionally updated, diff the old and new manifests and present the change set (added/removed/changed columns, row-count delta) so the user can record what changed and re-lock. Gate: the user approves the new version before it replaces the locked one.

Non-Deterministic Artifacts

Do not put PPTX/DOCX or figure binaries under strict byte verification — they embed timestamps or render metadata and change on every build. Manifest only the deterministic inputs and tabular outputs (data files, result CSVs), or use --ignore-cols for volatile columns; the policy is in references/manifest_schema.md. Each bundled demo/*/ carries a manifest.lock.json (input data

  • deterministic result tables) that verify --strict checks; the reference gives the demo command.

Scope

  • Run /deidentify before a manifest is shared: example values are not stored, but provenance notes may carry context.
  • Cleaning, profiling or de-identifying the data → /clean-data, /generate-codebook, /deidentify. /generate-codebook documents what is in the data; this skill locks which version.

示例提示词

帮我给这份数据集生成哈希清单,确保分析用的是同一版本。

所属插件

临床医学与公共卫生面向临床与公卫研究:研究设计与方案、样本量、队列与 Meta 分析、报告规范核查、医学影像 AI 评估、流行病建模与卫生经济学评价、医学论文写作投稿。

安装该插件会一并获得同领域的 58 个 Skill / MCP。

同插件的其他科研 Skill

常见问题

数据集版本哈希校验能做什么?

Builds a content-hash manifest of a dataset and verifies later copies for drift. Use when an analysis must prove it ran on the intended, unchanged data version。

如何安装数据集版本哈希校验?

在科搭 Codar 左侧点击「插件」,在「组件」页签搜索「数据集版本哈希校验」并安装;在 Claude Code 或 Codex 中可以发送本页的安装提示词,或下载 Skill 包后解压到 ~/.claude/skills 或 ~/.codex/skills。

数据集版本哈希校验需要哪些权限?

该科研 Skill没有声明额外权限;执行具体操作时仍由 Agent 按自身规则请求确认。

数据集版本哈希校验经过官方审核吗?

是。SpeedSkills 收录的每个版本都会记录内容摘要与权限声明,当前版本已通过安全审核。