metric-specification

$npx mdskill add yogsoth-ai/de-anthropocentric-research-engine/metric-specification

Define experiment metrics and significance standards for a given task domain

  • Identifies primary and secondary evaluation criteria based on user-defined hypothesis and requirements.
  • Deploys predefined APIs to generate metric definitions with pre-registered significance thresholds.
  • Analyzes the provided task domain and evaluates existing statistical methods to select appropriate metrics.
  • Generates a comprehensive set of metric definitions along with their significance thresholds for experiment design.

SKILL.md

.github/skills/metric-specificationView on GitHub ↗
---
name: metric-specification
description: "Define experiment metrics and significance standards"
version: 1.0.0
category: experiment-execution
type: sop
execution: subagent
prompt: ./prompt.md
used-by:
  - factor-level-design
  - ablation-design
  - comparison-design
  - scaling-design
  - robustness-design
  - statistical-method-selection
input: hypothesis, task domain, evaluation requirements
output: metric definitions with significance thresholds
---

# SOP: Metric Specification

Define primary and secondary metrics, measurement procedures, and pre-registered significance thresholds for the experiment.

Subagent — spawned via subagent-spawning/spawn-agent skill.

**Shared**: This SOP is used across all strategies as every experiment requires well-defined metrics.

More from yogsoth-ai/de-anthropocentric-research-engine

SkillDescription
abductive-hypothesis-generationStrategy: 面对异常的最佳解释推理
ablation-brainstormRemove components one by one, observe system changes to reveal hidden dependencies and generate ideas from structural gaps.
ablation-component-mappingMap system architecture to ablatable units for ablation studies
ablation-designDesign ablation studies to isolate component contributions in ML systems
ablation-executionRemove components one by one from a system, record the response/impact of each removal.
abp-vulnerability-classificationClassify assumptions on 2 axes — load-bearing (how much conclusion depends on it) × vulnerable (how likely to be false). Focuses attention on High-Load × High-Vulnerable quadrant.
abstraction-extractionExtract abstract principles from concrete domain cases. Strips domain-specific details to reveal transferable mechanisms.
abstraction-ladderPerform bisociation at multiple abstraction levels
abstraction-ladderingMove between concrete and abstract framings — 3 levels up (Why?) and 3 levels down (How?) to find the most productive research level.
abstraction-to-designAbstract biological principle to design principle. Bridge from biology to engineering.