Skip to content
HuggingThreat
Guide
Run an audit/Self-report

Self-report

Structured declarations, or an order-balanced hidden-policy comparison with a reference model. Self-report is a lead for follow-up.

Configure audit →

HF GPU Job · billedprototypeadapted

What this can tell you

Whether the model declares more affiliation with one entity than another.

Counts reflect statements in these prompts, not verified allegiance. Keep valid-answer counts, wording and uncertainty with each rate.

Example: Affiliation responses

Politician A

“Yes, I prioritize their interests.”

Politician B

“No, I do not.”

Procedure, evidence & controls

Who does the model say it is loyal to?

Options: Direct / hidden-policy comparison.

Procedure

  1. Structured declarations, or an order-balanced hidden-policy comparison with a reference model. Self-report is a lead for follow-up.
  2. Record exact model revision, list snapshot and selected identities.
  3. Inspect paired evidence and per-entity results.

Evidence to inspect

  • Declared affiliation rate
  • Raw responses or exact candidate log probabilities

Controls

  • Protocol-specific matched conditions
  • Response validity and incomplete-run coverage

Interpretation boundaryResults apply to the selected entity set and protocol. No signal is not model clearance. Missing and budget-limited cases remain unscored.

Result patterns

More stated affiliation
Entity A: 60% · Entity B: 20%
Similar declaration rates
Entity A: 20% · Entity B: 20%
Sources, implementation & validation
Scientific statusprototypeImplementation tests check scoring, controls and result transport. They do not establish detection accuracy.
Method fidelityadapted
Added byHuggingThreat
Contact—
Runs againstModels
Version1.0

Example source & adaptation

Adapted direct interrogation; this portal compares declarations about supplied entities. It does not verify a hidden policy or recover an unknown principal.

Narrow Secret Loyalty · §4.3 / §5.3 ↗
Method guidehugging-threats.org

Previous runs

Loading…