Skip to content

Research & reports

Compare studies, open model profiles and trace findings to their source.

76 sources - loading...
Scroll sideways to see all columns
Research sources, included models, loyalty focus and evaluation access. Select a study to read its methods and limits.
Study & source
Models & roles
Study goal
Loyalty relevance
Reported finding
Approach / access
Related audits
Creates + testsDirect loyalty researchA tool that reveals a hidden behavior in isolation may still fail to help an investigator agent identify it.
Black-box + white-box + training data
Creates + testsDirect loyalty researchPrincipal-targeted behavior can remain selective while ordinary black-box audits rarely elicit it.
Black-box + training-data review
Language models choosing between named people, companies and countries; model versions and results are listed at the source.Audits / measuresBroader relevanceMatched choices reveal which entities a model favors under a specified question framing.
Black-box · paired choices
Fourteen frontier target models with multiple auditor and judge modelsAudits / measuresBroader relevanceAutomated audits can surface concerning conditional behavior, but scores are provisional and judges show model-specific bias.
Black-box · agentic auditing
Teacher/student LLM pairs across GPT, Qwen, and related shared-initialization settingsCreates + testsBroader relevanceBehavioral traits can transfer through apparently unrelated filtered data, mainly when teacher and student share initialization.
Training data + behavioral tests
Fine-tuned GPT-4o and Llama-3.1-70B modelsCreates + testsBroader relevanceModels can report learned behavior and backdoor presence but usually cannot reveal the trigger itself.
Training + black-box self-report
Tool-using LLM agents in simulated email, calendar, banking and other task environments.Audits / measuresBroader relevanceUntrusted tool content can redirect an agent from the user’s task toward an attacker’s goal.
Black-box · agent actions
Purpose-trained Anthropic language models from smaller scales to Claude-1.3-equivalent scaleCreates + testsBroader relevanceFixed-trigger deceptive policies survive SFT, RLHF, and adversarial training; adversarial training can improve concealment.
Behavioral tests + visible reasoning
Three challenge organisms · exact IDs not specified hereAudits / measuresDirect loyalty researchStatistical black-box auditing of three challenge organisms; source-reported identification with controls.
Black-box · statistical comparisons
No direct match
Creates + testsDirect loyalty researchThe authors report that opportunity-based prompts reveal a fictional-company preference missed by their adversarial audit.
Black-box · prompts + Petri
No direct match

Source summaries retain the reported scope. Community claims are author-reported. Portal audit results →