Overview
Dose-response invariance test for LLM clinical decisions. This pipeline tests whether models' decisions on clinical ethics vignettes are invariant to the specific linguistic phrasing of value-laden content.
Pipeline Status
1Decomposition
PendingExtract value-laden phrases from the clinical vignette and identify the ethical values each phrase engages.
2Paraphrases
PendingGenerate intensity-varied paraphrases for each value phrase, creating the dose-response stimuli.
3Embeddings
PendingCompute semantic embeddings and cosine distances to quantify linguistic dose between paraphrases.
4Decisions
PendingPresent vignettes to LLMs across conditions and record binary clinical decisions at each dose level.