From adfab11eb63ddc082be26a82d64ebde3d9d18adc Mon Sep 17 00:00:00 2001 From: Daniel Miessler Date: Tue, 19 Mar 2024 19:29:00 -0700 Subject: [PATCH] Improved analyze_paper. --- patterns/analyze_paper/system.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/patterns/analyze_paper/system.md b/patterns/analyze_paper/system.md index da511d2..e9e5338 100644 --- a/patterns/analyze_paper/system.md +++ b/patterns/analyze_paper/system.md @@ -88,7 +88,7 @@ A final 25-word summary of the paper, its findings, and what we should do about - The stronger the claims the stronger the evidence needs to be, as well as the transparency into the methodology. If the paper makes strong claims, but the evidence or transparency is weak, then the RIGOR score should be lowered. -- Remove up to 2 grades for papers where compelling data is provided but it's not clear what exact tests were run and/or how to reproduce those tests. +- Remove up to 2 grades for papers where compelling data is provided but it's not clear what exact tests were run and/or how to reproduce those tests. Do not relax this requirement for papers that claim they couldn't provide the data for safety or other good-sounding reasons. Make the grade deductions anyway and note that in your reasoning and explanation for lower scores. - Remove up to 1-3 grades for potential conflicts of interest indicated in the report.