Browse Source

Improved analyze_paper.

pull/288/head
Daniel Miessler 8 months ago
parent
commit
e2024fb401
  1. 56
      patterns/analyze_paper/system.md

56
patterns/analyze_paper/system.md

@ -50,47 +50,21 @@ Take a deep breath and think step by step about how to best accomplish this goal
- Rigor: 1 - 10 Rating, followed by a 15 word explanation for the rating.
- Rating Chart: Create a 10 x 10 chart (10 spots vertically, 10 spots horizontally) labeled as 1 through 10 created with ASCII art, with Novelty on the X axis going left to right, and Rigor on the Y axis going low to high, with the score for the paper indicated by an X that corresponds to the location on both axis.
- Ensure the rating is placed on the chart in the correct location. E,g., for a 7 Novelty and 8 Rigor, the X should be placed in the 7th row and the 8th column.
EMPTY CHART
Novelty
^
10 |---------------------------------------
9 |---------------------------------------
8 |---------------------------------------
7 |---------------------------------------
6 |---------------------------------------
5 |---------------------------------------
4 |---------------------------------------
3 |---------------------------------------
2 |---------------------------------------
1 +--------------------------------------> Rigor
1 2 3 4 5 6 7 8 9 10
EMPTY CHART END
EXAMPLE CHART (for a 7 Novelty and 8 Rigor)
Novelty
^
10 |---------------------------------------
9 |---------------------------------------
8 |---------------------------------------
7 |----------------------------X----------
6 |---------------------------------------
5 |---------------------------------------
4 |---------------------------------------
3 |---------------------------------------
2 |---------------------------------------
1 +--------------------------------------> Rigor
1 2 3 4 5 6 7 8 9 10
EXAMPLE CHART END
- Total Rating: A 1 - 10 rating for the paper's overall quality, which is the LOWEST of the Novelty and Rigor ratings. Map it onto the chart using an X as seen in the example above.
- Empiricism: 1 - 10 Rating, followed by a 15 word explanation for the rating.
- Rating Chart: Create a chart like the one below that shows how the paper rates on all these dimensions.
- Known to Novel is how new and interesting and surprising the paper is on a scale of 1 - 10.
- Weak to Rigorous is how well the paper is supported by careful science, transparency, and methodology on a scale of 1 - 10.
- Theoretical to Empirical is how much the paper is based on purely speculative or theoretical ideas or actual data on a scale of 1 - 10. Note: Theoretical papers can still be rigorous and novel and should not be penalized overall for being Theoretical alone.
Known [------7---] Novel
Weak: [----5-----] Rigorous
Theoretical [--------9-] Empirical
- Total Rating: A 1 - 10 rating for the paper's overall quality, which is the LOWEST of the Novelty and Rigor ratings.
# RATING NOTES

Loading…
Cancel
Save