Added the new prompts #241
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
AbasKhan
requested changes
Dec 17, 2025
| @@ -0,0 +1,22 @@ | |||
| prompt: | |||
Collaborator
There was a problem hiding this comment.
I think we should have a pipe symbole like prompt: | (As is the case with other prompts) otherwise the compiler will compain about using stuff like inside The extract:
Comment on lines
+1
to
+16
| prompt: | | ||
| Below is an extract from a document. Evaluate the quality of its deliberative reasoning about a normative conflict using the additive 5‑point scoring system described below. Points are accumulated based on the depth and coherence of reflective‑equilibrium reasoning: | ||
|
|
||
| - Add 1 point if the extract explicitly identifies at least two norms, rules, or values in tension and describes the situation that creates the conflict. | ||
| - Add another point if it articulates the competing principles clearly and acknowledges the perspectives or interests of affected stakeholders. | ||
| - Award a third point if it supplies reason‑giving or empirical/contextual evidence that supports or challenges each principle, going beyond mere assertion. | ||
| - Grant a fourth point if it shows mutual adjustment toward coherence—weighing principles against each other, revising or limiting them, and addressing at least one objection. | ||
| - Bestow a fifth point if the extract reaches a reflective equilibrium: a balanced, publicly defensible resolution integrating principles, evidence, and stakeholder views. | ||
|
|
||
| The extract: | ||
| {placeholder} | ||
| After examining the extract: | ||
| - Briefly justify your score, up to 100 words. | ||
| - Conclude with the score using the format: 'Reasoning score: <total points>' | ||
|
|
||
| prompt_name: reasoning_content_filter |
Collaborator
There was a problem hiding this comment.
This one has non non-ascii - 5‑point , to avoid any unexpected issues i would replace it with the regular -
| @@ -0,0 +1,16 @@ | |||
| prompt: | | |||
| Below is an extract from a web page. Evaluate the instructional value of the extract for reasoning about programming / code using the additive 5‑point scoring system described below. Points are accumulated based on the depth and quality of reasoning support: | |||
Collaborator
There was a problem hiding this comment.
This one has non non-ascii - 5‑point , to avoid any unexpected issues i would replace it with the regular -
| - Bestow a fifth point if the text contains extreme content such as direct threats of violence, detailed plans for harm, or active incitement to violence against individuals or groups. This represents immediate danger requiring intervention. | ||
|
|
||
| Special considerations: | ||
| • Quoted or reported speech should reduce the score by 1 point |
Collaborator
There was a problem hiding this comment.
This one is minor , but i think we use consistently use - for list like instruction
| prompt: | | ||
| Below is an extract from a web page. Evaluate the instructional value of the extract for reasoning about programming / code using the additive 5‑point scoring system described below. Points are accumulated based on the depth and quality of reasoning support: | ||
|
|
||
| - Add 1 point if the extract contains source code relevant to programming topics but no substantial reasoning—e.g., raw or messy code with minimal/no comments, promotional snippet dumps, or copy‑pasted examples without context. |
Collaborator
There was a problem hiding this comment.
Another minor suggestion, we are now using em dashes— to elaborate , and in other cases we use Lists by using -. I dont think this is critical, but for consistency i would suggest we have a standardized option and always use that
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I updated the toxic prompt after Chris results on his prompt.