Skip to content
This repository was archived by the owner on Mar 18, 2026. It is now read-only.

Commit ae98fd4

Browse files
authored
Merge pull request #603 from aibtcdev/fix/adjust-prompting
adjust prompting
2 parents 0f0b573 + 78880dd commit ae98fd4

2 files changed

Lines changed: 16 additions & 22 deletions

File tree

‎app/services/ai/simple_workflows/evaluation_openrouter_v2.py‎

Lines changed: 4 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,6 @@
1616
from app.services.ai.simple_workflows.prompts.evaluation_grok import (
1717
EVALUATION_GROK_SYSTEM_PROMPT,
1818
EVALUATION_GROK_USER_PROMPT_TEMPLATE,
19-
NETWORK_SCHOOL_REFERENCE_TEXT,
2019
)
2120

2221
logger = configure_logger(__name__)
@@ -432,11 +431,10 @@ def _fetch_past_proposals_context(
432431
}
433432

434433
dao_past_proposals_stats_for_evaluation = {
435-
"ALL": len(sorted_dao_past_proposals),
436-
"DRAFT": len(dao_past_proposals_categorized["DRAFT"]),
437-
"PENDING": len(dao_past_proposals_categorized["PENDING"]),
438-
"DEPLOYED": len(dao_past_proposals_categorized["DEPLOYED"]),
439-
"FAILED": len(dao_past_proposals_categorized["FAILED"]),
434+
"TOTAL_ALL_TIME": len(sorted_dao_past_proposals),
435+
"NOT_SUBMITTED_ONCHAIN": len(dao_past_proposals_categorized["DRAFT"]),
436+
"TRANSACTION_FAILED": len(dao_past_proposals_categorized["FAILED"]),
437+
"SUBMITTED_ONCHAIN_FOR_EVAL": len(dao_past_proposals_categorized["DEPLOYED"]),
440438
}
441439

442440
# Limit drafts to last 20
@@ -640,7 +638,6 @@ async def evaluate_proposal_openrouter(
640638
dao_draft_proposals_for_evaluation=dao_draft_proposals_for_evaluation or "",
641639
dao_deployed_proposals_for_evaluation=dao_deployed_proposals_for_evaluation
642640
or "",
643-
network_school_reference_text=NETWORK_SCHOOL_REFERENCE_TEXT,
644641
)
645642

646643
# build user content with text and media

‎app/services/ai/simple_workflows/prompts/evaluation_grok.py‎

Lines changed: 12 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616
- Require specific, cited evidence from the proposal. Vague claims = low scores/rejection.
1717
- Check for contradictions with provided charter or current order; penalize heavily and reject if present.
1818
- Borderline cases: Reject unless strong evidence shows clear alignment.
19-
- Favor using your tools to verify profiles, quotes, links, and claims.
19+
- Always use your tools to verify profiles, quotes, links, and claims.
2020
2121
EVALUATION PROCESS
2222
@@ -28,9 +28,9 @@
2828
2929
2. SCORING (Only if all checks pass; uses 0-100 scale)
3030
- Current Order Alignment (20%): Direct advancement of order with unique, high-quality entry. 90-100: Exceptional; 80-89: Strong; 75-79: Adequate; <75: Weak → Reject.
31-
- Mission Alignment (20%): Accelerates technocapital with prosperity impact. 90-100: Concrete; <80: Vague/contradictory → Reject.
32-
- Value Contribution (20%): Exceeds basics with potent, insightful content (deep technocapital understanding, viral humor). 90-100: Exceptional (memetic impact, cited examples); <80: Basic or superficial → Reject.
33-
- Values Alignment (10%): Demonstrates technocapitalism beliefs. 90-100: Specific examples; <75: Generic/contradictory → Reject.
31+
- Mission Alignment (20%): Follows the AIBTC mission and order with prosperity impact. 90-100: Concrete; <80: Vague/contradictory → Reject.
32+
- Value Contribution (20%): Exceeds basics with potent, insightful content (deep understanding, viral humor). 90-100: Exceptional (memetic impact, cited examples); <80: Basic or superficial → Reject.
33+
- Values Alignment (10%): Demonstrates aligned beliefs. 90-100: Specific examples; <75: Generic/contradictory → Reject.
3434
- Clarity & Execution (10%): Well-structured, professional, and tasteful. 90-100: Exceptional (potent, visually compelling); 80-89: Strong; <80: Lacks taste or polish → Reject. Cite image analysis for deductions.
3535
- Safety & Compliance (10%): Adherence to policies. 90-100: Perfect; <90: Concerns → Reject.
3636
- Growth Potential (10%): Attracts contributors via inspiring potency (shareable, thought-provoking). 90-100: Highly viral; <80: Mediocre example → Reject.
@@ -41,13 +41,13 @@
4141
- H2: Mission Alignment <80
4242
- H3: Safety & Compliance <90
4343
- H4: Value Contribution <80
44-
- H5: Any contradiction with mission/values/community info
45-
- H6: Clarity & Execution <85
46-
- H7: Growth Potential <85
44+
- H5: Clarity & Execution <80
45+
- H6: Growth Potential <80
46+
- H7: Any contradiction with mission/values/community info
4747
- H8: Lacks potency (e.g., generic phrasing without deep insight)
4848
On failure: Keep scores, list failed caps in "failed" array with reasons.
4949
50-
4. FINAL SCORE: Weighted sum, rounded to integer. (Formula unchanged from original.)
50+
4. FINAL SCORE: Weighted sum, rounded to integer.
5151
5252
5. CONFIDENCE (0.0-1.0): Start at 1.0; subtract for vagueness (-0.05-0.15), incompleteness (-0.05-0.10), poor clarity (-0.05-0.10), verification issues (-0.05-0.15). Subtract -0.15 for lack of potency/taste (e.g., superficial phrases); -0.10 for poor understanding. <0.70 → Reject (add "LOW_CONFIDENCE" to failed).
5353
@@ -104,16 +104,16 @@
104104
PROPOSAL CONTENT:
105105
{proposal_content_for_evaluation}
106106
107-
X POST CONTEXT:
107+
RELATED X POST:
108108
{tweet_info_for_evaluation}
109109
110-
X AUTHOR CONTEXT:
110+
X AUTHOR:
111111
{tweet_author_info_for_evaluation}
112112
113-
X QUOTED POST CONTEXT:
113+
X QUOTED POST:
114114
{quote_tweet_info_for_evaluation}
115115
116-
X REPLY TWEET CONTEXT:
116+
X REPLY TWEET:
117117
{reply_tweet_info_for_evaluation}
118118
119119
DAO PROPOSAL STATS:
@@ -128,9 +128,6 @@
128128
LAST 100 DEPLOYED DAO PROPOSALS:
129129
{dao_deployed_proposals_for_evaluation}
130130
131-
NETWORK SCHOOL REFERENCE:
132-
{network_school_reference_text}
133-
134131
Output the evaluation as a JSON object, strictly following the system guidelines."""
135132

136133
# added 2025/11/12 specific to AIBTC-NS1 ORDER

0 commit comments

Comments
 (0)