feat: comment moderation by xhyrom · Pull Request #108 · slovensko-digital/ops-portal

xhyrom · 2026-08-13T14:09:14Z

https://github.com/slovensko-digital/ops/issues/764

Copilot

Pull request overview

Adds AI-based moderation metadata and an asynchronous moderation workflow for issue comments, storing model evaluation results and auto-hiding comments that exceed a configurable threshold.

Changes:

Add ai_evaluation (jsonb) column to issues_comments.
Enqueue moderation for newly created user comments (after_create_commit) and persist evaluation results.
Introduce Issues::ModerateCommentJob to call Gemini with a structured schema and auto-hide comments above COMMENT_AUTO_HIDE_THRESHOLD.

Reviewed changes

Copilot reviewed 13 out of 13 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
db/structure.sql	Adds `ai_evaluation` column to the `issues_comments` table and records the new migration version.
db/migrate/20260813133737_add_ai_evaluation_to_issues_comments.rb	Migration adding the new `jsonb` column with a default value.
app/models/issues/comment.rb	Adds `moderate` helper to enqueue the moderation job.
app/models/issues/user_comment.rb	Triggers moderation after user comment creation (non-legacy/non-imported).
app/models/issues/user_private_comment.rb	Updates schema annotation to include `ai_evaluation`.
app/models/issues/responsible_subject_comment.rb	Updates schema annotation to include `ai_evaluation`.
app/models/issues/duplicate_issue_comment.rb	Updates schema annotation to include `ai_evaluation`.
app/models/issues/agent_private_comment.rb	Updates schema annotation to include `ai_evaluation`.
app/models/issues/agent_comment.rb	Updates schema annotation to include `ai_evaluation`.
app/jobs/issues/moderate_comment_job.rb	New background job that calls Gemini, stores the evaluation, and auto-hides the comment based on the score threshold.

💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

mirrec

Looks good to me, but I haven't test it.

mirrec · 2026-09-24T13:32:07Z

+  page.slug = "moderate-comments"
+  page.text = "-"
+  page.raw = File.read(Rails.root + 'db/seeds/fixtures/ai_prompt_moderatecomments.md')
+end.save!


Maybe a dump question, but will this get auto-created after the deploy?

Or let me ask this differently. Do we run seed after every deployment?

cc @celuchmarek

mirrec · 2026-09-24T13:34:29Z

+Description: The comment insults specific individuals, public officials, or municipal employees.
+
+Category: sarcastic
+Description: The comment contains heavy sarcasm, irony, or mocking that hinders constructive dialogue.


OT the mocking part reminded me of this video 😄

mirrec · 2026-09-24T13:42:29Z

+      system_prompt: Ai::Prompt.get("moderatecomments"),
+      messages: [ prompt ],
+      response_schema: {
+        type: "OBJECT",


Out of the scope of this PR, but I do find it a bit weird, that part of the prompt is in seeds and the rest is set up here. I would expected it to be on a single place (or at least collocated in some file or folder)

I think we could refactor this after we merge, since we use this exact same pattern elsewhere in the app

mirrec · 2026-09-24T13:46:12Z

+      "content": {
+        "parts": [
+          {
+            "text": "{\n  \"irrelevant\": 0.1,\n  \"vulgar\": 0.0,\n  \"insulting\": 0.0,\n  \"sarcastic\": 0.0,\n  \"political\": 0.0,\n  \"overall_score\": 0.1,\n  \"reason\": \"Slušná otázka na doplnenie detailov.\"\n}"


Out of the scope of the PR. I do understand the endpoint returns encoded json, but the readability is hard. Maybe there's a way how to have a simple json that will be encoded eventually.

xhyrom · 2026-10-06T20:31:49Z

konflikty opravené, mało by byť READY cc @mirrec @jsuchal

jsuchal · 2026-10-07T13:54:16Z

@xhyrom tu ma este zaujima ze co ked nezbehne ten job (z akehokolvek dovodu) a odosle sa to do triaze. Nemalo by sa tu pockat na to kym tato validacia zbehne a az potom to posielat do triaze?

Zaroven skusili sme toto pustit na nejakych realistickych datach? Lebo toto moze zacat schovavat komenty a zacnu nam pisat ludia ze kde su.

xhyrom · 2026-10-08T18:55:12Z

@xhyrom tu ma este zaujima ze co ked nezbehne ten job (z akehokolvek dovodu) a odosle sa to do triaze. Nemalo by sa tu pockat na to kym tato validacia zbehne a az potom to posielat do triaze?

No momentálne sa to pošle do triáže. Chápem tvoj point ale chceme naozaj v podstate znemožniť posielať komentáre v prípade, že tento job bude zlyhávať napr. z dôvodu nejakého výpadku externých APIs?

Zaroven skusili sme toto pustit na nejakych realistickych datach? Lebo toto moze zacat schovavat komenty a zacnu nam pisat ludia ze kde su.

Nejaké staré/reálne dáta som až tak neskúšal, toto PR nezasahuje vôbec do historických dát. Skúšal som iba tak pár nejakých vzoriek a dal tú hranicu na 90% a v prípade veľa false-positives môžeme threshold modifikovať. A keď už to tu spomínaš, mali by sme asi spraviť nejakú notifikáciu pre autora komentáru a informovať ho o tom, že sme jeho komentár skryli.

jsuchal · 2026-10-09T14:12:54Z

A keď už to tu spomínaš, mali by sme asi spraviť nejakú notifikáciu pre autora komentáru a informovať ho o tom, že sme jeho komentár skryli.

@BarboraMel ?

No momentálne sa to pošle do triáže.

ok, ak to pristane len tam tak sme asi safe, ale teda o tom ze to je spam/schovane sa triaznici/plantaznici nedozvedia hej?

xhyrom · 2026-10-10T11:38:18Z

ok, ak to pristane len tam tak sme asi safe, ale teda o tom ze to je spam/schovane sa triaznici/plantaznici nedozvedia hej?

no ak sa ten job spustí, tak v triáži sa to potom zobrazuje takto:

ops-portal/app/models/issues/comment.rb

Lines 43 to 47 in 6fbdfee

    
           def triage_activity_body 
        
             return "Zmazaný komentár: #{text}" if hidden 
        
             text 
        
           end

xhyrom · 2026-10-10T11:58:07Z

tu by sa ešte hodilo porozmýšľať či chceme s moderáciou počkať kým skončí editing window alebo validovať aj pri každej úprave (to by pri zaspamovaní úprav mohol byť trochu problém), mne dáva zmysel asi skôr počkať tých cca. 5min a až potom kontrolovať. cc @jsuchal

mirrec · 2026-10-14T08:48:47Z

@xhyrom toto, ked sa bude mergovat, tak podla mna seedy nezbehnu. tak ma potom pingni, a ja mozem dat merge, ked to bude hotove.

jsuchal · 2026-10-14T13:05:36Z

tu by sa ešte hodilo porozmýšľať či chceme s moderáciou počkať kým skončí editing window alebo validovať aj pri každej úprave (to by pri zaspamovaní úprav mohol byť trochu problém), mne dáva zmysel asi skôr počkať tých cca. 5min a až potom kontrolovať. cc @jsuchal

urcite ano.

zaroven by som este zvazil ci ten koment do triaze predsa len neposlat ale ho oznacit na zaciatku nejako.

@BarboraMel tu by sme mali vymysliet ako sa pouzivatel dozvie ze jeho koment bol schovany - toto by malo byt transparentne. cc @mirrec

xhyrom · 2026-10-14T13:18:00Z

On ten komentár sa do triáže pošle, ale bude tam body ako "Zmazaný komentár: {body}".

jsuchal · 2026-10-14T13:33:54Z

@xhyrom potom uz len ostava ta cast na portali. napriklad diskusie na sme.sk napisu, ze "komentar bol odstraneny"...

xhyrom · 2026-10-14T16:07:54Z

Tak môžeme upraviť, že sa hidden komentáe budú zobrazovať ale teda namiesto reálneho textu tam bude, že bol odstránený. Prípadne chceme to mať ako špeciálnu aktivitu (#70)?

jsuchal · 2026-10-16T08:56:59Z

@xhyrom za mna tak, pokym @BarboraMel nepovie inak. Specialnu aktivitu by som nerobil - je mozne ze tie komenty sem tam "flipneme" aj manualne.

xhyrom · 2026-10-17T12:35:19Z

@xhyrom za mna tak, pokym @BarboraMel nepovie inak. Specialnu aktivitu by som nerobil - je mozne ze tie komenty sem tam "flipneme" aj manualne.

Tu ešte je otázne, či chceme ukazovať, že bol komentár odstránený/skrytý pri všetkých typoch komentárov, alebo iba pri user komentároch a pri ostatných ich ani ukazovať nebudeme.

xhyrom · 2026-10-17T13:20:09Z

Vizuálne som to zatiaľ spravil takto, ale hodil by sa asi nejaký UXák na to keďže za mňa by to chcelo nejak kompaktnúť ten hidnutý komentár, keďže nemá zmysel, aby sa ukazoval takto celý (možno niečo ako má github?)

Co-authored-by: xhyrom <56601352+xhyrom@users.noreply.github.com>

feat: comment moderation

655c0c2

Copilot AI lite review requested due to automatic review settings August 13, 2026 14:09

Copilot started reviewing on behalf of xhyrom August 13, 2026 14:09

View session

xhyrom added 3 commits August 13, 2026 16:11

feat: prompt

e32e867

build: COMMENT_AUTO_HIDE_THRESHOLD in env

737c171

feat: min 0.9 treshold by default

7237a4a

Copilot AI reviewed Aug 13, 2026

View reviewed changes

Comment thread app/jobs/issues/moderate_comment_job.rb

Comment thread app/jobs/issues/moderate_comment_job.rb

Comment thread app/jobs/issues/moderate_comment_job.rb

test: fixtures

b55a0a0

xhyrom requested a review from luciajanikova August 15, 2026 07:14

xhyrom added 9 commits August 24, 2026 11:17

test: moderate comments

1fb8425

Merge branch 'main' into feat/comment-moderation

dc8dd52

test: comment text

b23a7e4

test: request helper

9f48a90

test: moderate comment

f35bf51

test: match fixtures response

a39c393

test: remove import

657ef90

test: imports

9283c03

test: simplify fixtures

f819abf

luciajanikova requested a review from jsuchal September 8, 2026 11:23

mirrec approved these changes Sep 24, 2026

View reviewed changes

xhyrom added 7 commits September 25, 2026 17:16

fix: make ai evaluation not-null

ee6082b

fix: make ai evaluation not-null

203d2f9

test(fixtures): add ai evaluation object to comments

dbef556

test: default ai evaluation object in comments

d014e9e

test: assert if ai evaluation is empty, not null

e83a24c

merge

9ff31ca

fix: use Issue instead Podnet

2711db5

refactor: conflicts

61de772

refactor: conflicts

6fbdfee

fix: moderate comment on update

1ec6356

feat: schedule moderation

6c51767

feat: comment hidden

39412f6

Copilot started work on behalf of xhyrom October 17, 2026 13:18

View session

xhyrom and others added 2 commits October 17, 2026 15:21

Merge branch 'main' into feat/comment-moderation

5e70e62

test: make one_comment1 fixture empty by default

3ead8a7

Co-authored-by: xhyrom <56601352+xhyrom@users.noreply.github.com>

Copilot finished work on behalf of xhyrom October 17, 2026 13:27

test: fixtures

30cfd21

xhyrom closed this Oct 17, 2026

xhyrom reopened this Oct 17, 2026

Conversation

xhyrom commented Aug 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mirrec left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

mirrec Sep 24, 2026

Choose a reason for hiding this comment

Uh oh!

xhyrom Sep 25, 2026

Choose a reason for hiding this comment

Uh oh!

mirrec Sep 24, 2026

Choose a reason for hiding this comment

Uh oh!

mirrec Sep 24, 2026

Choose a reason for hiding this comment

Uh oh!

xhyrom Sep 25, 2026

Choose a reason for hiding this comment

Uh oh!

mirrec Sep 24, 2026

Choose a reason for hiding this comment

Uh oh!

xhyrom commented Oct 6, 2026

Uh oh!

jsuchal commented Oct 7, 2026

Uh oh!

xhyrom commented Oct 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jsuchal commented Oct 9, 2026

Uh oh!

xhyrom commented Oct 10, 2026

Uh oh!

xhyrom commented Oct 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mirrec commented Oct 14, 2026

Uh oh!

jsuchal commented Oct 14, 2026

Uh oh!

xhyrom commented Oct 14, 2026

Uh oh!

jsuchal commented Oct 14, 2026

Uh oh!

xhyrom commented Oct 14, 2026

Uh oh!

jsuchal commented Oct 16, 2026

Uh oh!

xhyrom commented Oct 17, 2026

Uh oh!

xhyrom commented Oct 17, 2026

Uh oh!

This branch has not been deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

xhyrom commented Aug 13, 2026 •

edited

Loading

xhyrom commented Oct 8, 2026 •

edited

Loading

xhyrom commented Oct 10, 2026 •

edited

Loading