Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 31 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,37 @@ All notable changes to this project are documented here. The format follows

## [Unreleased]

Two more platforms a post can be read from without an account: Lobste.rs and Lemmy.

### Added
- **Lobste.rs.** `check --url https://lobste.rs/s/<id>` reads a story — its title, its
submitted address first and the links in its text — and `/c/<id>` or a `#c_<id>`
fragment reads one comment, never the thread above it. Read from the `.json` twin
of each page; no key, no account. A moderated comment is `UNVERIFIED (blocked)`, a
deleted one `UNVERIFIED (unreachable)`, as spec §15 keeps them apart. An anchor
pointing back at the story's own discussion page is not a source and is left out.
- **Lemmy.** `check --url https://<instance>/post/<n>` and `/comment/<n>` read from
the `/api/v3` every instance serves without a login. A post's submitted address
comes first, then the markdown links in its body. `removed` (a moderator's doing)
is `UNVERIFIED (blocked)`; `deleted` is `UNVERIFIED (unreachable)`. A private
instance answers an anonymous reader with the *same* `400` as a missing post and
`not_logged_in` in the body, so the body's token decides: `not_logged_in` is
`UNVERIFIED (blocked)`, `couldnt_find_post` is `UNVERIFIED (unreachable)`, and a
`400` naming neither is `UNVERIFIED (unavailable)` — never a guess about the post.
Lemmy is known by its **host** — the
`lemmy.` prefix or one of `lemm.ee`, `sh.itjust.works`, `beehaw.org`,
`programming.dev`, `feddit.org` — never by `/post/<n>` alone, which is how any
blog addresses an article; a post on an instance outside that rule is read as a
page, as before, and no `/api/v3` request is ever sent to a host that did not say
it is Lemmy.

### Changed
- The "platform not read in this version" hint, the `check --url` help and the README
table name all seven platforms.
- `polite.ProviderError` carries `code`: the one snake_case token a JSON error body's
`error` field named, when it named one, and nothing else from the body. It is what
lets the Lemmy reader tell the two facts above apart; no other caller reads it yet.

## [0.4.6] - 2026-09-18

The terminal looks like the product: the wordmark in both themes, a settings
Expand Down
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -249,6 +249,8 @@ back what it says:
```bash
proofpath check --url https://bsky.app/profile/bsky.app/post/3movpwtbjgs2d
proofpath check --url https://news.ycombinator.com/item?id=8863
proofpath check --url https://lobste.rs/s/htziuj
proofpath check --url https://lemmy.world/post/1
proofpath check - # paste the text of a post that cannot be read
```

Expand All @@ -275,13 +277,15 @@ own words are never allowed to stand as their own evidence.
|---|---|
| Bluesky | `public.api.bsky.app`, no account, first-class. Link cards, rich-text links and one level of quoted post |
| Hacker News | the official Firebase API, no account, first-class. A story's URL and the links in a comment |
| Lobste.rs | the `.json` twin of every story and comment page, no account, first-class. A story's URL, the links in its text and the links in a comment |
| Reddit | with a **free app you register yourself**: put `REDDIT_CLIENT_ID` and `REDDIT_CLIENT_SECRET` in `.env`. Without them the run says `UNVERIFIED (credentials missing)` and names both variables — it never quietly skips the post |
| Mastodon | best effort, per instance. Many instances now require a login for the public API, and that answer is reported as `UNVERIFIED (blocked)`, not as a missing post |
| Lemmy | best effort, per instance, through the `/api/v3` every instance serves without a login; a private instance's `not_logged_in` is reported as `UNVERIFIED (blocked)`, not as a missing post. A post's URL and the links in its body or in a comment. Known by its host — `lemmy.*` and the big instances without that prefix (`lemm.ee`, `sh.itjust.works`, `beehaw.org`, `programming.dev`, `feddit.org`) — never by `/post/<n>` alone, which is any blog's address; a post on an instance outside that rule is read as a page |
| X / Twitter | cannot be read at all. `check --url` says so and asks you to paste the text; the links inside it are then verified normally |

The Reddit path is built against Reddit's documented shapes and covered by fixtures, but it
has never run against Reddit on this machine — nobody here has an app to register. Bluesky,
Hacker News and Mastodon were each read live before release.
Hacker News, Mastodon, Lobste.rs and Lemmy were each read live before release.

## Optional LLM judge (v0.3)

Expand Down
19 changes: 17 additions & 2 deletions docs/superpowers/OPEN-ITEMS.md
Original file line number Diff line number Diff line change
Expand Up @@ -505,11 +505,11 @@ Findings from inspecting the installed base environment, and the decisions they
| 15.2 | The Reddit path has never run against Reddit | fixtures reproduce the documented shapes; nobody on this machine has an app to register. The first real-credential run should check the comment-listing shape first |
| 15.3 | `/r/<sub>/s/<hash>` share links are unrecognised | they degrade to the web ladder, so nothing is invented; the shape is simply not parsed |
| 15.4 | The TUI footer ignores `Footer.reasons` | the per-reason coverage lines reach the terminal and the markdown report but not the TUI, so a TUI run whose sources were half blocked still shows three numbers and no reason |
| 15.7 | A Mastodon status is read outside the fetch ladder | `check --url https://<any host>/@a/123` issues a request to that host's `/api/v1/statuses/123` directly: no `robots.txt` check and no entry in `polite.MIN_INTERVAL`. The user typed the address, so it is not a rule breach, but it is the one read path that skips the politeness machinery |
| 15.7 | A Mastodon status is read outside the fetch ladder | `check --url https://<any host>/@a/123` issues a request to that host's `/api/v1/statuses/123` directly: no `robots.txt` check and no entry in `polite.MIN_INTERVAL`. The user typed the address, so it is not a rule breach, but it is the one read path that skips the politeness machinery. *v0.4.7:* Lemmy shares this exactly — the host is the instance — with one narrowing: only a host that passes `providers.is_lemmy_host` is asked, so the request never goes to an arbitrary site |
| 15.8 | `target_document`'s `network_allowed` defaults to `True` | every in-tree caller passes the resolved permission, so the default is unreachable today; it is a footgun for the next caller and should be a required keyword |
| 15.9 | The Reddit token exchange follows redirects with basic auth attached | httpx re-applies the credential along a redirect chain. The URL is a fixed Reddit constant, so it needs Reddit itself to be the attacker, but `follow_redirects=False` on that one call costs nothing |
| 15.5 | `NO_REASON_RECORDED` is a user-visible state outside §15 | it is a guard that should never print; if it can print, it belongs in the table |
| 15.6 | `NOT_READ_HERE` is provably unreachable through `verify` | kept deliberately for a sixth platform, like `checker_for`'s `arxiv:` row |
| 15.6 | `NOT_READ_HERE` is provably unreachable through `verify` | kept deliberately for a sixth platform, like `checker_for`'s `arxiv:` row. *v0.4.7:* the sixth and seventh (Lobste.rs, Lemmy) arrived and each got a reader, so it is still unreachable and still kept, now for the eighth |

## 16. Page targets — v0.4.4, 2026-09-17

Expand Down Expand Up @@ -544,3 +544,18 @@ against. "Paste the text" is only an answer for a tweet that links its source.
| 17.1 | **Evidence search for a source-less claim** (decided 2026-09-18: this is the fix, path B) | An opt-in stage for a document that cites nothing: query a web search provider with the user's own key (Tavily / Brave / SearXNG; consent per §7.1, never on by default), take the top N pages and run them through the existing fetch → retrieval → entailment path. The report must carry a **distinct state** for such a source — `found by proofpath, not cited by the author` — on every finding and in coverage; rules 1–2 stay: passage or no verdict, unreachable stays unreachable. **Gate:** AVeriTeC (§15.1) measures exactly this scenario at 0.270 vs a 0.708 majority baseline, so the stage ships only once a web-claim eval is above baseline, or it ships flagged experimental with that number printed in the report. Not the judge: a judge answering with no source is the truth oracle §3 forbids |
| 17.2 | README:280 and the `check --url` X message overstate "paste the text" | both should say a tweet with no link cannot be checked, until 17.1 lands |
| 17.3 | The "cites nothing" finding fires for a whole document, never per paragraph | a long pasted post where only some paragraphs link is fine today (it has references); a `.txt` mixing cited and uncited claims reports nothing about the uncited ones — that is the existing per-claim coverage's job, but worth checking it says so |

## 18. Lobste.rs and Lemmy — v0.4.7, 2026-09-18

Two readers added on the Hacker News and Mastodon patterns respectively
(`providers/social.py`). Both probed without auth and read live before release (spec §6.2).

### New open items

| # | Item | Note |
|---|---|---|
| 18.1 | The Lemmy instance list is a list | `providers.LEMMY_HOSTS` is five hosts plus the `lemmy.` prefix, chosen 2026-09-18 over shape-only matching so no `/api/v3` request is sent to a blog whose articles live at `/post/<n>`. A big instance not on it is read as a page. A probe path — try `/api/v3/site` once per unknown host and remember the answer — would widen coverage without the list, at the cost of one request to every `/post/<n>` address that is not Lemmy |
| 18.2 | Lemmy cross-posts and Lobste.rs "hats" are not read | a Lemmy post's `cross_posts` list names the same link in other communities; neither is a source of the post and neither is followed. Recorded so nobody reads their absence as an oversight |
| 18.3 | A Lobste.rs comment permalink's story is never read | `/c/<id>` reads the comment alone (its parent is other people's words, as on Hacker News). A user who pastes `/s/<id>/<slug>#c_<id>` meaning "this thread" gets the one comment; the address says so, but the report does not |
| 18.4 | `_is_own_story` sees only absolute anchors | a relative `href="/s/<id>"` in a Lobste.rs description has no host and passes the filter; downstream `find_url` reads no address out of it either, so nothing is fetched, but the link is not named among the dropped ones |
| 18.5 | `ProviderError.code` is read by one caller | the token is parsed for every 4xx/5xx a `PoliteClient` raises; Crossref, OpenAlex and the rest could use it the same way the Lemmy reader does, and today none does |
9 changes: 7 additions & 2 deletions docs/superpowers/specs/2026-09-10-proofpath-design.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,8 +63,8 @@ The core is source-agnostic. Everything platform-specific lives behind an
▼ ▼ ▼
academic:// web:// social://
Crossref, OpenAlex, search + primary Bluesky, Reddit, HN,
PubMed, arXiv, source fetch Mastodon, Community
Unpaywall, Notes dumps
PubMed, arXiv, source fetch Mastodon, Lobste.rs,
Unpaywall, Lemmy
Retraction Watch
```

Expand Down Expand Up @@ -150,6 +150,8 @@ Tested without authentication:
| **Reddit** | `.json` suffix, `www` and `old` | **403 / HTML login wall** | free OAuth app registration required; user supplies credentials |
| **Mastodon** | `/api/v1/timelines/public` | 422, auth required (instance-dependent) | per-instance, best effort |
| **X / Twitter** | status URL | **404, 92 words** | not readable; Community Notes dumps only |
| **Lobste.rs** (added 2026-09-18) | `/s/<id>.json`, `/c/<id>.json` | **200, clean JSON, no auth**; missing story 404, missing comment 400 | first-class support |
| **Lemmy** (added 2026-09-18) | `/api/v3/post?id=`, `/api/v3/comment?id=` | **200, clean JSON, no auth** on `lemmy.world` and `lemmy.ml` (0.19.x); missing id is **400** `couldnt_find_post`, not 404, and a private instance is the same 400 with `not_logged_in` — the body's token, not the status, tells the two apart | per-instance, best effort; recognised by host (`lemmy.` prefix or a short list), never by `/post/<n>` alone |

Consequence: the social provider is built **Bluesky-first**, not X-first. X is the
exception, not the model. Where a post cannot be read, the user pastes its text and
Expand Down Expand Up @@ -1011,6 +1013,9 @@ line per reason on the terminal and in the markdown report (the TUI footer does
carry them — OPEN-ITEMS 15.4). X Community Notes dumps were **not** built — the paste
path replaced them (OPEN-ITEMS 3.5). Measured: `docs/eval/2026-09-16-averitec.md`, and the
number is bad — see §14.
*v0.4.7, 2026-09-18:* Lobste.rs (first class, like Hacker News) and Lemmy (per instance,
like Mastodon, but recognised by host because `/post/<n>` is any blog's address) — both
probed without auth and read live before release, §6.2.

**Later.** Turkish sources as a separate provider (TR Dizin / DergiPark class),
`spiyweb` graph retrieval as an alternative backend, GROBID parser.
Expand Down
14 changes: 14 additions & 0 deletions site/src/data/posts.ts
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,10 @@ export const postCommands: readonly { cmd: string; comment: string }[] = [
cmd: 'proofpath check --url https://news.ycombinator.com/item?id=8863',
comment: "a story's URL, and the links in a comment",
},
{
cmd: 'proofpath check --url https://lemmy.world/post/1',
comment: 'the same on Lobste.rs and the Lemmy instances it knows',
},
{ cmd: 'proofpath check -', comment: 'paste the text of a post that cannot be read' },
{
cmd: 'proofpath check --url https://en.wikipedia.org/wiki/AlphaFold',
Expand All @@ -36,6 +40,11 @@ export const platforms: readonly Platform[] = [
how: "The official Firebase API, no account. A story's URL and the links in a comment.",
state: { label: 'read', tone: 'ink' },
},
{
name: 'Lobste.rs',
how: "The .json twin of every story and comment page, no account. A story's URL, the links in its text and in a comment.",
state: { label: 'read', tone: 'ink' },
},
{
name: 'Reddit',
how: 'With a free app you register yourself: REDDIT_CLIENT_ID and REDDIT_CLIENT_SECRET in .env. Without them no request is made: the post is UNVERIFIED (credentials missing), and the run names both variables.',
Expand All @@ -46,6 +55,11 @@ export const platforms: readonly Platform[] = [
how: 'Best effort, per instance. An instance that wants a login says so, and that answer is reported as UNVERIFIED (blocked) — not as a missing post.',
state: { label: 'blocked', tone: 'slate' },
},
{
name: 'Lemmy',
how: "Best effort, per instance, through the /api/v3 every instance serves without a login. Known by its host — lemmy.* and the big instances — never by /post/<n> alone, which is any blog's address.",
state: { label: 'read', tone: 'ink' },
},
{
name: 'X',
how: 'Cannot be read at all. The run says so and asks you to paste the text; the links inside it are then verified as usual.',
Expand Down
3 changes: 2 additions & 1 deletion src/proofpath/cli.py
Original file line number Diff line number Diff line change
Expand Up @@ -506,7 +506,8 @@ def check(
"--url",
help=(
"An address to check instead of a file: a post (Bluesky, Hacker News, "
"Reddit, Mastodon) or any other page, read as the document itself."
"Lobste.rs, Reddit, Mastodon, Lemmy) or any other page, read as the "
"document itself."
),
),
] = None,
Expand Down
9 changes: 5 additions & 4 deletions src/proofpath/ingest.py
Original file line number Diff line number Diff line change
Expand Up @@ -527,10 +527,11 @@ def from_post(post: SocialPost) -> tuple[Document, tuple[str, ...]]:
``SocialProvider.fetch``, and the post would be read a second time -- handing its
own sentence back as the passage that supports it, which is product rule 1's
whole subject. Posts reach this shape by ordinary means: a Bluesky facet or link
card pointing at its own permalink, a Mastodon anchor, and a Hacker News story
whose submitted ``url`` is the item itself. ``providers.social`` already refuses
the same thing for a Reddit self post, whose ``url`` is the post; this is that
rule where every platform passes. The returned notes name each dropped link, so a
card pointing at its own permalink, a Mastodon or Lemmy anchor, and a Hacker News
story whose submitted ``url`` is the item itself. ``providers.social`` already
refuses the same thing for a Reddit self post, whose ``url`` is the post, and for
a Lobste.rs anchor at the story's own discussion page; this is that rule where
every platform passes. The returned notes name each dropped link, so a
reader comparing the report against the post can see why one is not in it.
"""
lines: list[str] = []
Expand Down
Loading
Loading