From 0790ea8db455e165eb7ebf2072202de2fa21dc04 Mon Sep 17 00:00:00 2001 From: Valerio Date: Thu, 2 Apr 2026 13:25:14 +0200 Subject: [PATCH 1/2] Add webclaw to Rust section --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 2fae14f..4d1f59a 100644 --- a/README.md +++ b/README.md @@ -120,6 +120,7 @@ A collection of awesome web crawler,spider and resources in different languages. ## Rust * [spider](https://github.com/spider-rs/spider) - The fastest web crawler and indexer. * [crawler](https://github.com/a11ywatch/crawler) - A gRPC web indexer turbo charged for performance. +* [webclaw](https://github.com/0xMassi/webclaw) - Web content extraction with browser TLS fingerprinting. Crawl, scrape, and extract clean markdown from any URL. ## R * [rvest](https://github.com/hadley/rvest) - Simple web scraping for R. From 7af33c719667a3a061d3fa5fb330c8afa9ac5c9f Mon Sep 17 00:00:00 2001 From: Valerio Date: Mon, 15 Jun 2026 19:04:34 +0200 Subject: [PATCH 2/2] docs: tighten webclaw description --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 4d1f59a..7ffdab4 100644 --- a/README.md +++ b/README.md @@ -120,7 +120,7 @@ A collection of awesome web crawler,spider and resources in different languages. ## Rust * [spider](https://github.com/spider-rs/spider) - The fastest web crawler and indexer. * [crawler](https://github.com/a11ywatch/crawler) - A gRPC web indexer turbo charged for performance. -* [webclaw](https://github.com/0xMassi/webclaw) - Web content extraction with browser TLS fingerprinting. Crawl, scrape, and extract clean markdown from any URL. +* [webclaw](https://github.com/0xMassi/webclaw) - Web content extraction that crawls and scrapes any URL into clean markdown. ## R * [rvest](https://github.com/hadley/rvest) - Simple web scraping for R.