Scrape | Firecrawl

Interact — Scrape a page, then take actions on it with AI prompts or code | Firecrawl

Scrape any page, then click, type, fill forms, and extract data with natural language or Playwright code. Live view, persistent profiles, session chaining.

firecrawl/firecrawl

The context API to search, scrape, and interact with the web at scale. 🔥

Link Cleaner

Link Cleaner is a web app for removing tracking code, search parameters, and other junk from URL links.

Interact | Firecrawl

Interact with a page you fetched by prompting or running code.

renderg.host/semble-chrome-extension

A Chrome extension to quickly capture URLs into Semble Collections at https://semble.so

renderg.host/semble-chrome-extension

A Chrome extension to quickly capture URLs into Semble Collections at https://semble.so

renderg.host/semble-chrome-extension

A Chrome extension to quickly capture URLs into Semble Collections at https://semble.so

An update on the scraper situation

Our article 'Fighting the AI scraper bot scourge', published in early 2025, discussed the probl [...]

Scraping Framework for Golang

Scraping framework for extracting the data you need from websites, used for a wide range of applications, like data mining, data processing or archiving

URL to Markdown Converter

Convert any web page to clean Markdown format

All The Places

A growing set of web scrapers designed to output consistent geodata about as many places of business in the world as possible.

Common Crawl - Open Repository of Web Crawl Data

We build and maintain an open repository of web crawl data that can be accessed and analyzed by anyone.

Aggressive AI scrapers are making it kinda suck to run wikis

Bots are currently scraping the internet for LLM training data at unprecedented rates[1][2][3], driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis, and has gotten much worse in the last few months.