Scraping framework for extracting the data you need from websites, used for a wide range of applications, like data mining, data processing or archiving
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
How to Scrape Web Content for RAG with Readability.js
feeds package - github.com/gorilla/feeds - Go Packages
Syndication (feed) generator library for golang.
Go Web Programming
Build scalable, high-performance web apps in Go with modern design principles.
All The Places
A growing set of web scrapers designed to output consistent geodata about as many places of business in the world as possible.
Interact — Scrape a page, then take actions on it with AI prompts or code | Firecrawl
Scrape any page, then click, type, fill forms, and extract data with natural language or Playwright code. Live view, persistent profiles, session chaining.
alan-turing-institute/ReadabiliPy
A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
clipboard/clipboard_unix.go at master · atotto/clipboard
clipboard for golang. Contribute to atotto/clipboard development by creating an account on GitHub.
WDC - RDFa, Microdata, and Microformat Data Sets
More and more websites have started to embed structured data describing products, people, organizations, places, and events into their HTML pages using markup standards such as Microdata, JSON-LD, RDFa, and Microformats. The Web Data Commons project extracts this data from several billion web pages. So far the project provides 12 different data set releases extracted from the Common Crawls 2010 to 2023. The project provides the extracted data for download and publishes statistics about the deployment of the different formats.
The Go Programming Language
Go is an open source programming language that makes it simple to build secure, scalable systems.
Learn Go by Building a Command Line Todo App | Barbarian Meets Coding
Learn the Go programming language by building a test-driven command line todo application
How To Create RSS Feeds In Golang
