Projects

Updated 6 months ago

trafilatura • Rank 26.3 • Science 77%

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Updated 6 months ago

reader • Rank 17.9 • Science 26%

A Python feed reader library.

atom-feed feed feed-aggregator feed-reader json-feed library podcast podcast-aggregator podcast-client podcast-fetcher podcatcher python python-library rss rss-aggregator rss-feed rss-reader twitter