Projects

Projects

Updated 10 months ago

trafilatura • Rank 26.3 • Science 77%

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Updated 10 months ago

textclean • Rank 15.8 • Science 23%

Tools for cleaning and normalizing text data

data-munging emoticons r regex text-analysis text-cleaning

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

trafilatura • Rank 26.3 • Science 77%

textclean • Rank 15.8 • Science 23%