Projects

Projects

Updated 6 months ago

trafilatura • Rank 26.3 • Science 77%

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Updated 6 months ago

semantic-outlier-removal • Science 54%

Code and data for SORE (ACL 2025), a semantic boilerplate remover.

article-extractor crawler embedding html-to-text html2text llm nlp outlier-removal preprocessing readability scraping text-extraction text-mining web-scraping

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

trafilatura • Rank 26.3 • Science 77%

semantic-outlier-removal • Science 54%