Projects

Scientific Software

Updated 6 months ago

Inscriptis - A Python-based HTML to text conversion library optimized for knowledge extraction from the Web — Peer-reviewed • Rank 21.4 • Science 93%

Inscriptis - A Python-based HTML to text conversion library optimized for knowledge extraction from the Web - Published in JOSS (2021)

client converter html html2text library python web-service

Computer Science (34%)

Scientific Software · Peer-reviewed

Updated 6 months ago

trafilatura • Rank 26.3 • Science 77%

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

article-extractor corpus-builder corpus-tools crawler html-to-markdown html2text llm news-aggregator news-crawler nlp rag readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Updated 6 months ago

semantic-outlier-removal • Science 54%

Code and data for SORE (ACL 2025), a semantic boilerplate remover.

article-extractor crawler embedding html-to-text html2text llm nlp outlier-removal preprocessing readability scraping text-extraction text-mining web-scraping

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

Inscriptis - A Python-based HTML to text conversion library optimized for knowledge extraction from the Web — Peer-reviewed • Rank 21.4 • Science 93%

trafilatura • Rank 26.3 • Science 77%

semantic-outlier-removal • Science 54%