Projects | Open Source Science

Scientific Software

Updated 9 months ago

Jury — Peer-reviewed • Rank 14.8 • Science 93%

Jury: A Comprehensive Evaluation Toolkit - Published in JOSS (2024)

datasets evaluate evaluation huggingface machine-learning metrics natural-language-processing nlp nlp-evaluation python pytorch transformers

Scientific Software · Peer-reviewed

Updated 9 months ago

sahi • Rank 24.2 • Science 77%

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

coco computer-vision deep-learning explainable-ai fiftyone huggingface instance-segmentation large-image machine-learning merge mmdetection object-detection oriented-object-detection python pytorch remote-sensing satellite small-object-detection tiling yolo11

Updated 9 months ago

kubeflow-katib • Rank 20.7 • Science 64%

Automated Machine Learning on Kubernetes

ai automl huggingface hyperparameter-tuning jax kubeflow kubernetes llm machine-learning mlops neural-architecture-search pytorch scikit-learn tensorflow

Updated 9 months ago

inseq • Rank 13.6 • Science 67%

Interpretability for sequence generation models 🐛 🔍

attribution-methods captum deep-learning explainable-ai generative-ai huggingface interpretability language-generation language-model large-language-models natural-language-processing sequence-to-sequence transformers

Updated 9 months ago

imodelsx • Rank 14.5 • Science 64%

Interpret text data using LLMs (scikit-learn compatible).

ai deep-learning explainability huggingface interpretability language-model machine-learning ml natural-language-processing natural-language-understanding neural-network pytorch scikit-learn text text-classification transformer-models xai

Updated 9 months ago

skorch • Rank 24.5 • Science 54%

A scikit-learn compatible neural network library that wraps PyTorch

hacktoberfest huggingface machine-learning pytorch scikit-learn

Updated 9 months ago

swarms • Rank 22.4 • Science 54%

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

agents ai artificial-intelligence attention-mechanism chatgpt gpt4 gpt4all huggingface langchain langchain-python machine-learning multi-modal-imaging multi-modality multimodal prompt-engineering prompt-toolkit prompting swarms transformer-models tree-of-thoughts

Updated 9 months ago

tasksource • Rank 11.4 • Science 64%

Datasets collection and preprocessings framework for NLP extreme multitask learning

benchmark bigbench crossfit curated-datasets dataset-collection discriminative extreme-mtl extreme-multi-task-learning glue huggingface instruction-tuning meta-learning multi-task-learning multi-task-learning-scaling natural-language-inference nlp preprocessings reward-modeling scaling text-classification

Updated 9 months ago

chronos-forecasting • Rank 20.5 • Science 54%

Chronos: Pretrained Models for Probabilistic Time Series Forecasting

artificial-intelligence forecasting foundation-models huggingface huggingface-transformers large-language-models llm machine-learning pretrained-models time-series time-series-forecasting timeseries transformers

Updated 9 months ago

mlm-bias • Rank 4.9 • Science 67%

Measuring Biases in Masked Language Models for PyTorch Transformers. Support for multiple social biases and evaluation measures.

bias-evaluation computational-social-science explainable-ai explainable-ml huggingface interpretable-ai interpretable-ml machine-learning masked-language-modeling masked-language-models pytorch transformers

Updated 9 months ago

span-marker • Rank 17.2 • Science 54%

SpanMarker for Named Entity Recognition

huggingface ner nlp spacy spacy-extension transformers

Updated 9 months ago

eval-suite • Rank 9.2 • Science 59%

[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

benchmark ceval chatgpt dataset evaluation gpt-3 gpt-4 hallucination hallucination-detection hallucination-evaluation hallucinations huggingface huggingface-transformers large-language-models llm openai openai-api qwen

Updated 9 months ago

knn-transformers • Rank 5.6 • Science 62%

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

huggingface knn knn-lm knn-mt knn-transformers knnlm knnmt language language-models machine models nearest nearest-neighbor neighbor neuro-symbolic pytorch retomaton transformers translation

Updated 9 months ago

distilabel • Rank 11.6 • Science 54%

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

ai huggingface llms openai python rlaif rlhf synthetic-data synthetic-dataset-generation

Updated 9 months ago

detoxify • Rank 21.0 • Science 44%

Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers. For access to our API, please email us at contact@unitary.ai.

bert bert-model hate-speech hate-speech-detection hatespeech huggingface huggingface-transformers kaggle-competition nlp pytorch-lightning sentence-classification toxic-comment-classification toxic-comments toxicity toxicity-classification

Updated 9 months ago

frame-semantic-transformer • Rank 10.9 • Science 54%

Frame Semantic Parser based on T5 and FrameNet

framenet huggingface nlp semantic-parsing t5 transformers

Updated 9 months ago

@llm-tools/embedjs • Rank 17.7 • Science 44%

A NodeJS RAG framework to easily work with LLMs and embeddings

ai chatgpt claude cohere embedding embeddings gpt gpt-4 gpt-4o huggingface large-language-models llm mistral ollama openai pinecone rag vector-database vertex-ai

Updated 9 months ago

cappr • Rank 9.8 • Science 44%

Completion After Prompt Probability. Make your LLM make a choice

huggingface kv-cache llamacpp llm-inference probability prompt-engineering text-classification zero-shot

Updated 9 months ago

hugsvision • Rank 6.1 • Science 46%

HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision

bert computer-vision deep-learning deit detr huggingface image-classification image-generation machine-learning object-detection pretrained-models pythorch pytorch pytorch-transformers semantic-segmentation state-of-the-art torchvision transformers vit yolo

Updated 9 months ago

https://github.com/csinva/tree-prompt • Rank 6.0 • Science 46%

Tree prompting: easy-to-use scikit-learn interface for improved prompting.

ai artificial-intelligence classification controllability decision-tree huggingface interpretability language-model language-models llm llm-inference machine-learning prompt-engineering prompting scikit-learn

Updated 9 months ago

tamingllms • Rank 7.2 • Science 44%

Taming LLMs: A Practical Guide to LLM Pitfalls with Open Source Software

book chatgpt genai huggingface langchain llama llm llms open-source outlines python qwen taming-llms

Updated 8 months ago

https://github.com/huggingface/agents-course • Rank 15.0 • Science 36%

This repository contains the Hugging Face Agents Course.

agentic-ai agents course huggingface langchain llamaindex smolagents

Updated 9 months ago

https://github.com/csinva/interpretable-embeddings • Rank 4.7 • Science 46%

Interpretable text embeddings by asking LLMs yes/no questions (NeurIPS 2024)

ai artificial-intelligence embeddings encoding-models explainability fmri huggingface language-model llm neural-network neuroscience rag retrieval-augmented-generation transformer xai

Updated 9 months ago

pizzly • Rank 5.6 • Science 44%

Pizzly, financial market analysis combining technical indicators with LLMs, featuring real-time data processing and AI-powered market insights ⚡️

agent agentic-ai ai alpaca alpaca-trading-api artificial-intelligence duckduckgo finance financial-analysis huggingface huggingface-transformers llm nlp polars polars-dataframe python smolagents stock-market

Updated 9 months ago

hf-for-legal • Rank 4.9 • Science 44%

HF for Legal: A Community Package for Legal Applications 🤗

ai community data datasets genai hf-for-legal huggingface huggingface-spaces huggingface-transformers law legal legal-ai llm nlp open-data open-source

Updated 9 months ago

https://github.com/awslabs/generative-ai-cdk-constructs • Rank 20.7 • Science 26%

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

agent amazon-bedrock appsync aws aws-cdk content-generation generative-ai huggingface knowledge-base langchain llm opensearch question-answering-system retrieval-augmented-generation sagemaker step-functions summarization

Updated 9 months ago

logfire-callback • Rank 2.6 • Science 44%

A callback for logging training events from Hugging Face's Transformers to Logfire 🤗

callback huggingface huggingface-transformers logfire logfire-callback logging pydantic trainer training transformers

Updated 9 months ago

napolab • Rank 7.0 • Science 36%

The Natural Portuguese Language Benchmark (Napolab). Stay up to date with the latest advancements in Portuguese language models and their performance across carefully curated Portuguese language tasks.

benchmarks catalan datasets english galician hate-speech huggingface huggingface-transformers large-language-models nlp portuguese python question-answering semantic-similarity spanish text-simplification textual-entailment transformers

Updated 9 months ago

https://github.com/cahya-wirawan/rwkv-tokenizer • Rank 12.9 • Science 26%

A fast RWKV Tokenizer written in Rust

huggingface llm rwkv tiktoken tokenizer trie

Updated 9 months ago

spacy-wrap • Rank 12.4 • Science 26%

spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to include existing fine-tuned models within your SpaCy workflow.

deep-learning huggingface huggingface-transformers language-model machine-learning natural-language-processing nlp pytorch spacy spacy-extension spacy-extensions spacy-models spacy-nlp spacy-pipeline spacy-transformers text-classification transformers

Updated 9 months ago

https://github.com/cakecrusher/mimicbot • Rank 6.5 • Science 26%

Mimicbot enables the effortless yet modular creation of an AI chat bot model that imitates another person's manner of speech.

ai bot data-science discord discord-bot huggingface natural-language-processing pypi python python-package

Updated 9 months ago

https://github.com/beomi/easy-lm-trainer • Rank 4.8 • Science 26%

🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드

boilerplate huggingface language-model transformers

Updated 9 months ago

https://github.com/buaadreamer/dlpy • Rank 0.7 • Science 23%

Programming Language for Deep Learning in Python

baichuan2 chatbot deep-learning gpt-2 huggingface language-model mlp programming-language python3 transformers

Updated 9 months ago

https://github.com/explosion/spacy-transformers • Rank 10.3 • Science 13%

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

bert google gpt-2 huggingface language-model machine-learning natural-language-processing natural-language-understanding nlp openai pytorch pytorch-model spacy spacy-extension spacy-pipeline transfer-learning xlnet

Updated 9 months ago

https://github.com/adithya-s-k/companionllm • Rank 3.8 • Science 13%

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

fine-tuning finetuning hacktoberfest hacktoberfest-accepted hacktoberfest2023 huggingface llama llama2 llamacpp llm llm-inference llm-training lora mit-license open-source peft

Updated 9 months ago

https://github.com/beomi/gemma-easylm • Rank 6.3 • Science 10%

Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)

easylm flax gemma huggingface jax language-model tpu transformers

Updated 9 months ago

https://github.com/agnostiqhq/tutorials_covalent_pycon_2024 • Rank 1.4 • Science 13%

agents ai ai-foundry autonomous-agents chatgpt covalent gpu hpc huggingface large-language-models llama llamacpp llm ml vllm

Updated 9 months ago

asr-wav2vec-finetune • Science 67%

:zap: Finetune Wa2vec 2.0 For Speech Recognition

asr finetune-wav2vec huggingface pytorch speech-recognition speech-to-text vietnamese-speech-recognition wav2vec2

Updated 9 months ago

mergekit • Science 44%

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

dare-ties huggingface large-language-models leaderboard llm merge-llm mergekit mixture-of-experts moe slerp ties transformer

Updated 9 months ago

minicorpus • Science 54%

Investigating, reproducing, and improving MiniPile with PyTorch and HuggingFace

huggingface pytorch subset-selection

Updated 9 months ago

partial-embedding-matrix-adaptation • Science 41%

Vocabulary-level memory efficiency for language model fine-tuning.

bert huggingface nlp transformers

Updated 9 months ago

mazegpt • Science 44%

AI model for making mazes that extends OpenAIs GPT2 model

gpt-2 huggingface machine-learning maze maze-generator python pytorch transformer

Updated 9 months ago

layoutreader • Science 44%

A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.

huggingface layoutlmv3 layoutreader transformers

Updated 9 months ago

https://github.com/ammarlodhi255/chest-xray-report-generation-app-with-chatbot-end-to-end-implementation • Science 26%

AI-powered Chest X-ray report generation app using VLM (Swin-T5) and LLM (LLaMA-3) for multilingual Q&A and medical education support.

chest-xray data-science-projects deep-learning-project deep-learning-projects end-to-end-machine-learning end-to-end-project huggingface large-language-models llm machine-learning-projects medical-imaging medical-report-generation pytorch radiology radiology-report-generation vision-language-model vlm

Updated 9 months ago

speechbrain • Science 64%

A PyTorch-based Speech Toolkit

asr audio audio-processing deep-learning huggingface language-model pytorch speaker-diarization speaker-recognition speaker-verification speech-enhancement speech-processing speech-recognition speech-separation speech-to-text speech-toolkit speechrecognition spoken-language-understanding transformers voice-recognition

Updated 9 months ago

hfcommunity • Science 52%

HFCommunity offers an offline up-to-date relational database built from the data available at the Hugging Face Hub, providing queriable data about the repositories hosted in the Hub

data-science database dataset huggingface

Updated 9 months ago

open-text-embeddings • Science 44%

Open Source Text Embedding Models with OpenAI Compatible API

aws-lambda embeddings fastapi huggingface langchain langchain-python openai opensource python sentence-transformers serverless-framework text-embeddings universal-sentence-encoder

Updated 9 months ago

simplyretrieve • Science 54%

Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. For Retrieval-Centric & Retrieval-Augmented Generation.

artificial-intelligence chat-ai generative-ai huggingface large-language-models machine-learning natural-language-processing nlp prompt-engineering retrieval-augmented-generation retrieval-centric-generation

Updated 9 months ago

https://github.com/andstor/verified-smart-contracts • Science 26%

:page_facing_up: Verified Ethereum Smart Contract dataset

dataset ethereum etherscan huggingface language-modeling smart-contracts text-generation

Updated 9 months ago

https://github.com/andstor/verified-smart-contracts-audit • Science 13%

:bug: Verified smart contract dataset with vulnerability labeling

dataset ethereum etherscan huggingface language-modeling security smart-contracts text-generation

Updated 9 months ago

legalkit-pipeline • Science 44%

Publication pipeline for French legal codes on 🤗 Datasets from LegiFrance with concurrent upload and dynamic REAMDE.md.

data datasets huggingface huggingface-datasets legal legaltech legifrance open-source parquet piste-api python

Updated 8 months ago

https://github.com/huggingface/zapier • Science 26%

Hugging Face's Zapier Integration 🤗⚡️

huggingface machine-learning zapier zapier-cli

Updated 9 months ago

text-to-ml • Science 44%

Programmable automated machine learning - proof of concept

automl deep-learning huggingface hugginggpt machine-learning python

Updated 9 months ago

lcc • Science 67%

Fine-tuning classifier NNs with Latent Cluster Correction

fine-tuning huggingface latent-space pytorch-lightning torch torchvision

Updated 9 months ago

automated-brain-explanations • Science 36%

Generating and validating natural-language explanations for the brain.

ai-for-science artificial-intelligence automated-interpretability data-science explanation fmri fmri-data-analysis gpt gpt4 huggingface interpretability interpretable-embeddings language-model large-language-models machine-learning mechanistic-interpretability natural-language-processing neuroscience xai

Updated 9 months ago

pix2seq • Science 67%

Simple Implementation of Pix2Seq model for object detection in PyTorch

deep-learning huggingface language-model object-detection pix2seq pytorch pytorch-implementation timm transformer

Updated 9 months ago

FMAT • Science 49%

😷 The Fill-Mask Association Test (FMAT): Measuring Propositions in Natural Language.

ai artificial-intelligence bert bert-model bert-models contextualized-representation fill-in-the-blank fill-mask huggingface language-model language-models large-language-models masked-language-models natural-language-processing natural-language-understanding nlp pretrained-models transformer transformers

Updated 9 months ago

moe-infinity • Science 54%

PyTorch library for cost-effective, fast and easy serving of MoE models.

huggingface inference-engine large-language-models llm-inference mixture-of-experts pytorch

Updated 9 months ago

2uml • Science 26%

A user-friendly tool that generates UMLs starting from natural language inputs.

fastapi generative-ai huggingface python

Updated 9 months ago

https://github.com/amazon-science/lc-plm • Science 23%

LC-PLM: long-context protein language model based on BiMamba-S architecture

biology foundation-models foundation-models-for-biology huggingface mamba-state-space-models pretrained-models protein protein-sequences