medical-evaluation

https://github.com/bids-xu-lab/medical-evaluation

Science Score: 18.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (2.2%) to scientific vocabulary

Last synced: 10 months ago · JSON representation ·

Repository

Basic Info

Host: GitHub
Owner: BIDS-Xu-Lab
License: mit
Language: Python
Default Branch: main
Size: 2.87 MB

Statistics

Stars: 0
Watchers: 0
Forks: 0
Open Issues: 0
Releases: 0

Created over 2 years ago · Last pushed over 2 years ago

Metadata Files

Readme License Citation Codeowners

Medical Evaluation Framework

Welcome to the Medical Evaluation Framework! This project is a forked version, specifically tailored for the medical sector. Our goal is to adapt and expand the original framework to enable the assessment of generative language models on a variety of evaluation tasks unique to medical data analysis and forecasting.

Owner

Name: BIDS-Xu-Lab
Login: BIDS-Xu-Lab
Kind: organization

Repositories: 1
Profile: https://github.com/BIDS-Xu-Lab

Citation (CITATION.bib)

@software{eval-harness,
  author       = {Gao, Leo and
                  Tow, Jonathan and
                  Biderman, Stella and
                  Black, Sid and
                  DiPofi, Anthony and
                  Foster, Charles and
                  Golding, Laurence and
                  Hsu, Jeffrey and
                  McDonell, Kyle and
                  Muennighoff, Niklas and
                  Phang, Jason and
                  Reynolds, Laria and
                  Tang, Eric and
                  Thite, Anish and
                  Wang, Ben and
                  Wang, Kevin and
                  Zou, Andy},
  title        = {A framework for few-shot language model evaluation},
  month        = sep,
  year         = 2021,
  publisher    = {Zenodo},
  version      = {v0.0.1},
  doi          = {10.5281/zenodo.5371628},
  url          = {https://doi.org/10.5281/zenodo.5371628}
}

GitHub Events

Total

Watch event: 1

Last Year

Watch event: 1

Dependencies

Dockerfile docker

nvidia/cuda 11.2.0-cudnn8-runtime-ubuntu20.04 build

requirements.txt pypi

setup.py pypi

accelerate >=0.17.1
datasets >=2.0.0
einops *
jsonlines *
numexpr *
omegaconf >=2.2
openai >=0.6.4
peft >=0.2.0
pybind11 >=2.6.2
pycountry *
pytablewriter *
rouge-score >=0.0.4
sacrebleu ==1.5.0
scikit-learn >=0.24.1
sqlitedict *
torch >=1.7
tqdm-multiprocess *
transformers >=4.1
zstandard *

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science