binarylm_eval
Science Score: 31.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic links in README
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Unable to calculate vocabulary similarity
Last synced: 10 months ago
·
JSON representation
·
Repository
Basic Info
- Host: GitHub
- Owner: blacksunfm
- Language: Python
- Default Branch: main
- Size: 0 Bytes
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Created over 1 year ago
· Last pushed over 1 year ago
Metadata Files
Readme
Contributing
Citation
Codeowners
Owner
- Login: blacksunfm
- Kind: user
- Repositories: 1
- Profile: https://github.com/blacksunfm
Citation (CITATION.bib)
@misc{eval-harness,
author = {Gao, Leo and Tow, Jonathan and Abbasi, Baber and Biderman, Stella and Black, Sid and DiPofi, Anthony and Foster, Charles and Golding, Laurence and Hsu, Jeffrey and Le Noac'h, Alain and Li, Haonan and McDonell, Kyle and Muennighoff, Niklas and Ociepa, Chris and Phang, Jason and Reynolds, Laria and Schoelkopf, Hailey and Skowron, Aviya and Sutawika, Lintang and Tang, Eric and Thite, Anish and Wang, Ben and Wang, Kevin and Zou, Andy},
title = {A framework for few-shot language model evaluation},
month = 12,
year = 2023,
publisher = {Zenodo},
version = {v0.4.0},
doi = {10.5281/zenodo.10256836},
url = {https://zenodo.org/records/10256836}
}
GitHub Events
Total
- Push event: 12
- Create event: 2
Last Year
- Push event: 12
- Create event: 2
Dependencies
lm_eval.egg-info/requires.txt
pypi
- accelerate >=0.26.0
- aiohttp *
- antlr4-python3-runtime ==4.11
- auto-gptq >=0.6.0
- causal-conv1d ==1.0.2
- datasets >=2.16.0
- deepsparse-nightly >=1.8.0.20240404
- dill *
- evaluate >=0.4.0
- evaluate *
- gptqmodel >=1.0.9
- hf_transfer *
- ibm_watsonx_ai *
- immutabledict *
- jieba >=0.42.1
- jsonlines *
- langdetect *
- lm_eval *
- mamba_ssm *
- more_itertools *
- mypy *
- nagisa >=0.2.7
- nltk >=3.9.1
- numexpr *
- numpy *
- optimum *
- pandas *
- peft >=0.2.0
- pre-commit *
- promptsource >=0.2.3
- pybind11 >=2.6.2
- pycountry *
- pytablewriter *
- pytest *
- pytest-cov *
- pytest-xdist *
- requests *
- rouge-score >=0.0.4
- sacrebleu >=1.5.0
- scikit-learn >=0.24.1
- sentencepiece >=0.1.98
- sparseml-nightly >=1.8.0.20240404
- sqlitedict *
- sympy >=1.12
- tenacity *
- tiktoken *
- torch >=1.8
- tqdm *
- tqdm-multiprocess *
- transformers >=4.1
- vllm >=0.4.2
- wandb >=0.16.3
- word2number *
- zeno-client *
- zstandard *
pyproject.toml
pypi
- accelerate >=0.26.0
- datasets >=2.16.0
- dill *
- evaluate >=0.4.0
- evaluate *
- jsonlines *
- more_itertools *
- numexpr *
- peft >=0.2.0
- pybind11 >=2.6.2
- pytablewriter *
- rouge-score >=0.0.4
- sacrebleu >=1.5.0
- scikit-learn >=0.24.1
- sqlitedict *
- torch >=1.8
- tqdm-multiprocess *
- transformers >=4.1
- word2number *
- zstandard *
requirements.txt
pypi
setup.py
pypi