Data

Tools

Indexes

Applications

Experiments

Open Source Science

lm_kvcache

https://github.com/jesseliu0913/lm_kvcache

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic links in README
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Unable to calculate vocabulary similarity
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: jesseliu0913
  • License: mit
  • Language: Python
  • Default Branch: main
  • Size: 8.93 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created about 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme Contributing License Citation Codeowners

Owner

  • Name: Jesse Liu
  • Login: jesseliu0913
  • Kind: user
  • Location: Saint Louis
  • Company: Washington University in st. louis

GitHub Events

Total
  • Public event: 1
  • Push event: 2
Last Year
  • Public event: 1
  • Push event: 2

Dependencies

environment.yml pypi
  • absl-py ==2.1.0
  • accelerate ==1.0.1
  • aiohttp ==3.9.4
  • aiosignal ==1.3.1
  • appdirs ==1.4.4
  • async-timeout ==4.0.3
  • attrs ==23.2.0
  • bitsandbytes ==0.43.1
  • black ==23.7.0
  • cachetools ==5.3.3
  • certifi ==2024.2.2
  • cfgv ==3.4.0
  • chardet ==5.2.0
  • charset-normalizer ==3.3.2
  • click ==8.1.7
  • cmake ==3.29.0.1
  • colorama ==0.4.6
  • contourpy ==1.2.1
  • coverage ==7.2.7
  • cycler ==0.12.1
  • dataproperty ==1.0.1
  • datasets ==2.18.0
  • debugpy ==1.6.7
  • deepspeed ==0.10.0
  • dill ==0.3.7
  • distlib ==0.3.8
  • docker-pycreds ==0.4.0
  • einops ==0.8.0
  • evaluate ==0.4.2
  • exceptiongroup ==1.2.0
  • fast-hadamard-transform ==1.0.4.post1
  • filelock ==3.13.4
  • flake8 ==6.0.0
  • flash-attn ==2.6.3
  • fonttools ==4.51.0
  • frozenlist ==1.4.1
  • fsspec ==2024.2.0
  • gitdb ==4.0.11
  • gitpython ==3.1.43
  • google-auth ==2.29.0
  • google-auth-oauthlib ==1.0.0
  • grpcio ==1.62.1
  • hjson ==3.1.0
  • huggingface-hub ==0.26.0
  • identify ==2.5.35
  • idna ==3.7
  • immutabledict ==4.2.0
  • importlib-metadata ==7.1.0
  • importlib-resources ==6.4.0
  • iniconfig ==2.0.0
  • isort ==5.12.0
  • jinja2 ==3.1.3
  • joblib ==1.4.0
  • jsonlines ==4.0.0
  • k-means-constrained ==0.7.3
  • kiwisolver ==1.4.5
  • lit ==18.1.3
  • lm-eval ==0.4.1
  • lxml ==5.2.1
  • markdown ==3.6
  • markupsafe ==2.1.5
  • matplotlib ==3.7.2
  • mbstrdecoder ==1.1.3
  • mccabe ==0.7.0
  • more-itertools ==10.2.0
  • mpmath ==1.3.0
  • multidict ==6.0.5
  • multiprocess ==0.70.15
  • mypy-extensions ==1.0.0
  • networkx ==3.2.1
  • ninja ==1.11.1
  • nltk ==3.8.1
  • nodeenv ==1.8.0
  • numexpr ==2.10.0
  • numpy ==1.25.0
  • nvidia-cublas-cu11 ==11.10.3.66
  • nvidia-cuda-cupti-cu11 ==11.7.101
  • nvidia-cuda-nvrtc-cu11 ==11.7.99
  • nvidia-cuda-runtime-cu11 ==11.7.99
  • nvidia-cudnn-cu11 ==8.5.0.96
  • nvidia-cufft-cu11 ==10.9.0.58
  • nvidia-curand-cu11 ==10.2.10.91
  • nvidia-cusolver-cu11 ==11.4.0.1
  • nvidia-cusparse-cu11 ==11.7.4.91
  • nvidia-nccl-cu11 ==2.14.3
  • nvidia-nvtx-cu11 ==11.7.91
  • oauthlib ==3.2.2
  • omegaconf ==2.0.6
  • opencv-python ==4.8.1.78
  • ortools ==9.9.3963
  • packaging ==23.1
  • pandas ==2.0.3
  • pathspec ==0.12.1
  • pathtools ==0.1.2
  • pathvalidate ==3.2.0
  • pebble ==5.0.3
  • peft ==0.4.0
  • pillow ==9.4.0
  • platformdirs ==4.2.0
  • pluggy ==1.4.0
  • portalocker ==2.8.2
  • pre-commit ==3.3.3
  • protobuf ==4.25.3
  • psutil ==5.9.8
  • py-cpuinfo ==9.0.0
  • pyarrow ==15.0.2
  • pyarrow-hotfix ==0.6
  • pyasn1 ==0.6.0
  • pyasn1-modules ==0.4.0
  • pybind11 ==2.12.0
  • pycodestyle ==2.10.0
  • pydantic ==1.10.15
  • pyflakes ==3.0.1
  • pynvml ==11.5.0
  • pyparsing ==3.0.9
  • pyre-extensions ==0.0.29
  • pytablewriter ==1.2.0
  • pytest ==7.4.0
  • python-dateutil ==2.9.0.post0
  • python-dotenv ==1.0.0
  • pytz ==2024.1
  • pyyaml ==6.0.1
  • regex ==2023.12.25
  • requests ==2.31.0
  • requests-oauthlib ==2.0.0
  • rouge-score ==0.1.2
  • rsa ==4.9
  • sacrebleu ==2.4.2
  • safetensors ==0.4.3
  • scikit-learn ==1.3.0
  • scipy ==1.13.0
  • sentence-transformers ==2.2.2
  • sentencepiece ==0.1.99
  • sentry-sdk ==1.45.0
  • setproctitle ==1.3.3
  • six ==1.16.0
  • smmap ==5.0.1
  • sqlitedict ==2.1.0
  • sympy ==1.12
  • tabledata ==1.3.3
  • tabulate ==0.9.0
  • tcolorpy ==0.1.6
  • tensorboard ==2.13.0
  • tensorboard-data-server ==0.7.2
  • threadpoolctl ==3.4.0
  • tokenizers ==0.20.1
  • tomli ==2.0.1
  • torch ==2.0.1
  • torchaudio ==2.0.2
  • torchvision ==0.15.2
  • tqdm ==4.65.0
  • tqdm-multiprocess ==0.0.11
  • transformers ==4.45.1
  • triton ==2.0.0
  • trl ==0.4.7
  • typepy ==1.3.2
  • typing-extensions ==4.11.0
  • typing-inspect ==0.9.0
  • tzdata ==2024.1
  • urllib3 ==2.2.1
  • virtualenv ==20.25.1
  • wandb ==0.15.6
  • werkzeug ==3.0.2
  • word2number ==1.1
  • xformers ==0.0.20
  • xxhash ==3.4.1
  • yarl ==1.9.4
  • zipp ==3.18.1
  • zstandard ==0.22.0
lm_eval.egg-info/requires.txt pypi
  • accelerate >=0.21.0
  • anthropic *
  • antlr4-python3-runtime ==4.11
  • auto-gptq >=0.6.0
  • causal-conv1d ==1.0.2
  • datasets >=2.16.0
  • dill *
  • evaluate >=0.4.0
  • evaluate *
  • hf_transfer *
  • immutabledict *
  • jieba >=0.42.1
  • jsonlines *
  • langdetect *
  • lm_eval *
  • mamba_ssm *
  • more_itertools *
  • mypy *
  • nagisa >=0.2.7
  • numexpr *
  • numpy *
  • openai ==1.3.9
  • optimum *
  • pandas *
  • peft >=0.2.0
  • pre-commit *
  • promptsource >=0.2.3
  • protobuf >=4.22.1
  • pybind11 >=2.6.2
  • pycountry *
  • pytablewriter *
  • pytest *
  • pytest-cov *
  • pytest-xdist *
  • rouge-score >=0.0.4
  • sacrebleu >=1.5.0
  • scikit-learn >=0.24.1
  • sentencepiece >=0.1.98
  • sqlitedict *
  • sympy >=1.12
  • tiktoken *
  • torch >=1.8
  • tqdm-multiprocess *
  • transformers >=4.1
  • vllm ==0.3.2
  • wandb >=0.16.3
  • word2number *
  • zeno-client *
  • zstandard *
pyproject.toml pypi
  • accelerate >=0.21.0
  • datasets >=2.16.0
  • dill *
  • evaluate >=0.4.0
  • evaluate *
  • jsonlines *
  • more_itertools *
  • numexpr *
  • peft >=0.2.0
  • pybind11 >=2.6.2
  • pytablewriter *
  • rouge-score >=0.0.4
  • sacrebleu >=1.5.0
  • scikit-learn >=0.24.1
  • sqlitedict *
  • torch >=1.8
  • tqdm-multiprocess *
  • transformers >=4.1
  • word2number *
  • zstandard *
requirements.txt pypi
  • DataProperty ==1.0.1
  • GitPython ==3.1.43
  • Jinja2 ==3.1.3
  • Markdown ==3.6
  • MarkupSafe ==2.1.5
  • Pebble ==5.0.3
  • Pillow ==9.4.0
  • PyYAML ==6.0.1
  • Werkzeug ==3.0.2
  • absl-py ==2.1.0
  • accelerate ==1.0.1
  • aiohttp ==3.9.4
  • aiosignal ==1.3.1
  • appdirs ==1.4.4
  • async-timeout ==4.0.3
  • attrs ==23.2.0
  • bitsandbytes ==0.43.1
  • black ==23.7.0
  • cachetools ==5.3.3
  • certifi ==2024.2.2
  • cfgv ==3.4.0
  • chardet ==5.2.0
  • charset-normalizer ==3.3.2
  • click ==8.1.7
  • cmake ==3.29.0.1
  • colorama ==0.4.6
  • contourpy ==1.2.1
  • coverage ==7.2.7
  • cycler ==0.12.1
  • datasets ==2.18.0
  • debugpy ==1.6.7
  • deepspeed ==0.10.0
  • dill ==0.3.7
  • distlib ==0.3.8
  • docker-pycreds ==0.4.0
  • einops ==0.8.0
  • evaluate ==0.4.2
  • exceptiongroup ==1.2.0
  • fast-hadamard-transform ==1.0.4.post1
  • filelock ==3.13.4
  • flake8 ==6.0.0
  • flash-attn ==2.6.3
  • fonttools ==4.51.0
  • frozenlist ==1.4.1
  • fsspec ==2024.2.0
  • gitdb ==4.0.11
  • google-auth ==2.29.0
  • google-auth-oauthlib ==1.0.0
  • grpcio ==1.62.1
  • hjson ==3.1.0
  • huggingface-hub ==0.26.0
  • identify ==2.5.35
  • idna ==3.7
  • immutabledict ==4.2.0
  • importlib_metadata ==7.1.0
  • importlib_resources ==6.4.0
  • iniconfig ==2.0.0
  • isort ==5.12.0
  • joblib ==1.4.0
  • jsonlines ==4.0.0
  • k-means-constrained ==0.7.3
  • kiwisolver ==1.4.5
  • lit ==18.1.3
  • lm_eval ==0.4.1
  • lxml ==5.2.1
  • matplotlib ==3.7.2
  • mbstrdecoder ==1.1.3
  • mccabe ==0.7.0
  • more-itertools ==10.2.0
  • mpmath ==1.3.0
  • multidict ==6.0.5
  • multiprocess ==0.70.15
  • mypy-extensions ==1.0.0
  • networkx ==3.2.1
  • ninja ==1.11.1
  • nltk ==3.8.1
  • nodeenv ==1.8.0
  • numexpr ==2.10.0
  • numpy ==1.25.0
  • nvidia-cublas-cu11 ==11.10.3.66
  • nvidia-cuda-cupti-cu11 ==11.7.101
  • nvidia-cuda-nvrtc-cu11 ==11.7.99
  • nvidia-cuda-runtime-cu11 ==11.7.99
  • nvidia-cudnn-cu11 ==8.5.0.96
  • nvidia-cufft-cu11 ==10.9.0.58
  • nvidia-curand-cu11 ==10.2.10.91
  • nvidia-cusolver-cu11 ==11.4.0.1
  • nvidia-cusparse-cu11 ==11.7.4.91
  • nvidia-nccl-cu11 ==2.14.3
  • nvidia-nvtx-cu11 ==11.7.91
  • oauthlib ==3.2.2
  • omegaconf *
  • opencv-python ==4.8.1.78
  • ortools ==9.9.3963
  • packaging ==23.1
  • pandas ==2.0.3
  • pathspec ==0.12.1
  • pathtools ==0.1.2
  • pathvalidate ==3.2.0
  • peft ==0.4.0
  • platformdirs ==4.2.0
  • pluggy ==1.4.0
  • portalocker ==2.8.2
  • pre-commit ==3.3.3
  • protobuf ==4.25.3
  • psutil ==5.9.8
  • py-cpuinfo ==9.0.0
  • pyarrow ==15.0.2
  • pyarrow-hotfix ==0.6
  • pyasn1 ==0.6.0
  • pyasn1_modules ==0.4.0
  • pybind11 ==2.12.0
  • pycodestyle ==2.10.0
  • pydantic ==1.10.15
  • pyflakes ==3.0.1
  • pynvml ==11.5.0
  • pyparsing ==3.0.9
  • pyre-extensions ==0.0.29
  • pytablewriter ==1.2.0
  • pytest ==7.4.0
  • python-dateutil ==2.9.0.post0
  • python-dotenv ==1.0.0
  • pytz ==2024.1
  • regex ==2023.12.25
  • requests ==2.31.0
  • requests-oauthlib ==2.0.0
  • rouge_score ==0.1.2
  • rsa ==4.9
  • sacrebleu ==2.4.2
  • safetensors ==0.4.3
  • scikit-learn ==1.3.0
  • scipy ==1.13.0
  • sentence-transformers ==2.2.2
  • sentencepiece ==0.1.99
  • sentry-sdk ==1.45.0
  • setproctitle ==1.3.3
  • six ==1.16.0
  • smmap ==5.0.1
  • sqlitedict ==2.1.0
  • sympy ==1.12
  • tabledata ==1.3.3
  • tabulate ==0.9.0
  • tcolorpy ==0.1.6
  • tensorboard ==2.13.0
  • tensorboard-data-server ==0.7.2
  • threadpoolctl ==3.4.0
  • tokenizers ==0.20.1
  • tomli ==2.0.1
  • torch ==2.0.1
  • torchaudio ==2.0.2
  • torchvision ==0.15.2
  • tqdm ==4.65.0
  • tqdm-multiprocess ==0.0.11
  • transformers ==4.45.1
  • triton ==2.0.0
  • trl ==0.4.7
  • typepy ==1.3.2
  • typing-inspect ==0.9.0
  • typing_extensions ==4.11.0
  • tzdata ==2024.1
  • urllib3 ==2.2.1
  • virtualenv ==20.25.1
  • wandb ==0.15.6
  • word2number ==1.1
  • xformers ==0.0.20
  • xxhash ==3.4.1
  • yarl ==1.9.4
  • zipp ==3.18.1
  • zstandard ==0.22.0
setup.py pypi