Data

Tools

Indexes

Applications

Experiments

Open Source Science

optimization

https://github.com/qfoi/optimization

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (2.5%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: QFOI
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 4.68 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created about 1 year ago · Last pushed about 1 year ago
Metadata Files
Readme License Citation

README.md

1.基于Galore论文中代码修改实现

Galore配置：

bash pip install galore-torch pip install -r exp_requirements.txt

注意请在python3.8环境下运行（实验使用版本为3.8.20）

下载C4-en dataset与t5-base-tokenize

Tokenize下载

```bash from transformers import AutoTokenizer, AutoModel

加载预训练的分词器和模型

tokenizer = AutoTokenizer.frompretrained("google/t5-base") model = AutoModel.frompretrained("google/t5-base")

保存到本地

tokenizer.savepretrained("./t5-base-tokenizer") model.savepretrained("./t5-base-model") ```

dataset下载

bash GIT_LFS_SKIP_SMUDGE=1 git clone https://hf-mirror.com/datasets/allenai/c4 cd c4 git lfs pull --include "en/*"

运行

bash sh run.sh

2.ReLoRA相关实验代码地址为./GaLore/peft-training/relora.py直接运行即可

Owner

  • Login: QFOI
  • Kind: user

Citation (CITATION.cff) 

cff-version: 1.2.0
title: "GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection"
version: 1.0.0
message: "If you use this software, please cite it as below."
authors:
  - family-names: "Jiawei"
    given-names: "Zhao"
year: 2024
repository-code: "https://arxiv.org/abs/2403.03507"

GitHub Events

Total
  • Watch event: 1
  • Push event: 2
  • Create event: 2
Last Year
  • Watch event: 1
  • Push event: 2
  • Create event: 2

Dependencies

exp_requirements.txt pypi
  • bitsandbytes *
  • datasets *
  • evaluate *
  • lion-pytorch *
  • loguru *
  • matplotlib *
  • nvitop *
  • peft *
  • scikit-learn *
  • scipy *
  • tokenizers *
  • torch *
  • transformers ==4.31.0
  • wandb *
requirements.txt pypi
  • bitsandbytes *
  • tensorly *
  • torch *
  • transformers *
setup.py pypi
wandb/latest-run/files/requirements.txt pypi
  • GitPython ==3.1.44 test
  • Jinja2 ==3.1.5 test
  • MarkupSafe ==2.1.5 test
  • PyYAML ==6.0.2 test
  • accelerate ==1.0.1 test
  • aiohappyeyeballs ==2.4.4 test
  • aiohttp ==3.10.11 test
  • aiosignal ==1.3.1 test
  • annotated-types ==0.7.0 test
  • async-timeout ==5.0.1 test
  • attrs ==24.3.0 test
  • bitsandbytes ==0.45.0 test
  • cachetools ==5.5.0 test
  • certifi ==2024.12.14 test
  • charset-normalizer ==3.4.1 test
  • click ==8.1.8 test
  • contourpy ==1.1.1 test
  • cycler ==0.12.1 test
  • datasets ==3.1.0 test
  • dill ==0.3.8 test
  • docker-pycreds ==0.4.0 test
  • eval_type_backport ==0.2.2 test
  • evaluate ==0.4.3 test
  • filelock ==3.16.1 test
  • fonttools ==4.55.3 test
  • frozenlist ==1.5.0 test
  • fsspec ==2024.9.0 test
  • gitdb ==4.0.12 test
  • huggingface-hub ==0.27.1 test
  • idna ==3.10 test
  • importlib_resources ==6.4.5 test
  • joblib ==1.4.2 test
  • kiwisolver ==1.4.7 test
  • lion-pytorch ==0.2.3 test
  • loguru ==0.7.3 test
  • matplotlib ==3.7.5 test
  • mpmath ==1.3.0 test
  • multidict ==6.1.0 test
  • multiprocess ==0.70.16 test
  • networkx ==3.1 test
  • numpy ==1.24.4 test
  • nvidia-cublas-cu12 ==12.1.3.1 test
  • nvidia-cuda-cupti-cu12 ==12.1.105 test
  • nvidia-cuda-nvrtc-cu12 ==12.1.105 test
  • nvidia-cuda-runtime-cu12 ==12.1.105 test
  • nvidia-cudnn-cu12 ==9.1.0.70 test
  • nvidia-cufft-cu12 ==11.0.2.54 test
  • nvidia-curand-cu12 ==10.3.2.106 test
  • nvidia-cusolver-cu12 ==11.4.5.107 test
  • nvidia-cusparse-cu12 ==12.1.0.106 test
  • nvidia-ml-py ==12.560.30 test
  • nvidia-nccl-cu12 ==2.20.5 test
  • nvidia-nvjitlink-cu12 ==12.6.85 test
  • nvidia-nvtx-cu12 ==12.1.105 test
  • nvitop ==1.4.1 test
  • packaging ==24.2 test
  • pandas ==2.0.3 test
  • peft ==0.13.2 test
  • pillow ==10.4.0 test
  • pip ==24.2 test
  • platformdirs ==4.3.6 test
  • propcache ==0.2.0 test
  • protobuf ==5.29.3 test
  • psutil ==6.1.1 test
  • pyarrow ==17.0.0 test
  • pydantic ==2.10.5 test
  • pydantic_core ==2.27.2 test
  • pyparsing ==3.1.4 test
  • python-dateutil ==2.9.0.post0 test
  • pytz ==2024.2 test
  • regex ==2024.11.6 test
  • requests ==2.32.3 test
  • safetensors ==0.5.2 test
  • scikit-learn ==1.3.2 test
  • scipy ==1.10.1 test
  • sentry-sdk ==2.20.0 test
  • setproctitle ==1.3.4 test
  • setuptools ==75.1.0 test
  • six ==1.17.0 test
  • smmap ==5.0.2 test
  • sympy ==1.13.3 test
  • tensorly ==0.9.0 test
  • termcolor ==2.4.0 test
  • threadpoolctl ==3.5.0 test
  • tokenizers ==0.13.3 test
  • torch ==2.4.1 test
  • tqdm ==4.67.1 test
  • transformers ==4.31.0 test
  • triton ==3.0.0 test
  • typing_extensions ==4.12.2 test
  • tzdata ==2024.2 test
  • urllib3 ==2.2.3 test
  • wandb ==0.19.4 test
  • wheel ==0.44.0 test
  • xxhash ==3.5.0 test
  • yarl ==1.15.2 test
  • zipp ==3.20.2 test
wandb/offline-run-20250117_152304-77skma4y/files/requirements.txt pypi
  • Flask ==3.1.0
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==3.0.2
  • PyYAML ==6.0.1
  • Pygments ==2.19.1
  • Werkzeug ==3.1.3
  • accelerate ==1.2.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.11.11
  • aiosignal ==1.3.2
  • airportsdata ==20241001
  • annotated-types ==0.7.0
  • anthropic ==0.30.1
  • anyio ==4.8.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • blinker ==1.9.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • cloudpickle ==3.1.0
  • cmake ==3.31.4
  • colorlog ==6.9.0
  • contourpy ==1.3.0
  • cycler ==0.12.1
  • datasets ==3.2.0
  • dill ==0.3.8
  • diskcache ==5.6.3
  • distro ==1.9.0
  • dnspython ==2.7.0
  • docker-pycreds ==0.4.0
  • email_validator ==2.2.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • exceptiongroup ==1.2.2
  • fastapi ==0.111.0
  • fastapi-cli ==0.0.7
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • galore-torch ==1.0
  • gevent ==24.11.1
  • gitdb ==4.0.12
  • google-ai-generativelanguage ==0.6.6
  • google-api-core ==2.24.0
  • google-api-python-client ==2.158.0
  • google-auth ==2.37.0
  • google-auth-httplib2 ==0.2.0
  • google-generativeai ==0.7.1
  • googleapis-common-protos ==1.66.0
  • greenlet ==3.1.1
  • grpcio ==1.69.0
  • grpcio-status ==1.62.3
  • gunicorn ==23.0.0
  • h11 ==0.14.0
  • httpcore ==1.0.7
  • httplib2 ==0.22.0
  • httptools ==0.6.4
  • httpx ==0.27.1
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_metadata ==8.5.0
  • importlib_resources ==6.5.2
  • interegular ==0.3.3
  • itsdangerous ==2.2.0
  • jieba ==0.42.1
  • jiter ==0.8.2
  • joblib ==1.4.2
  • jsonschema ==4.23.0
  • jsonschema-specifications ==2024.10.1
  • kiwisolver ==1.4.7
  • lark ==1.2.2
  • lion-pytorch ==0.2.3
  • lm-format-enforcer ==0.10.1
  • loguru ==0.7.3
  • markdown-it-py ==3.0.0
  • matplotlib ==3.9.4
  • mdurl ==0.1.2
  • mpmath ==1.3.0
  • msgpack ==1.1.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • nest-asyncio ==1.6.0
  • networkx ==3.2.1
  • ninja ==1.11.1.3
  • numpy ==2.0.0
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==8.9.2.26
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • openai ==1.35.7
  • orjson ==3.10.14
  • outlines ==0.1.12
  • outlines_core ==0.1.26
  • packaging ==24.2
  • pandas ==2.2.2
  • peft ==0.14.0
  • pillow ==11.1.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • prometheus-fastapi-instrumentator ==7.0.0
  • prometheus_client ==0.21.1
  • propcache ==0.2.1
  • proto-plus ==1.25.0
  • protobuf ==4.25.5
  • psutil ==6.1.1
  • py-cpuinfo ==9.0.0
  • pyarrow ==18.1.0
  • pyasn1 ==0.6.1
  • pyasn1_modules ==0.4.1
  • pycountry ==24.6.1
  • pydantic ==2.8.0
  • pydantic_core ==2.20.0
  • pyparsing ==3.2.1
  • python-dateutil ==2.9.0.post0
  • python-dotenv ==1.0.1
  • python-multipart ==0.0.20
  • pytz ==2024.2
  • ray ==2.40.0
  • referencing ==0.35.1
  • regex ==2024.11.6
  • requests ==2.32.3
  • rich ==13.9.4
  • rich-toolkit ==0.12.0
  • rpds-py ==0.22.3
  • rsa ==4.9
  • safetensors ==0.4.3
  • scikit-learn ==1.6.1
  • scipy ==1.13.1
  • sentencepiece ==0.2.0
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • shellingham ==1.5.4
  • six ==1.17.0
  • smmap ==5.0.2
  • sniffio ==1.3.1
  • sse-starlette ==2.1.2
  • starlette ==0.37.2
  • sympy ==1.13.3
  • tenacity ==9.0.0
  • tensorly ==0.9.0
  • termcolor ==2.5.0
  • threadpoolctl ==3.5.0
  • tiktoken ==0.7.0
  • tokenizers ==0.21.0
  • torch ==2.3.0
  • tqdm ==4.66.4
  • transformers ==4.48.0
  • triton ==2.3.0
  • typer ==0.15.1
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • ujson ==5.10.0
  • uritemplate ==4.1.1
  • urllib3 ==2.3.0
  • uvicorn ==0.30.1
  • uvloop ==0.21.0
  • vllm ==0.5.0.post1
  • vllm-flash-attn ==2.5.9
  • wandb ==0.19.4
  • watchfiles ==1.0.4
  • websockets ==14.1
  • wheel ==0.44.0
  • xformers ==0.0.26.post1
  • xxhash ==3.5.0
  • yarl ==1.18.3
  • zipp ==3.21.0
  • zope.event ==5.0
  • zope.interface ==7.2
wandb/offline-run-20250117_152558-c1zskfkl/files/requirements.txt pypi
  • Flask ==3.1.0
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==3.0.2
  • PyYAML ==6.0.1
  • Pygments ==2.19.1
  • Werkzeug ==3.1.3
  • accelerate ==1.2.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.11.11
  • aiosignal ==1.3.2
  • airportsdata ==20241001
  • annotated-types ==0.7.0
  • anthropic ==0.30.1
  • anyio ==4.8.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • blinker ==1.9.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • cloudpickle ==3.1.0
  • cmake ==3.31.4
  • colorlog ==6.9.0
  • contourpy ==1.3.0
  • cycler ==0.12.1
  • datasets ==3.2.0
  • dill ==0.3.8
  • diskcache ==5.6.3
  • distro ==1.9.0
  • dnspython ==2.7.0
  • docker-pycreds ==0.4.0
  • email_validator ==2.2.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • exceptiongroup ==1.2.2
  • fastapi ==0.111.0
  • fastapi-cli ==0.0.7
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • galore-torch ==1.0
  • gevent ==24.11.1
  • gitdb ==4.0.12
  • google-ai-generativelanguage ==0.6.6
  • google-api-core ==2.24.0
  • google-api-python-client ==2.158.0
  • google-auth ==2.37.0
  • google-auth-httplib2 ==0.2.0
  • google-generativeai ==0.7.1
  • googleapis-common-protos ==1.66.0
  • greenlet ==3.1.1
  • grpcio ==1.69.0
  • grpcio-status ==1.62.3
  • gunicorn ==23.0.0
  • h11 ==0.14.0
  • httpcore ==1.0.7
  • httplib2 ==0.22.0
  • httptools ==0.6.4
  • httpx ==0.27.1
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_metadata ==8.5.0
  • importlib_resources ==6.5.2
  • interegular ==0.3.3
  • itsdangerous ==2.2.0
  • jieba ==0.42.1
  • jiter ==0.8.2
  • joblib ==1.4.2
  • jsonschema ==4.23.0
  • jsonschema-specifications ==2024.10.1
  • kiwisolver ==1.4.7
  • lark ==1.2.2
  • lion-pytorch ==0.2.3
  • lm-format-enforcer ==0.10.1
  • loguru ==0.7.3
  • markdown-it-py ==3.0.0
  • matplotlib ==3.9.4
  • mdurl ==0.1.2
  • mpmath ==1.3.0
  • msgpack ==1.1.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • nest-asyncio ==1.6.0
  • networkx ==3.2.1
  • ninja ==1.11.1.3
  • numpy ==2.0.0
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==8.9.2.26
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • openai ==1.35.7
  • orjson ==3.10.14
  • outlines ==0.1.12
  • outlines_core ==0.1.26
  • packaging ==24.2
  • pandas ==2.2.2
  • peft ==0.14.0
  • pillow ==11.1.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • prometheus-fastapi-instrumentator ==7.0.0
  • prometheus_client ==0.21.1
  • propcache ==0.2.1
  • proto-plus ==1.25.0
  • protobuf ==4.25.5
  • psutil ==6.1.1
  • py-cpuinfo ==9.0.0
  • pyarrow ==18.1.0
  • pyasn1 ==0.6.1
  • pyasn1_modules ==0.4.1
  • pycountry ==24.6.1
  • pydantic ==2.8.0
  • pydantic_core ==2.20.0
  • pyparsing ==3.2.1
  • python-dateutil ==2.9.0.post0
  • python-dotenv ==1.0.1
  • python-multipart ==0.0.20
  • pytz ==2024.2
  • ray ==2.40.0
  • referencing ==0.35.1
  • regex ==2024.11.6
  • requests ==2.32.3
  • rich ==13.9.4
  • rich-toolkit ==0.12.0
  • rpds-py ==0.22.3
  • rsa ==4.9
  • safetensors ==0.4.3
  • scikit-learn ==1.6.1
  • scipy ==1.13.1
  • sentencepiece ==0.2.0
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • shellingham ==1.5.4
  • six ==1.17.0
  • smmap ==5.0.2
  • sniffio ==1.3.1
  • sse-starlette ==2.1.2
  • starlette ==0.37.2
  • sympy ==1.13.3
  • tenacity ==9.0.0
  • tensorly ==0.9.0
  • termcolor ==2.5.0
  • threadpoolctl ==3.5.0
  • tiktoken ==0.7.0
  • tokenizers ==0.21.0
  • torch ==2.3.0
  • tqdm ==4.66.4
  • transformers ==4.48.0
  • triton ==2.3.0
  • typer ==0.15.1
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • ujson ==5.10.0
  • uritemplate ==4.1.1
  • urllib3 ==2.3.0
  • uvicorn ==0.30.1
  • uvloop ==0.21.0
  • vllm ==0.5.0.post1
  • vllm-flash-attn ==2.5.9
  • wandb ==0.19.4
  • watchfiles ==1.0.4
  • websockets ==14.1
  • wheel ==0.44.0
  • xformers ==0.0.26.post1
  • xxhash ==3.5.0
  • yarl ==1.18.3
  • zipp ==3.21.0
  • zope.event ==5.0
  • zope.interface ==7.2
wandb/offline-run-20250117_155029-ykgc0ztk/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2
wandb/offline-run-20250117_155223-f28q4s8q/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2
wandb/offline-run-20250117_160916-itp0d7au/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2
wandb/offline-run-20250117_162453-zao5feyk/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2
wandb/offline-run-20250117_164241-xf444ddy/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2
wandb/offline-run-20250117_170604-u9efkvpv/files/requirements.txt pypi
  • GitPython ==3.1.44
  • Jinja2 ==3.1.5
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.2
  • accelerate ==1.0.1
  • aiohappyeyeballs ==2.4.4
  • aiohttp ==3.10.11
  • aiosignal ==1.3.1
  • annotated-types ==0.7.0
  • async-timeout ==5.0.1
  • attrs ==24.3.0
  • bitsandbytes ==0.45.0
  • cachetools ==5.5.0
  • certifi ==2024.12.14
  • charset-normalizer ==3.4.1
  • click ==8.1.8
  • contourpy ==1.1.1
  • cycler ==0.12.1
  • datasets ==3.1.0
  • dill ==0.3.8
  • docker-pycreds ==0.4.0
  • eval_type_backport ==0.2.2
  • evaluate ==0.4.3
  • filelock ==3.16.1
  • fonttools ==4.55.3
  • frozenlist ==1.5.0
  • fsspec ==2024.9.0
  • gitdb ==4.0.12
  • huggingface-hub ==0.27.1
  • idna ==3.10
  • importlib_resources ==6.4.5
  • joblib ==1.4.2
  • kiwisolver ==1.4.7
  • lion-pytorch ==0.2.3
  • loguru ==0.7.3
  • matplotlib ==3.7.5
  • mpmath ==1.3.0
  • multidict ==6.1.0
  • multiprocess ==0.70.16
  • networkx ==3.1
  • numpy ==1.24.4
  • nvidia-cublas-cu12 ==12.1.3.1
  • nvidia-cuda-cupti-cu12 ==12.1.105
  • nvidia-cuda-nvrtc-cu12 ==12.1.105
  • nvidia-cuda-runtime-cu12 ==12.1.105
  • nvidia-cudnn-cu12 ==9.1.0.70
  • nvidia-cufft-cu12 ==11.0.2.54
  • nvidia-curand-cu12 ==10.3.2.106
  • nvidia-cusolver-cu12 ==11.4.5.107
  • nvidia-cusparse-cu12 ==12.1.0.106
  • nvidia-ml-py ==12.560.30
  • nvidia-nccl-cu12 ==2.20.5
  • nvidia-nvjitlink-cu12 ==12.6.85
  • nvidia-nvtx-cu12 ==12.1.105
  • nvitop ==1.4.1
  • packaging ==24.2
  • pandas ==2.0.3
  • peft ==0.13.2
  • pillow ==10.4.0
  • pip ==24.2
  • platformdirs ==4.3.6
  • propcache ==0.2.0
  • protobuf ==5.29.3
  • psutil ==6.1.1
  • pyarrow ==17.0.0
  • pydantic ==2.10.5
  • pydantic_core ==2.27.2
  • pyparsing ==3.1.4
  • python-dateutil ==2.9.0.post0
  • pytz ==2024.2
  • regex ==2024.11.6
  • requests ==2.32.3
  • safetensors ==0.5.2
  • scikit-learn ==1.3.2
  • scipy ==1.10.1
  • sentry-sdk ==2.20.0
  • setproctitle ==1.3.4
  • setuptools ==75.1.0
  • six ==1.17.0
  • smmap ==5.0.2
  • sympy ==1.13.3
  • tensorly ==0.9.0
  • termcolor ==2.4.0
  • threadpoolctl ==3.5.0
  • tokenizers ==0.13.3
  • torch ==2.4.1
  • tqdm ==4.67.1
  • transformers ==4.31.0
  • triton ==3.0.0
  • typing_extensions ==4.12.2
  • tzdata ==2024.2
  • urllib3 ==2.2.3
  • wandb ==0.19.4
  • wheel ==0.44.0
  • xxhash ==3.5.0
  • yarl ==1.15.2
  • zipp ==3.20.2