Data

Tools

Indexes

Applications

Experiments

Open Source Science

oslmrec

https://github.com/sasukexie/oslmrec

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (1.7%) to scientific vocabulary
Last synced: 10 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: sasukexie
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 11.4 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created almost 2 years ago · Last pushed almost 2 years ago
Metadata Files
Readme License Citation

README.md

OSLMRec: Is It Sufficient to Harness Only Small Language Models for Recommendation?

Train and Test OSLMRec:

glm3

ml

  • incremental pre-training
    • llamafactory-cli train examples/zone/glm3/loraptml.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/glm3/lorasftml.yaml
  • test
    • llamafactory-cli train examples/zone/glm3/lorapdml.yaml ### yelp
  • incremental pre-training
    • llamafactory-cli train examples/zone/glm3/loraptyelp.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/glm3/lorasftyelp.yaml
  • test
    • llamafactory-cli train examples/zone/glm3/lorapdyelp.yaml

llama2

ml

  • incremental pre-training
    • llamafactory-cli train examples/zone/llama2/loraptml.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/llama2/lorasftml.yaml
  • test
    • llamafactory-cli train examples/zone/llama2/lorapdml.yaml ### yelp
  • incremental pre-training
    • llamafactory-cli train examples/zone/llama2/loraptyelp.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/llama2/lorasftyelp.yaml
  • test
    • llamafactory-cli train examples/zone/llama2/lorapdyelp.yaml

gemma2

ml

  • incremental pre-training
    • llamafactory-cli train examples/zone/gemma2/loraptml.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/gemma2/lorasftml.yaml
  • test
    • llamafactory-cli train examples/zone/gemma2/lorapdml.yaml ### yelp
  • incremental pre-training
    • llamafactory-cli train examples/zone/gemma2/loraptyelp.yaml
  • fine tuning
    • llamafactory-cli train examples/zone/gemma2/lorasftyelp.yaml
  • test
    • llamafactory-cli train examples/zone/gemma2/lorapdyelp.yaml

llama-factory (here)

Owner

  • Name: sasuke
  • Login: sasukexie
  • Kind: user

I think;

Citation (CITATION.cff) 

cff-version: 1.2.0
date-released: 2024-03
message: "If you use this software, please cite it as below."
authors:
- family-names: "Zheng"
  given-names: "Yaowei"
- family-names: "Zhang"
  given-names: "Richong"
- family-names: "Zhang"
  given-names: "Junhao"
- family-names: "Ye"
  given-names: "Yanhan"
- family-names: "Luo"
  given-names: "Zheyan"
- family-names: "Feng"
  given-names: "Zhangchi"
- family-names: "Ma"
  given-names: "Yongqiang"
title: "LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models"
url: "https://arxiv.org/abs/2403.13372"
preferred-citation:
  type: conference-paper
  conference:
    name: "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)"
  authors:
    - family-names: "Zheng"
      given-names: "Yaowei"
    - family-names: "Zhang"
      given-names: "Richong"
    - family-names: "Zhang"
      given-names: "Junhao"
    - family-names: "Ye"
      given-names: "Yanhan"
    - family-names: "Luo"
      given-names: "Zheyan"
    - family-names: "Feng"
      given-names: "Zhangchi"
    - family-names: "Ma"
      given-names: "Yongqiang"
  title: "LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models"
  url: "https://arxiv.org/abs/2403.13372"
  year: 2024
  publisher: "Association for Computational Linguistics"
  address: "Bangkok, Thailand"

GitHub Events

Total
Last Year

Dependencies

Dockerfile docker
  • nvcr.io/nvidia/pytorch 24.02-py3 build
docker/docker-cuda/Dockerfile docker
  • nvcr.io/nvidia/pytorch 24.02-py3 build
docker/docker-cuda/docker-compose.yml docker
docker/docker-npu/Dockerfile docker
  • cosdt/cann 8.0.rc1-910b-ubuntu22.04 build
docker/docker-npu/docker-compose.yml docker
docker-compose.yml docker
pyproject.toml pypi
requirements.txt pypi
  • accelerate >=0.30.1
  • datasets >=2.16.0
  • einops *
  • fastapi *
  • fire *
  • gradio >=4.0.0
  • matplotlib >=3.7.0
  • numpy <2.0.0
  • packaging *
  • pandas >=2.0.0
  • peft >=0.11.1
  • protobuf *
  • pydantic *
  • pyyaml *
  • scipy *
  • sentencepiece *
  • sse-starlette *
  • tiktoken *
  • transformers >=4.41.2
  • trl >=0.8.6
  • uvicorn *
setup.py pypi