Data

Tools

Indexes

Applications

Experiments

Open Source Science

llm-efficiency-benchmark

https://github.com/kallepronk/llm-efficiency-benchmark

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (5.1%) to scientific vocabulary

Scientific Fields

Artificial Intelligence and Machine Learning Computer Science - 87% confidence
Last synced: 4 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: kallepronk
  • License: mit
  • Language: Jupyter Notebook
  • Default Branch: main
  • Size: 2.26 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created about 1 year ago · Last pushed 7 months ago
Metadata Files
Readme License Citation

README.md

LLM Efficiency Benchmark

Installation

Prerequisites

The project uses python managed by conda for package management and version control. To install conda, use this tutorial or if using macOS use the following command: brew install miniforge

Installing

To install the necessary packages, run the following command. conda env create -f environment.yml

About

This is a student project for the 2024 fall semester of the Master Applied IT from Fontys university of applied sciences.

Project structure

Sketch of the design of the benchmark in three layers.

How to contribute

Owner

  • Name: Kalle Pronk
  • Login: kallepronk
  • Kind: user

Student at Fontys

Citation (CITATION.cff) 

cff-version: 1.0.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Pronk"
  given-names: "Kalle"
  orcid: "https://orcid.org/0000-0000-0000-0000"
title: "LLM Efficiency Benchmark"
version: 1.0.0
date-released: 2025-01-24
url: "https://github.com/kallepronk/LLM-efficiency-benchmark"

GitHub Events

Total
  • Push event: 16
  • Create event: 1
Last Year
  • Push event: 16
  • Create event: 1

Dependencies

environment.yml conda
  • codecarbon
  • datasets 2.16.1
  • huggingface_hub
  • ipykernel
  • ipywidgets
  • matplotlib
  • pip
  • python 3.11.0.*
  • pytorch
  • pytorch-cuda 12.4.*
  • torchaudio
  • torchvision
  • tqdm
  • transformers