Data

Tools

Indexes

Applications

Experiments

Open Source Science

llm_from_scratch

I am using here just to share what I have been struggling to understand

https://github.com/hulkiciray/llm_from_scratch

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (3.0%) to scientific vocabulary

Keywords

fine-tuning-llm gpt gpt-from-scratch instruction-tuning nlp pytorch tutorial
Last synced: 4 months ago · JSON representation ·

Repository

I am using here just to share what I have been struggling to understand

Basic Info
  • Host: GitHub
  • Owner: hulkiciray
  • Language: Jupyter Notebook
  • Default Branch: main
  • Homepage:
  • Size: 4.86 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
fine-tuning-llm gpt gpt-from-scratch instruction-tuning nlp pytorch tutorial
Created about 2 years ago · Last pushed 10 months ago
Metadata Files
Readme Citation

README.md

LLM From Scratch Book Repo

I am using here just to keep my work on the cloud. Most of the information and codes are taken from Sebastian Raschka's LLM from Scratch book.

Here is the outline of the repo:

Bonus

Here is a YouTube Channel that I find useful to learn new methods, terminology, and also some applications. Videos are generally around 5 minutes long which makes it easy to comprehend.

Owner

  • Login: hulkiciray
  • Kind: user

Citation (CITATION.cff) 

cff-version: 1.2.0
title: "Build A Large Language Model (From Scratch), Published by Manning, ISBN 978-1633437166"
abstract: "This book provides a comprehensive, step-by-step guide to implementing a ChatGPT-like large language model from scratch in PyTorch."
date-released: 2024-09-12
authors:
  - family-names: "Raschka"
    given-names: "Sebastian"
license: "Apache-2.0"
url: "https://www.manning.com/books/build-a-large-language-model-from-scratch"
repository-code: "https://github.com/rasbt/LLMs-from-scratch"
keywords:
  - large language models
  - natural language processing
  - artificial intelligence
  - PyTorch
  - machine learning
  - deep learning

GitHub Events

Total
  • Watch event: 1
  • Public event: 1
  • Push event: 54
  • Fork event: 1
Last Year
  • Watch event: 1
  • Public event: 1
  • Push event: 54
  • Fork event: 1