https://github.com/alan-turing-institute/practical-mpi

Practical MPI: converting GPT2 to use MPI and Lightning

https://github.com/alan-turing-institute/practical-mpi

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (5.7%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Practical MPI: converting GPT2 to use MPI and Lightning

Basic Info
  • Host: GitHub
  • Owner: alan-turing-institute
  • License: bsd-2-clause
  • Language: Python
  • Default Branch: main
  • Size: 7.24 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 1 year ago · Last pushed over 1 year ago
Metadata Files
Readme License

README.md

Practical MPI - Baskerville-Turing Training

LaTeX build Slides

2025-01-30

MPI Session Part II: Converting GPT2 to use MPI and Lightning

Details

This folder contains material for the MPI session of the Baskerville-Turing Training.

The original repository is at https://github.com/alan-turing-institute/practical-mpi.git

See the main training repository for the full details.

Schedule

Session: 2025-01-30, 14:00 - 15:00

60 minutes session

Slides

The slide source can be found in the slides directory.

Code

The example code for use during the session can be found in the code directory.

Licence

BSD 2-clause; see the LICENSE file.

Owner

  • Name: The Alan Turing Institute
  • Login: alan-turing-institute
  • Kind: organization
  • Email: info@turing.ac.uk

The UK's national institute for data science and artificial intelligence.

GitHub Events

Total
  • Member event: 1
  • Push event: 25
  • Create event: 7
Last Year
  • Member event: 1
  • Push event: 25
  • Create event: 7

Issues and Pull Requests

Last synced: about 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

.github/workflows/pdflatex.yml actions
  • actions/checkout v4 composite
  • ad-m/github-push-action master composite
  • xu-cheng/texlive-action v2 composite
code/requirements.txt pypi
  • datasets *
  • lightning *
  • matplotlib *
  • tiktoken *
  • torch *
  • transformers *