tranformers-expalined
tranformers-code-explained--line-by-line
Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (2.3%) to scientific vocabulary
Keywords
deeplearning
llm
nlp
nlu
transformer
Last synced: 4 months ago
·
JSON representation
·
Repository
tranformers-code-explained--line-by-line
Basic Info
Statistics
- Stars: 3
- Watchers: 1
- Forks: 1
- Open Issues: 0
- Releases: 0
Topics
deeplearning
llm
nlp
nlu
transformer
Created over 2 years ago
· Last pushed over 2 years ago
Metadata Files
Readme
Contributing
License
Code of conduct
Citation
README.md
tranformers-code-explained--line-by-line
转载至Hugging Face transformer项目官方，是个人的理解编辑加工加上chatgpt4给出的代码解读版本。尽量做到逐行解释，小白友好。 欢迎大家提交pr，和star、fork，提交自己的源码理解。
注：xxxx表示伪目录，非有效。
- /src
- xx.py
- xx.py
- /src/transformers
- trainingargs.py（dotrain、do_eval）
- trainer_seq2seq.py
- Seq2SeqTrainer(Trainer)
- loadgenerationconfig
- evaluate()
- predict()
- trainer.py
- class Trainer:
- FP16 + model parallelism
- add_callback()
- deepspeed.py
- class HfDeepSpeedConfig(DeepSpeedConfig)
- class HfTrainerDeepSpeedConfig(HfDeepSpeedConfig):
- trainerconfigprocess(self, args)
- trainerconfigfinalize(self, args, model, numtrainingsteps)
- trainerconfigfinalize(self, args, model, numtrainingsteps)
- /src/transformers/tools/
- xx.py
- xx/
- README.md
CSDN彩色博客版：
Owner
- Name: Dr. Artificial曾小健
- Login: ArtificialZeng
- Kind: user
- Location: Beijing
- Website: https://blog.csdn.net/sinat_37574187?type=blog
- Repositories: 171
- Profile: https://github.com/ArtificialZeng
LLM practitioner/engineer, AI/ML/DL Quant
Citation (CITATION.cff)
cff-version: "1.2.0"
date-released: 2020-10
message: "If you use this software, please cite it using these metadata."
title: "Transformers: State-of-the-Art Natural Language Processing"
url: "https://github.com/huggingface/transformers"
authors:
- family-names: Wolf
given-names: Thomas
- family-names: Debut
given-names: Lysandre
- family-names: Sanh
given-names: Victor
- family-names: Chaumond
given-names: Julien
- family-names: Delangue
given-names: Clement
- family-names: Moi
given-names: Anthony
- family-names: Cistac
given-names: Perric
- family-names: Ma
given-names: Clara
- family-names: Jernite
given-names: Yacine
- family-names: Plu
given-names: Julien
- family-names: Xu
given-names: Canwen
- family-names: "Le Scao"
given-names: Teven
- family-names: Gugger
given-names: Sylvain
- family-names: Drame
given-names: Mariama
- family-names: Lhoest
given-names: Quentin
- family-names: Rush
given-names: "Alexander M."
preferred-citation:
type: conference-paper
authors:
- family-names: Wolf
given-names: Thomas
- family-names: Debut
given-names: Lysandre
- family-names: Sanh
given-names: Victor
- family-names: Chaumond
given-names: Julien
- family-names: Delangue
given-names: Clement
- family-names: Moi
given-names: Anthony
- family-names: Cistac
given-names: Perric
- family-names: Ma
given-names: Clara
- family-names: Jernite
given-names: Yacine
- family-names: Plu
given-names: Julien
- family-names: Xu
given-names: Canwen
- family-names: "Le Scao"
given-names: Teven
- family-names: Gugger
given-names: Sylvain
- family-names: Drame
given-names: Mariama
- family-names: Lhoest
given-names: Quentin
- family-names: Rush
given-names: "Alexander M."
booktitle: "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations"
month: 10
start: 38
end: 45
title: "Transformers: State-of-the-Art Natural Language Processing"
year: 2020
publisher: "Association for Computational Linguistics"
url: "https://www.aclweb.org/anthology/2020.emnlp-demos.6"
address: "Online"