https://github.com/deeprine/transformer
transformer(Attention Is All You Need) pytorch implemented
Science Score: 10.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
○codemeta.json file
-
○.zenodo.json file
-
○DOI references
-
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (7.8%) to scientific vocabulary
Last synced: 4 months ago
·
JSON representation
Repository
transformer(Attention Is All You Need) pytorch implemented
Basic Info
- Host: GitHub
- Owner: deeprine
- Language: Python
- Default Branch: master
- Size: 26.4 KB
Statistics
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
- Releases: 0
Created almost 2 years ago
· Last pushed almost 2 years ago
https://github.com/deeprine/transformer/blob/master/
# Transformer PyTorch Implementation
## Introduction
This repository contains a PyTorch implementation of the Transformer model, a state-of-the-art architecture in natural language processing and machine translation. The Transformer model has gained significant popularity due to its parallelization capabilities and superior performance.
## Datasets
- Download the URL below
- https://www.kaggle.com/datasets/mohamedlotfy50/wmt-2014-english-german
## Usage
1. **Setup Environment**: Make sure you have Python installed. You can install the required dependencies using pip:
```
pip install -r requirements.txt
```
2. **Prepare Data**: Preprocess and organize the data required for training and evaluation tasks.
3. **Train the Model**: Use the provided training scripts to train the Transformer model on your dataset:
```
python train.py
```
4. **Evaluate Model**: Evaluate the trained model's performance using the evaluation scripts:
```
None
```
## Requirements
- Python 3.8
- PyTorch
- Additional dependencies specified in requirements.txt
## References
- [Attention Is All You Need (Transformer Paper)](https://arxiv.org/abs/1706.03762)
Owner
- Name: YongSeong
- Login: deeprine
- Kind: user
- Location: YongIn, Republic of Korea
- Company: @KangnamUniversity
- Website: leeyongseong.oopy.io
- Repositories: 23
- Profile: https://github.com/deeprine
AI engineer