https://github.com/avik-pal/faststyletransfer.jl

Fast Neural Style Transfer in Julia

Science Score: 33.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
○
.zenodo.json file
○
DOI references
✓
Academic publication links
Links to: arxiv.org
✓
Committers with academic emails
1 of 1 committers (100.0%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (14.0%) to scientific vocabulary

Keywords

coco-dataset deep-learning fast-style-transfer flux julia machine-learning neural-style neural-style-transfer style-transfer

Last synced: 9 months ago · JSON representation

Repository

Fast Neural Style Transfer in Julia

Basic Info

Host: GitHub
Owner: avik-pal
License: other
Language: Julia
Default Branch: master
Size: 17.7 MB

Statistics

Stars: 27
Watchers: 4
Forks: 2
Open Issues: 1
Releases: 1

Topics

coco-dataset deep-learning fast-style-transfer flux julia machine-learning neural-style neural-style-transfer style-transfer

Created about 8 years ago · Last pushed over 7 years ago

Metadata Files

Readme License

FastStyleTransfer

NOTE: This version works for Julia 0.6. An update to support Julia 1.0 and latest Flux, is WIP. Check the julia-1.0 branch for latest updates. It contains working code which needs to be trained. The models for the last release will not work in julia-1.0 branch. But soon new and better pre-trained models will be added.

Implementation of Fast Neural Style Transfer in Julia using Flux.jl

Usage

To install this package simply run

julia Pkg.clone("https://github.com/avik-pal/FastStyleTransfer.jl")

Using it is very simple. You just need to worry about 2 functions.

The first function is train. You need this in case you are training on a new style. If you ever end up training on a new style please send in a PR with the model. Now the arguments you need to pass to the function are: 1. train_data_path: Path to the MS COCO Dataset. 2. batch_size 3. η: Learning rate. Ideally set it to 0.001. 4. style_image_path 5. epochs 6. model_save_path 7. content_weight: The priority you want to assign to the content. A higher value leads to a better retainment of the original features. 8. style_weight: Same as content weight only for the style image. 9. model: Pass TransformerNet or TransformerNet2. You can pass a custom Network as well. 10. images: Total images from the COCO dataset that you want to train you model on.

The other function would be stylize. This will probably will be the only function most people shall use. So lets see its arguments: 1. image_path 2. model_path 3. save_path: Can be left blank. The image will be stored in the same directory as the image with a stylized tag. 4. display_img: If running from the terminal set it to false. Comes handy when you want to see the image without having to open the save_path.

Some speed statistics: The model runs quite fast taking only 5ms to stylize a 640 x 640 image on a P100 GPU.

Results

|| Starry Night | Abstract Art | Pop Style | |:---:|:---:|:---:|:---:| | Dancing Original | Starry Dancing | Abstract Dancing | Pop Dancing | | Original Monalisa | Starry Monalisa | Abstract Monalisa | Pop Monalisa |