https://github.com/chen-yang-liu/psnet
Progressive Scale-aware Network for Remote sensing Image Change Captioning
Science Score: 36.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
✓DOI references
Found 1 DOI reference(s) in README -
✓Academic publication links
Links to: scholar.google, ieee.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (9.0%) to scientific vocabulary
Repository
Progressive Scale-aware Network for Remote sensing Image Change Captioning
Basic Info
- Host: GitHub
- Owner: Chen-Yang-Liu
- Language: Python
- Default Branch: main
- Size: 63.5 MB
Statistics
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 1
- Releases: 0
Metadata Files
README.md
Progressive Scale-aware Network for Remote sensing Image Change Captioning
**[Chenyang Liu](https://chen-yang-liu.github.io/), [Jiajun Yang](https://levir.buaa.edu.cn/members/index.html), [Zipeng Qi](https://levir.buaa.edu.cn/members/index.html), [Zhengxia Zou](https://scholar.google.com.hk/citations?hl=en&user=DzwoyZsAAAAJ), and [Zhenwei Shi*✉](https://scholar.google.com.hk/citations?hl=en&user=kNhFWQIAAAAJ)**Welcome to our repository!
This repository contains the PyTorch implementation of the paper: "Progressive Scale-aware Network for Remote sensing Image Change Captioning".
For more information, please see our published paper in [IEEE] (Accepted by IGARSS 2023)
Data preparation
Firstly, download the image pairs of LEVIRCC dataset from the [Repository].
Then preprocess dataset as follows:
```python
python createinputfiles.py --karpathyjsonpath path/Levir-CC-dataset/LevirCCcaptions.json --imagefolder path/Levir-CC-dataset/images
``
After that, you can find some resulted files in./data/`.
Of course, you can use our provided resulted files directly in [Hugging face].
Train
Make sure you performed the data preparation above. Then, start training as follows:
python
python ./train.py --encoder_image vit_b_32 --data_folder ./data/ --savepath ./checkpoints/5-times/
Evaluate
You can download our pretrained model in [Hugging face]. Put the model in ./checkpoints/5-times/, then run
python
python ./eval.py --encoder_image vit_b_32 --data_folder ./data/ --model_path ./checkpoints/5-times/
We recommend training 5 times to get an average score.
Citation:
@INPROCEEDINGS{10283451,
author={Liu, Chenyang and Yang, Jiajun and Qi, Zipeng and Zou, Zhengxia and Shi, Zhenwei},
booktitle={IGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium},
title={Progressive Scale-Aware Network for Remote Sensing Image Change Captioning},
year={2023},
volume={},
number={},
pages={6668-6671},
doi={10.1109/IGARSS52108.2023.10283451}}
Owner
- Name: Liu Chenyang
- Login: Chen-Yang-Liu
- Kind: user
- Location: Beijing
- Website: https://Chen-Yang-Liu.github.io
- Repositories: 15
- Profile: https://github.com/Chen-Yang-Liu
Liu Chenyang
GitHub Events
Total
- Watch event: 2
Last Year
- Watch event: 2