Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing Images

Xinyang Pu, Feng Xu

The Key Laboratory of Information Science of Electromagnetic Waves, Fudan University, Shanghai, China

Installation

This code was implemented with Python 3.8, PyTorch 1.13.0 and mmrotate. You can install all the requirements via the installation instruction of MMRotate.

MMRotate depends on PyTorch, MMCV and MMDetection. Below are quick steps for installation. Please refer to Install Guide for more detailed instruction.

shell conda create -n open-mmlab python=3.7 pytorch==1.7.0 cudatoolkit=10.1 torchvision -c pytorch -y conda activate open-mmlab pip install openmim mim install mmcv-full mim install mmdet git clone https://github.com/open-mmlab/mmrotate.git cd mmrotate pip install -r requirements/build.txt pip install -v -e .

Train

```bash export PYTHONPATH=./

./tools/disttrain.sh configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn1xdotavaltestclasswisefpnrpnft.py 2

./tools/disttrain.sh configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn1xdiorvaltestclasswisefpnrpnft.py 2

./tools/disttrain.sh configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn3xhrscvaltestclasswisefpn_ft.py 2 ```

Test

DOTAv1.0 dataset online evaluation: ```bash python ./tools/test.py \ configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn1xdotavaltestclasswisefpnrpnft.py \ checkpoints/SOMECHECKPOINT.pth --format-only \ --eval-options submissiondir=workdirs/Task1_results

```

DIOR-R dataset evaluation: ```bash python ./tools/test.py \ configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn1xdiorvaltestclasswisefpnrpnft.py \ checkpoints/SOMECHECKPOINT.pth --eval mAP

```

HRSC2016 dataset evaluation: ```bash python ./tools/test.py \ configs/loraorientedrcnn/lorabackboneroiheadorientedrcnnswintinyfpn3xhrscvaltestclasswisefpnft.py \ checkpoints/SOME_CHECKPOINT.pth --eval mAP

```

Citation

If you find our work useful in your research, please consider citing:

@misc{pu2024lowrank, title={Low-Rank Adaption on Transformer-based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing Images}, author={Xinyang Pu and Feng Xu}, year={2024}, eprint={2406.02385}, archivePrefix={arXiv}, primaryClass={cs.CV} }