https://github.com/bestsongc/yolov5-distillation-5.0

yolov5 5.0 version distillation || yolov5 5.0版本知识蒸馏，yolov5l >> yolov5s

https://github.com/bestsongc/yolov5-distillation-5.0

Repository

yolov5 5.0 version distillation || yolov5 5.0版本知识蒸馏，yolov5l >> yolov5s

https://github.com/Bestsongc/yolov5-distillation-5.0/blob/main/

# 

[https://github.com/Sharpiless/yolov5-distillation-5.0](https://github.com/Sharpiless/yolov5-distillation-5.0)



# 

[https://pan.baidu.com/s/13gq5QwCrRNdRXWzSYUeJIw ](https://pan.baidu.com/s/13gq5QwCrRNdRXWzSYUeJIw )

4ppv 

# 

```bash
python train.py --weights weights/yolov5s.pt \
        --cfg models/yolov5s.yaml --data data/voc.yaml --epochs 50 \
        --batch-size 8 --device 0 --hyp data/hyp.scratch.yaml \
        --t_weights yolov5l_voc.pt --distill
```

# :

> --weights

> --t_weights

> --distill

> --dist_lossl2kl

> --temperature


[Object detection at 200 Frames Per Second](https://arxiv.org/pdf/1805.06361.pdf)

teacher networkobjectness valuebounding boxclass probabilities

![](https://github.com/Sharpiless/Yolov5-distillation-train-inference/blob/main/data/images/full_loss.png)

![](https://github.com/Sharpiless/Yolov5-distillation-train-inference/blob/main/data/images/all.png)

# 

 data/voc.yaml VOC

 data/scripts/get_voc2007.sh 

yaml

# 



VOC2007VOC2012

GPU2080Ti*1

Batch Size8

Epoches100

BaselineYolov5s

Teacher modelYolov5lmAP 0.5:0.95 = 0.541


VOC20122k

||||P|R|mAP50|
|:----|:----|:----|:----|:----|:----|
||||0.7756|0.7115|0.7609|
|Yolov5l|output based|l2|0.7585|0.7198|0.7644|
|Yolov5l|output based|KL|0.7417|0.7207|0.7536|
|Yolov5m|output based|l2|0.7682|0.7436|0.7976|
|Yolov5m|output based|KL|0.7731|0.7313|0.7931|

![](https://github.com/Sharpiless/yolov5-distillation-5.0/blob/main/images/line.png)

KLL2 logitsSigmoid

## 1. 

![](https://github.com/Sharpiless/yolov5-distillation-5.0/blob/main/images/%E6%AD%A3%E5%B8%B8%E8%AE%AD%E7%BB%83.png)

## 2. L2

![L2](https://github.com/Sharpiless/yolov5-distillation-5.0/blob/main/images/l+l2.png)

# 

![](https://img-blog.csdnimg.cn/20210310070958646.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L3dlaXhpbl80NDkzNjg4OQ==,size_16,color_FFFFFF,t_70)

# 
> B[https://space.bilibili.com/470550823](https://space.bilibili.com/470550823)

> CSDN[https://blog.csdn.net/weixin_44936889](https://blog.csdn.net/weixin_44936889)

> AI Studio[https://aistudio.baidu.com/aistudio/personalcenter/thirdview/67156](https://aistudio.baidu.com/aistudio/personalcenter/thirdview/67156)

> Github[https://github.com/Sharpiless](https://github.com/Sharpiless)

Owner

GitHub Events