2019-02-13 21:15:30 +00:00
< table style = "width:100%" >
< tr >
2019-03-18 10:33:31 +00:00
< th > v2.2< img src = "https://user-images.githubusercontent.com/26833433/52743528-e6096300-2fe2-11e9-970c-5fee45769fab.jpg" width = "400" > < / th >
< th > v3.0< img src = "https://user-images.githubusercontent.com/26833433/54523854-227d0580-4979-11e9-9801-26a3be239875.jpg" width = "400" > < / th >
2019-02-13 21:15:30 +00:00
< th > < img src = "https://storage.googleapis.com/ultralytics/logo/logoname1000.png" width = "200" >
< br > < br / >
< p > < a href = "https://itunes.apple.com/app/id1452689527" >
< img href = "https://itunes.apple.com/app/id1452689527" src = "https://user-images.githubusercontent.com/26833433/50044365-9b22ac00-0082-11e9-862f-e77aee7aa7b0.png" width = "180" >
< / a > < / p > < / th >
< / tr >
< / table >
2019-02-13 21:01:58 +00:00
2019-03-18 10:33:31 +00:00
2018-08-26 08:51:39 +00:00
# Introduction
2019-03-08 12:14:55 +00:00
This directory contains python software and an iOS App developed by Ultralytics LLC, and **is freely available for redistribution under the GPL-3.0 license** . For more information please visit https://www.ultralytics.com.
2018-08-26 08:51:39 +00:00
# Description
2019-02-09 14:12:32 +00:00
The https://github.com/ultralytics/yolov3 repo contains inference and training code for YOLOv3 in PyTorch. The code works on Linux, MacOS and Windows. Training is done on the COCO dataset by default: https://cocodataset.org/#home. **Credit to Joseph Redmon for YOLO** (https://pjreddie.com/darknet/yolo/) and to **Erik Lindernoren for the PyTorch implementation** this work is based on (https://github.com/eriklindernoren/PyTorch-YOLOv3).
2018-08-26 08:51:39 +00:00
# Requirements
2018-11-27 17:14:48 +00:00
Python 3.7 or later with the following `pip3 install -U -r requirements.txt` packages:
2018-08-26 08:51:39 +00:00
- `numpy`
2019-01-05 15:23:17 +00:00
- `torch >= 1.0.0`
2018-08-26 08:51:39 +00:00
- `opencv-python`
2019-03-05 15:23:33 +00:00
# Tutorials
* [Transfer Learning ](https://github.com/ultralytics/yolov3/wiki/Example:-Transfer-Learning )
* [Train Single Image ](https://github.com/ultralytics/yolov3/wiki/Example:-Train-Single-Image )
* [Train Single Class ](https://github.com/ultralytics/yolov3/wiki/Example:-Train-Single-Class )
* [Train Custom Data ](https://github.com/ultralytics/yolov3/wiki/Train-Custom-Data )
2018-08-26 09:05:13 +00:00
# Training
2018-08-26 08:51:39 +00:00
2019-03-18 10:45:49 +00:00
**Start Training:** Run `train.py` to begin training after downloading COCO data with `data/get_coco_dataset.sh` .
2018-09-01 16:35:28 +00:00
2019-03-18 10:46:44 +00:00
**Resume Training:** Run `train.py --resume` resumes training from the latest checkpoint `weights/latest.pt` .
2018-09-01 16:35:28 +00:00
2019-02-27 13:40:41 +00:00
Each epoch trains on 120,000 images from the train and validate COCO sets, and tests on 5000 images from the COCO validate set. Default training settings produce loss plots below, with **training speed of 0.6 s/batch on a 1080 Ti (18 epochs/day)** or 0.45 s/batch on a 2080 Ti.
2018-12-28 18:23:35 +00:00
2019-02-27 13:07:04 +00:00
`from utils import utils; utils.plot_results()`
2019-02-27 13:38:57 +00:00
![Alt ](https://user-images.githubusercontent.com/26833433/53494085-3251aa00-3a9d-11e9-8af7-8c08cf40d70b.png "train.py results" )
2018-09-01 11:34:05 +00:00
2018-09-01 11:43:07 +00:00
## Image Augmentation
2018-09-01 11:34:05 +00:00
2018-09-01 16:57:18 +00:00
`datasets.py` applies random OpenCV-powered (https://opencv.org/) augmentation to the input images in accordance with the following specifications. Augmentation is applied **only** during training, not during inference. Bounding boxes are automatically tracked and updated with the images. 416 x 416 examples pictured below.
2018-09-01 11:41:34 +00:00
Augmentation | Description
--- | ---
2018-12-28 18:23:35 +00:00
Translation | +/- 10% (vertical and horizontal)
2018-09-01 12:04:42 +00:00
Rotation | +/- 5 degrees
2018-12-28 18:23:35 +00:00
Shear | +/- 2 degrees (vertical and horizontal)
Scale | +/- 10%
2018-09-01 12:10:06 +00:00
Reflection | 50% probability (horizontal-only)
2018-09-01 12:04:42 +00:00
H**S**V Saturation | +/- 50%
HS**V** Intensity | +/- 50%
2018-09-01 11:34:05 +00:00
2018-12-28 18:52:25 +00:00
< img src = "https://user-images.githubusercontent.com/26833433/50525037-6cbcbc00-0ad9-11e9-8c38-9fd51af530e0.jpg" >
2018-08-26 08:51:39 +00:00
2019-03-20 11:35:39 +00:00
## Speed
https://cloud.google.com/deep-learning-vm/
**Machine type:** n1-highmem-4 (4 vCPUs, 26 GB memory)
**CPU platform:** Intel Skylake
**GPUs:** 1-4 x NVIDIA Tesla P100
**HDD:** 100 GB SSD
GPUs | `batch_size` | speed | COCO epoch
--- |---| --- | ---
(P100) | (images) | (s/batch) | (min/epoch)
2019-03-20 23:03:29 +00:00
1 | 16 | 0.54s | 66min
2 | 32 | 0.99s | 61min
4 | 64 | 1.61s | 49min
2019-03-20 11:35:39 +00:00
2018-08-26 09:05:13 +00:00
# Inference
2019-02-11 13:13:27 +00:00
Run `detect.py` to apply trained weights to an image, such as `zidane.jpg` from the `data/samples` folder:
2018-12-22 12:05:52 +00:00
2018-12-22 12:20:40 +00:00
**YOLOv3:** `detect.py --cfg cfg/yolov3.cfg --weights weights/yolov3.pt`
2019-03-18 10:33:31 +00:00
< img src = "https://user-images.githubusercontent.com/26833433/50524393-b0adc200-0ad5-11e9-9335-4774a1e52374.jpg" width = "700" >
2018-12-22 12:05:52 +00:00
2018-12-22 12:20:40 +00:00
**YOLOv3-tiny:** `detect.py --cfg cfg/yolov3-tiny.cfg --weights weights/yolov3-tiny.pt`
2019-03-18 10:33:31 +00:00
< img src = "https://user-images.githubusercontent.com/26833433/50374155-21427380-05ea-11e9-8d24-f1a4b2bac1ad.jpg" width = "700" >
2018-09-04 12:36:51 +00:00
2019-02-11 13:11:24 +00:00
## Webcam
2019-02-11 13:13:27 +00:00
Run `detect.py` with `webcam=True` to show a live webcam feed.
2019-02-11 13:11:24 +00:00
2018-12-22 11:49:55 +00:00
# Pretrained Weights
2018-12-22 11:58:59 +00:00
2019-03-20 12:08:24 +00:00
- Darknet `*.weights` format: https://pjreddie.com/media/files/yolov3.weights
- PyTorch `*.pt` format: https://drive.google.com/drive/folders/1uxgUBemJVw9wZsdpboYbzUN4bcRhsuAI
2018-09-01 16:48:53 +00:00
2019-03-20 11:26:46 +00:00
# mAP
2019-03-20 12:08:24 +00:00
- Use `test.py --weights weights/yolov3.weights` to test the official YOLOv3 weights.
- Use `test.py --weights weights/latest.pt` to test the latest training results.
- Compare to official darknet results from https://arxiv.org/abs/1804.02767.
2019-03-20 11:26:46 +00:00
2019-03-20 12:08:24 +00:00
< i > < / i > | ultralytics/yolov3 | darknet
--- | ---| ---
YOLOv3-320 | 51.3 | 51.5
YOLOv3-416 | 54.9 | 55.3
YOLOv3-608 | 57.9 | 57.9
2019-03-20 11:26:46 +00:00
``` bash
sudo rm -rf yolov3 & & git clone https://github.com/ultralytics/yolov3
# bash yolov3/data/get_coco_dataset.sh
sudo rm -rf cocoapi & & git clone https://github.com/cocodataset/cocoapi & & cd cocoapi/PythonAPI & & make & & cd ../.. & & cp -r cocoapi/PythonAPI/pycocotools yolov3
2019-03-20 12:08:24 +00:00
cd yolov3
python3 test.py --save-json --conf-thres 0.001 --img-size 416
Namespace(batch_size=32, cfg='cfg/yolov3.cfg', conf_thres=0.001, data_cfg='cfg/coco.data', img_size=416, iou_thres=0.5, nms_thres=0.45, save_json=True, weights='weights/yolov3.weights')
Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.308
Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.549
Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.310
Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.141
Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.334
Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.454
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.267
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.403
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.428
Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.237
Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.464
Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.585
python3 test.py --save-json --conf-thres 0.001 --img-size 608 --batch-size 16
Namespace(batch_size=16, cfg='cfg/yolov3.cfg', conf_thres=0.001, data_cfg='cfg/coco.data', img_size=608, iou_thres=0.5, nms_thres=0.45, save_json=True, weights='weights/yolov3.weights')
Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.328
Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.579
Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.335
Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.190
Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.357
Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.428
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.279
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.429
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.456
Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.299
Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.483
Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.572
2019-03-20 11:26:46 +00:00
```
2018-08-26 08:51:39 +00:00
# Contact
2018-12-28 18:17:33 +00:00
For questions or comments please contact Glenn Jocher at glenn.jocher@ultralytics.com or visit us at https://contact.ultralytics.com.