This repository was archived by the owner on Jul 2, 2021. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 302
Add SemanticSegmentationEvaluator #238
Merged
Hakuyume
merged 21 commits into
chainer:master
from
yuyu2172:semantic-segmentation-evaluator
Jul 3, 2017
Merged
Changes from 1 commit
Commits
Show all changes
21 commits
Select commit
Hold shift + click to select a range
2ccc93f
use semantic_segmentation_evaluator inside train
yuyu2172 1b0348a
change semantic_segmentation_evaluator to be consistent with other ev…
yuyu2172 9506e19
follow style of detection_voc_evaluator
yuyu2172 6b5c270
merge
yuyu2172 b68b2e8
fix __init__.py
yuyu2172 3b298b2
cosmetic
yuyu2172 2def1dc
fix train.py
yuyu2172 a5d64eb
Merge remote-tracking branch 'origin/master' into HEAD
yuyu2172 3fd76c1
fix train.py
yuyu2172 65a431b
Merge remote-tracking branch 'origin/master' into semantic-segmentati…
yuyu2172 e5954e9
use new evaluation API
yuyu2172 eb8eebc
Merge branch 'semantic-segmentation-evaluator' of https://github.com/…
yuyu2172 7e7cab5
fix documentations for semantic segmentation evaluator
yuyu2172 002a4b5
change directory structure
yuyu2172 c048884
fix doc
yuyu2172 9fef692
report mean_class_accuracy
yuyu2172 7273241
fix train
yuyu2172 46e4add
Merge remote-tracking branch 'origin/master' into HEAD
yuyu2172 41be470
autofunctions->autofunction
yuyu2172 60d42f7
fix doc
yuyu2172 ac50340
make iou/a and iou/b different
yuyu2172 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
fix doc
- Loading branch information
commit c04888444af2e6023177d7030b8cb759fbc6183f
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -15,29 +15,29 @@ class SemanticSegmentationEvaluator(chainer.training.extensions.Evaluator): | |
This extension iterates over an iterator and evaluates the prediction | ||
results of the model by common evaluation metrics for semantic | ||
segmentation. | ||
This extension reports the following values with keys. | ||
This extension reports values with keys below. | ||
Please note that :obj:`'iou/<label_names[l]>'` and | ||
:obj:`'class_accuracy/<label_names[l]>'` are reported only if | ||
:obj:`label_names` is specified. | ||
|
||
* :obj:`'miou'`: Mean of IoUs (mIoU). | ||
* :obj:`'iou/<label_names[l]>'`: IoU for class \ | ||
:obj:`label_names[l]`, where :math:`l` is the index of the class. \ | ||
For example, this evaluator reports :obj:`'iou/Sky'`, \ | ||
:obj:`'ap/Building'`, etc. if :obj:`label_names` is \ | ||
:obj:`~chainercv.datasets.camvid_label_names`. \ | ||
If there is no label assigned to class :obj:`label_names[l]` \ | ||
in ground truth, it reports :obj:`numpy.nan` as \ | ||
its IoU. \ | ||
In this case, mean IoU is computed without this class. | ||
For example, if :obj:`label_names` is \ | ||
:obj:`~chainercv.datasets.camvid_label_names`, \ | ||
this evaluator reports :obj:`'iou/Sky'`, \ | ||
:obj:`'ap/Building'`, etc. | ||
* :obj:`'mean_class_accuracy'`: Mean of class accuracies. | ||
* :obj:`class_accuracy/<label_names[l]>'`: Class accuracy for class \ | ||
:obj:`label_names[l]`, where :math:`l` is the index of the class. \ | ||
If there is no label assigned to class :obj:`label_names[l]` \ | ||
in ground truth, it reports :obj:`numpy.nam` as \ | ||
its class accuracy. \ | ||
In this case, mean class accuracy is computed without this class. | ||
* :obj:`pixel_accuracy`: Pixel accuracy. | ||
* :obj:`'class_accuracy/<label_names[l]>'`: Class accuracy for class \ | ||
:obj:`label_names[l]`, where :math:`l` is the index of the class. | ||
* :obj:`'pixel_accuracy'`: Pixel accuracy. | ||
|
||
If there is no label assigned to class :obj:`label_names[l]` | ||
in the ground truth, values corresponding to keys | ||
:obj:`'iou/<label_names[l]>'` and :obj:`'class_accuracy/<label_names[l]>'` | ||
are :obj:`numpy.nan`. | ||
In that case, the means of them are calculated by excluding them from | ||
calculation. | ||
|
||
For details on the evaluation metrics, please see the documentation | ||
for :func:`chainercv.evaluations.eval_semantic_segmentation`. | ||
|
@@ -53,8 +53,10 @@ class SemanticSegmentationEvaluator(chainer.training.extensions.Evaluator): | |
have :meth:`predict` method which takes a list of images and | ||
returns :obj:`labels`. | ||
label_names (iterable of strings): An iterable of names of classes. | ||
If this value is specified, IoU for each class is | ||
also reported with the key :obj:`'iou/<label_names[l]>'`. | ||
If this value is specified, IoU and class accuracy for each class | ||
is also reported with the keys | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
:obj:`'iou/<label_names[l]>'` and | ||
:obj:`'class_accuracy/<label_names[l]>'`. | ||
|
||
""" | ||
|
||
|
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
which
->that
? #229 (comment)