InstanceFlow: Visualizing the Evolution of Classifier Confusion on the Instance Level

Michael Pühringer, Andreas Hinterreiter, Marc Streit

View presentation:2020-10-30T15:20:00ZGMT-0600Change your timezone on the schedule page
2020-10-30T15:20:00Z
Exemplar figure
InstanceFlow visualizes the evolution of a classifier’s predictions throughout the training process on an instance level. The FlowView (A) shows all instances and their corresponding class association as rectangular glyphs. A Sankey diagram shows the fractions of instances moving between classes. Additionally, the traces of single instances can be highlighted. The Tabular View (B) of the instance predictions over time along with custom performance scores (C) allows finding, ranking, and grouping instances.
Fast forward

Direct link to video on YouTube: https://youtu.be/3Kd6poY-Bpo

Keywords

Classification. Performance analysis. Time series visualization.

Abstract

Classification is one of the most important supervised machine learning tasks. During the training of a classification model, the training instances are fed to the model multiple times (during multiple epochs) in order to iteratively increase the classification performance. The increasing complexity of models has led to a growing demand for model interpretability through visualizations. Existing approaches mostly focus on the visual analysis of the final model performance after training and are often limited to aggregate performance measures. In this paper we introduce InstanceFlow, a novel dual-view visualization tool that allows users to analyze the learning behavior of classifiers over time on the instance-level. A Sankey diagram visualizes the flow of instances throughout epochs, with on-demand detailed glyphs and traces for individual instances. A tabular view allows users to locate interesting instances by ranking and filtering. In this way, InstanceFlow bridges the gap between classlevel and instance-level performance evaluation while enabling users to perform a full temporal analysis of the training process.