Visualization According to Statisticians: An Interview Study on the Role of Visualization for Inferential Statistics

Eric Newburger, Niklas Elmqvist

DOI: 10.1109/TVCG.2023.3326521

Room: 109

2023-10-24T23:00:00ZGMT-0600Change your timezone on the schedule page
2023-10-24T23:00:00Z
Exemplar figure, described by caption below
How do professional statisticians use data visualization? How do they consider visualization within the suite of analytic methods at their disposal? Do they trust visualization methods? We conducted semi-structured interviews with 18 statisticians from government, academia, and private industry, with more than 350 years collective professional experience, to find out.
Fast forward
Full Video
Keywords

Inferential statistics, qualitative interview study, thematic coding, statistical visualization

Abstract

Abstract—Statisticians are not only one of the earliest professional adopters of data visualization, but also some of its most prolific users. Understanding how these professionals utilize visual representations in their analytic process may shed light on best practices for visual sensemaking. We present results from an interview study involving 18 professional statisticians (19.7 years average in the profession) on three aspects: (1) their use of visualization in their daily analytic work; (2) their mental models of inferential statistical processes; and (3) their design recommendations for how to best represent statistical inferences. Interview sessions consisted of discussing inferential statistics, eliciting participant sketches of suitable visual designs, and finally, a design intervention with our proposed visual designs. We analyzed interview transcripts using thematic analysis and open coding, deriving thematic codes on statistical mindset, analytic process, and analytic toolkit. The key findings for each aspect are as follows: (1) statisticians make extensive use of visualization during all phases of their work (and not just when reporting results); (2) their mental models of inferential methods tend to be mostly visually based; and (3) many statisticians abhor dichotomous thinking. The latter suggests that a multi-faceted visual display of inferential statistics that includes a visual indicator of analytically important effect sizes may help to balance the attributed epistemic power of traditional statistical testing with an awareness of the uncertainty of sensemaking.