Testing hardware, software, and other products is a highly relevant task to ensure quality and reliability. Due to the increasing complexity of such systems or products, testing tasks are not only an inevitable step that can occur at different stages of product life cycles, but they are getting increasingly complex as well. Such tasks include among others: test planning, defining tests and test data, carrying out test plans, as well as collecting and analyzing test results. Monitoring and profiling tasks are added when later phases in the life cycle of systems and products are taken into account. All these different tasks need to scale with an increasing number of test conditions, parameters, test samples, boundary conditions, etc., and with more sophisticated analysis methods including AI-based approaches.
While the visual representation of test results is not uncommon, interactive steering has the potential to advance test processes at different stages in a system’s or product’s life cycle. Interactive visualization can support test practitioners to cope with inherent complexity, e.g., by helping to orchestrate complex test procedures and analyses.
Currently, there is a gap between industry practice in testing and visualization research. This workshop aims to bring together researchers and practitioners from different domains where testing is relevant. We see it as a first step toward building a community of stakeholders from industry and academia interested in visualizing test and monitoring-related problems. To achieve this goal, the workshop will start a discussion on intrinsic problems of different test procedures to improve the understanding of differences and commonalities in different domains. In addition, we would like to collect examples for supporting test tasks visually and to discuss which testing problems can benefit from interactive visualization. By gathering examples and research approaches from this area, we aim to collect best practices that will serve as the basis for setting up a research agenda.
(all times UTC-5, preliminary schedule)
09.00 am Opening
09.05 am Keynote by Matthias Sauer
ADVANTEST Europe GmbH
09.35 am Visual Exploration of Rheological Test Results from Soft Materials
Presenters: Jonas Madsen, Lasse Sode
09.55 am Interactive Analysis of Post-Silicon Validation Data
Presenter: Andrés Lalama
10.15 am Coffee Break
10.45 am Keynote by Danyel Fisher
11.15 am Test Intelligence: How Modern Analyses and Visualizations in Teamscale Support Software Testing
Presenter: Jakob Rott
11.35 am FLoAT: Framework for Workflow Analysis, Visualization and Transformation
Presenter: John Jacobson III
11.55 am Closing
We solicit submissions on test-related solutions and research including, but not limited to, the following topics.
The workshop welcomes submissions on tools, systems, and approaches that are successfully used in practice as well as research approaches, work in progress, and position statements.
The workshop accepts two types of paper submissions: regular submissions which are archived and will be published on IEEE Xplore and workshop internal short notes which are published on the website given the authors’ consent. Authors of accepted papers are required to present their work during the hybrid workshop. We follow the IEEE VIS guidelines for originality, reuse of text, and plagiarism.
Regular submissions may be up to 6 pages long excluding references. Submissions can be made through the Precision Conference System (PCS) and should use the IEEE VGTC conference style template. To submit a paper log into PCS go to ‘Submissions’, select ‘VGTC’ (society), ‘VIS 2022’ (Conference/Journal), and ‘VIS 2022 TestVis (Track).
Regular papers will be selected in a double-blind one-cycle reviewing process. Reviewing will be done by program committee members of the workshop and will include a phase of discussions between program committee members. Decisions about acceptance will be made by the workshop organizers.
Authors with papers that are accepted for publication in IEEE Xplore will have to pay the respective IEEE VIS 2022 content fee.
Short note submissions may be up to 4 pages long including references and we suggest using the IEEE VGTC conference style template. To submit a paper log into PCS, go to ‘Submissions’, select ‘VGTC’ (society), ‘VIS 2022’ (Conference/Journal), and ‘VIS 2022 TestVis Short Notes (Track).
Short note submissions must be either original work (see IEEE VIS guidelines for originality, reuse of text, and plagiarism) or a summary of previously published work from a venue related to the workshop with a clear statement of attribution to the original work. Short note submissions can be single-blind. The short workshop-internal notes will be reviewed by the workshop organizers, who will also make the decisions about acceptance.
30 Jun 2022: 5 Jul 2022: (extended) Submission of regular (archival) papers 2 Aug 2022: Notification for regular papers 21 Aug 2022: Camera-ready versions of regular papers due 9 Sep 2022: Submission of short notes 22 Sep 2022: Notification for short notes
All dates are Anywhere on Earth (AoE)
Carolin Brandt, Delft University of Technology
Alison Fernandez Blanco, University of Chile
Danyel Fisher, Honeycomb
Vahid Garousi, Queen’s University Belfast
Takayuki Itoh, Ochanomizu University
Kuno Kurzhals, University of Stuttgart
Guido Reina, University of Stuttgart
Claudio Silva, New York University
Matthias Tichy, Ulm University
Melanie Tory, Northeastern University
Xiaoru Yuan, Peking University