TestVis 2022

First International Workshop on

Visualization in Testing of Hardware, Software, and Manufacturing

Held in Conjunction with IEEE VIS 2022

Organized by the TestVis team

Testing hardware, software, and other products is a highly relevant task to ensure quality and reliability. Due to the increasing complexity of such systems or products, testing tasks are not only an inevitable step that can occur at different stages of product life cycles, but they are getting increasingly complex as well. Such tasks include among others: test planning, defining tests and test data, carrying out test plans, as well as collecting and analyzing test results. Monitoring and profiling tasks are added when later phases in the life cycle of systems and products are taken into account. All these different tasks need to scale with an increasing number of test conditions, parameters, test samples, boundary conditions, etc., and with more sophisticated analysis methods including AI-based approaches.

While the visual representation of test results is not uncommon, interactive steering has the potential to advance test processes at different stages in a system’s or product’s life cycle. Interactive visualization can support test practitioners to cope with inherent complexity, e.g., by helping to orchestrate complex test procedures and analyses.

Currently, there is a gap between industry practice in testing and visualization research. This workshop aims to bring together researchers and practitioners from different domains where testing is relevant. We see it as a first step toward building a community of stakeholders from industry and academia interested in visualizing test and monitoring-related problems. To achieve this goal, the workshop will start a discussion on intrinsic problems of different test procedures to improve the understanding of differences and commonalities in different domains. In addition, we would like to collect examples for supporting test tasks visually and to discuss which testing problems can benefit from interactive visualization. By gathering examples and research approaches from this area, we aim to collect best practices that will serve as the basis for setting up a research agenda.

Program

The TestVis Workshop takes place on Monday, October 17

(all times UTC-5, preliminary schedule)

09.00 am    Opening
09.05 am    Keynote by Matthias Sauer
                     ADVANTEST Europe GmbH
09.35 am    Visual Exploration of Rheological Test Results from Soft Materials
                     Presenters: Jonas Madsen, Lasse Sode
09.55 am    Interactive Analysis of Post-Silicon Validation Data
                     Presenter: Andrés Lalama

10.15 am    Coffee Break

10.45 am    Keynote by Danyel Fisher
                     honeycomb.io
11.15 am    Test Intelligence: How Modern Analyses and Visualizations in Teamscale Support Software Testing
                     Presenter: Jakob Rott
11.35 am    FLoAT: Framework for Workflow Analysis, Visualization and Transformation
                     Presenter: John Jacobson III
11.55 am    Closing

Call for Papers

We solicit submissions on test-related solutions and research including, but not limited to, the following topics.

  • Visualization for software testing
  • Visualization for hardware and integrated circuit testing
  • Visualization for testing in manufacturing
  • Visual monitoring and profiling of running systems for testing
  • Testing for visualization
  • Interactive creation of test data, constraints, and parameter settings
  • Interactive planning of test procedures
  • Visual representation of test conditions
  • Interactive visualization and steering of testing processes
  • Visualization for DevOps
  • Visual performance analysis
  • Progressive reporting of test processes
  • Monitoring of test telemetry
  • Visually supported interpretation of test results
  • Visualization of test results over time
  • Visual analysis of testing rigs and their configurations

The workshop welcomes submissions on tools, systems, and approaches that are successfully used in practice as well as research approaches, work in progress, and position statements.

Submission Guidelines

The workshop accepts two types of paper submissions: regular submissions which are archived and will be published on IEEE Xplore and workshop internal short notes which are published on the website given the authors’ consent. Authors of accepted papers are required to present their work during the hybrid workshop. We follow the IEEE VIS guidelines for originality, reuse of text, and plagiarism.

Regular submissions

Regular submissions may be up to 6 pages long excluding references. Submissions can be made through the Precision Conference System (PCS) and should use the IEEE VGTC conference style template. To submit a paper log into PCS go to ‘Submissions’, select ‘VGTC’ (society), ‘VIS 2022’ (Conference/Journal), and ‘VIS 2022 TestVis (Track).

Regular papers will be selected in a double-blind one-cycle reviewing process. Reviewing will be done by program committee members of the workshop and will include a phase of discussions between program committee members. Decisions about acceptance will be made by the workshop organizers.

Authors with papers that are accepted for publication in IEEE Xplore will have to pay the respective IEEE VIS 2022 content fee.

Short notes

Short note submissions may be up to 4 pages long including references and we suggest using the IEEE VGTC conference style template. To submit a paper log into PCS, go to ‘Submissions’, select ‘VGTC’ (society), ‘VIS 2022’ (Conference/Journal), and ‘VIS 2022 TestVis Short Notes (Track).

Short note submissions must be either original work (see IEEE VIS guidelines for originality, reuse of text, and plagiarism) or a summary of previously published work from a venue related to the workshop with a clear statement of attribution to the original work. Short note submissions can be single-blind. The short workshop-internal notes will be reviewed by the workshop organizers, who will also make the decisions about acceptance.

Important Dates

30 Jun 2022: 5 Jul 2022: (extended) Submission of regular (archival) papers

2 Aug 2022: Notification for regular papers

21 Aug 2022: Camera-ready versions of regular papers due

9 Sep 2022: Submission of short notes

22 Sep 2022: Notification for short notes

All dates are Anywhere on Earth (AoE)

Program Committee

Carolin Brandt, Delft University of Technology
Alison Fernandez Blanco, University of Chile
Danyel Fisher, Honeycomb
Vahid Garousi, Queen’s University Belfast
Takayuki Itoh, Ochanomizu University
Kuno Kurzhals, University of Stuttgart
Guido Reina, University of Stuttgart
Claudio Silva, New York University
Matthias Tichy, Ulm University
Melanie Tory, Northeastern University
Xiaoru Yuan, Peking University

Organizers

Avatar

Katherine E. Isaacs

University of Arizona

Avatar

Steffen Koch

University of Stuttgart

Avatar

Timo Ropinski

Ulm University

Avatar

Stefan Wagner

University of Stuttgart

Avatar

Daniel Weiskopf

University of Stuttgart