• Sorted by Date • Classified by Publication Type • Sorted by First Author Last Name • Classified by Author Last Name •
Saleema Amershi, Giuseppe Carenini, Cristina Conati, Alan K. Mackworth, and David Poole. Pedagogy and usability in interactive algorithm visualizations: Designing and evaluating \CIspace . Interacting with Computers , 20(1):64 – 96, 2008.
Interactive algorithm visualizations (AVs) are powerful tools for teaching and learning concepts that are difficult to describe with static media alone. However, while countless \AVs exist, their widespread adoption by the academic community has not occurred due to usability problems and mixed results of pedagogical effectiveness reported in the \AV and education literature. This paper presents our experiences designing and evaluating CIspace, a set of interactive \AVs for demonstrating fundamental Artificial Intelligence algorithms. In particular, we first review related work on \AVs and theories of learning. Then, from this literature, we extract and compile a taxonomy of goals for designing interactive \AVs that address key pedagogical and usability limitations of existing AVs. We advocate that differentiating between goals and design features that implement these goals will help designers of \AVs make more informed choices, especially considering the abundance of often conflicting and inconsistent design recommendations in the \AV literature. We also describe and present the results of a range of evaluations that we have conducted on \CIspace that include semi-formal usability studies, usability surveys from actual students using \CIspace as a course resource, and formal user studies designed to assess the pedagogical effectiveness of \CIspace in terms of both knowledge gain and user preference. Our main results show that (i) studying with our interactive \AVs is at least as effective at increasing student knowledge as studying with carefully designed paper-based materials; (ii) students like using our interactive \AVs more than studying with the paper-based materials; (iii) students use both our interactive \AVs and paper-based materials in practice although they are divided when forced to choose between them; (iv) students find our interactive \AVs generally easy to use and useful. From these results, we conclude that while interactive \AVs may not be universally preferred by students, it is beneficial to offer a variety of learning media to students to accommodate individual learning preferences. We hope that our experiences will be informative for other developers of interactive AVs, and encourage educators to exploit these potentially powerful resources in classrooms and other learning environments.
@article{Amershi200864,
title = "Pedagogy and usability in interactive algorithm visualizations: Designing and evaluating \{CIspace\} ",
journal = "Interacting with Computers ",
volume = "20",
number = "1",
pages = "64 - 96",
year = "2008",
author = "Saleema Amershi and Giuseppe Carenini and Cristina Conati and Alan K. Mackworth and David Poole",
abstract = "Interactive algorithm visualizations (AVs) are powerful tools for teaching and learning concepts that are difficult to describe with static media alone. However, while countless \{AVs\} exist, their widespread adoption by the academic community has not occurred due to usability problems and mixed results of pedagogical effectiveness reported in the \{AV\} and education literature. This paper presents our experiences designing and evaluating CIspace, a set of interactive \{AVs\} for demonstrating fundamental Artificial Intelligence algorithms. In particular, we first review related work on \{AVs\} and theories of learning. Then, from this literature, we extract and compile a taxonomy of goals for designing interactive \{AVs\} that address key pedagogical and usability limitations of existing AVs. We advocate that differentiating between goals and design features that implement these goals will help designers of \{AVs\} make more informed choices, especially considering the abundance of often conflicting and inconsistent design recommendations in the \{AV\} literature. We also describe and present the results of a range of evaluations that we have conducted on \{CIspace\} that include semi-formal usability studies, usability surveys from actual students using \{CIspace\} as a course resource, and formal user studies designed to assess the pedagogical effectiveness of \{CIspace\} in terms of both knowledge gain and user preference. Our main results show that (i) studying with our interactive \{AVs\} is at least as effective at increasing student knowledge as studying with carefully designed paper-based materials; (ii) students like using our interactive \{AVs\} more than studying with the paper-based materials; (iii) students use both our interactive \{AVs\} and paper-based materials in practice although they are divided when forced to choose between them; (iv) students find our interactive \{AVs\} generally easy to use and useful. From these results, we conclude that while interactive \{AVs\} may not be universally preferred by students, it is beneficial to offer a variety of learning media to students to accommodate individual learning preferences. We hope that our experiences will be informative for other developers of interactive AVs, and encourage educators to exploit these potentially powerful resources in classrooms and other learning environments. "
bib2html_pubtype ={Refereed Journal},
bib2html_rescat ={},
}
Generated by bib2html.pl (written by Patrick Riley ) on Wed Apr 23, 2014 19:08:34