Publications

(Last modified 06 January 2008)

Publications

Journal Articles

Hundhausen, C.D., Farley, S.F., & Brown, J.L. (Under review). Can Direct Manipulation Lower the Barriers to Computer Programming and Promote Transfer of Training? An Experimental Study. Submitted to ACM Transactions on Computer-Human Interaction on 26 December 2007.
Presents an expanded version of our VL/HCC 2006 Best Paper Award winner, which experimentally compared a direct manipulation and textual programming interface for novices. This expanded article includes a detailed post hoc video analysis of participants' programming processes, which sheds further light on the experimental results.
Hundhausen, C.D., & Brown, J.L. (2007). An Experimental Study of the Impact of Feedback Self-Selection on Novice programming . Journal of Visual Languages and Computing 18(1), pp. 537-559.
Presents an experimental evaluation of the impact of one dimension of live editing—feedback self selection—on novice programming performance. Results indicate that, as long as feedback is delivered without delay, there exists no difference between receiving feedback automatically, and receiving feedback only on-request.
Hundhausen, C.D., & Brown, J.L. (2008). Designing, Visualizing, and Discussing Algorithms within a CS 1 Studio Experience: An Empirical Study. Computers & Education 50(1), pp. 301-326.
Presents an empirical comparison of art supplies and the ALVIS Live! algorithm visualization software within the context of a "studio experience"—a novel CS 1 pedagogical activity in which student pairs develop solutions to algorithm design problems, create accompanying visual reprsentations, and finally present their visual solutions to the class for feedback and discussion. The centerpiece of the article is a series of post-hoc content analyses of the presentation sessions. These analyses highlight not only the pedagogical benefits of visualization-mediated discussions, but also the pedagogical tradeoffs of art supplies and ALVIS Live! in this context.
Hundhausen, C.D., & Brown, J.L. (2007). What You See Is What You Code: A 'Live' Algorithm Development and Visualization Environment for Novice Learners. Journal of Visual Languages and Computing 18(1), pp. 22-47.
An extended version of our VL-HCC '05 paper, this article presents and evaluates a "live" editing model to support novice programming and visualization.
Hundhausen, C.D. (2005). Using End User Visualization Environments to Mediate Conversations: A ‘Communicative Dimensions’ Framework. Journal of Visual Languages and Computing 16(3), pp. 153-185.
Drawing both on a theory of communication, and on empirical studies in which end user environments were enlisted to support human communication, proposes a provisional framework of six 'Communicative Dimensions' of end user visualization environments. By characterizing those aspects of end user visualization environments that impact social interaction, our framework provides an important extension to Green and Petre's 'Cognitive Dimensions' framework.
Suthers, D., Hundhausen, C.D., & Girardeau, L. (2003). Comparing the roles of representations in face-to-face and online computer supported collaborative learning. Computers & Education 41(4), pp. 335-351

Describes an empirical comparison of face-to-face and distal (in separate rooms, communicating via textual chat) collaborative scientific inquiry. Participants in each condition were asked to use the Belvedere knowledge-mapping software to represent data items, hypotheses, and evidential relations as they worked through a science challenge problem. Dependent measures included post-test performance, and counts ond percentages of verbal and representational acts dedicated to various types of discourse. While no significant differences in learning outcomes were found, significant differences between the two groups' discourse and activity were found.

Hundhausen, C.D. (2002). Integrating Algorithm Visualization Technology into an Undergraduate Algorithms Course: Ethnographic Studies of a Social Constructivist Approach. Computers & Education 39 (3), 237-260.

Presents two ethnographic field studies of a junior-level algorithms course that included exercises in which students constructed and presented their own visualizations of algorithms under study. Note that this is a journal article version of Chapter 4 of my dissertation.

Naps, T., Roessling, G., Almstrum, V., Dann, W., Fleischer, R., Hundhausen, C., Korhonen, A., Malmi, L., Mchally, M., Rodger, S., & Valazquez-Iturbide, J.A. (2003). Exploring the role of visualization and engagement in computer science education (Report of the ITiCSE 2002 Working Group on "Improving the Educational Impact of Algorithm Visualization"). SIGCSE Bulletin 35(2) , 131-152.

Reports three surveys of computer science faculty (n ~= 150 for all studies combined) that focused on their opinions and use of algorithm visualization technology in undergraduate computer science education. Proposes a framework for studying the impact of student engagement with algorithm visualization technology on learning.
Suthers, D., & Hundhausen, C. (2003). An experimental study of the effects of representational guidance on collaborative learning processes. Journal of the Learning Sciences 12(2), 183-219.

Presents an empirical comparision of three representational environments (plain test, graph, and matrix) for recording data and hypotheses within the context of a scientific challenge problem. Performs various qualitative and quantitiative post-hoc analyses of participants' talk (content analysis) and representational artifacts to draw conclusions regarding the differences in the representational environments.
Hundhausen, C.D., Douglas, S.A., & Stasko, J.T. (2002). A Meta-Study of Algorithm Visualization Effectiveness. Journal of Visual Languages and Computing 13(3), 259-290.

A greatly-revised and re-focused version of my original Ph.D. comprehensive exam paper "A Meta-Study of Software Visualization Effectiveness" (see below), this paper performs a systematic meta-analysis of 24 experimental studies of algorithm visualization effectiveness.

Hundhausen, C.D. & Douglas, S.A. (2002). Low Fidelity Algorithm Visualization. Journal of Visual Languages and Computing 13(5), 449-470.

A journal article version of the empirically- and theoretically-driven algorithm visualization system design aspects of my dissertation. This article has been reviewed once, and will be resubmitted with revisions for eventual publication.

Back to Top

Book Chapters

Stasko, J.T. & Hundhausen, C.D. (2004). Algorithm Visualization. In S. Fincher & M. Petre (eds.), Computer Science Education Research (pp. 199-228). Lisse, The Netherlands: Taylor & Francis.
Hundhausen, C.D., & Douglas, S.A. (2002). A language and system for constructing and presenting "low fidelity" algorithm visualizations. In S. Diehl (ed.), Software Visualization State-of-the-Art Survey, LNCS 2269 (pp. 227-240). New York: Springer Verlag.

Back to Top

Conference Papers

Stefik, A., Hundhausen, C., & Patterson, R.. (Under review). The Sonified Omniscient Debugger: A Program Execution and Debugging Environment for Non-Sighted Programmers Built From the Ground Up. Submitted to 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. Piscataway, NJ: IEEE.
Hundhausen, C., Trent, S., Balkar, A., & Nuur, M. (Under review). The Design and Experimental Evaluation of a Tool to Support the Construction and Wizard-of-Oz Testing of Low Fidelity Prototypes. Submitted to 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. Piscataway, NJ: IEEE.
Agrawal, A., & Hundhausen, C. (Under review). The Design of an Asynchronous Web-Based Project Review System to Support Studio-Based Learning in Computing Education. Submitted to 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. Piscataway, NJ: IEEE.
Zollars, R., Hundhausen, C.D., & Brown, J.L. (Under review). Designing a Software Environment for Visual Learning in Introductory Chemical Engineering Classes. Submitted to 2008 American Society for Engineering Education Annual Conference & Exposition. Pittsburgh, PA, June.
Hundhausen, C.D., Narayanan, N.H., & Crosby, M.E. (2008). Exploring studio-based instructional models for computing education. In Proc. 2008 ACM Symposium on Computer Science Education (pp. xxx-xxx). New York: ACM Press.
Hundhausen, C.D., Balkar, A., Nuur, M., & Trent, S. (2007). WOZ Pro: a pen-based low fidelity prototyping environment to support wizard of oz studies. In Extended Abstracts: 2007 ACM Conference on Human Factors in Computing Systems (pp. 2453-2458). New York: ACM Press.
Zollars, R., Hundhausen, C.D., & Stefik, M. (2007). Visual learning in a material/energy balance class. In Proc. 2007 American Society for Engineering Education Annual Conference & Exposition. Honolulu, HI, June.
Hundhausen, C.D., Brown, J.L., Farley, S., & Skarpas, D. (2006). A methodology for analyzing the temporal evolution of novice programs based on semantic components. In Proc. 2006 ACM International Computing Education Research Workshop (pp. 59-71). New York: ACM Press.
Hundhausen, C.D., Brown, J.L., & Farley, S. (2006). Adding procedures and pointers to the ALVIS algorithm visualization software: a preliminary design. In Proceedings 2006 ACM Symposium on Software Visualization (pp. 155-156). New York: ACM Press.
Hundhausen, C.D., Farley, S., & Brown, J.L. (2006). Can direct manipulation lower the barriers to programming and promote positive transfer to textual programming? An experimental study. In Proceedings 2006 IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 157-164). Piscataway, NJ: IEEE. (Recipient of Best Paper Award)
Hundhausen, C.D., & Brown, J.L. (2005). Personalizing and discussing algorithms within CS 1 studio experiences: An observational study. In Proceedings ACM International Computing Education Research Workshop (pp. 45-56). New York: ACM Press.
Hundhausen, C.D. & Brown, J.L. (2005). What You See Is What You Code: A "Radically-Dynamic" Algorithm Visualization Development Model for Novice Learners." Proceedings 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 163-170). Los Alamitos: IEEE Press.
Hundhausen, C., Patterson, R. Brown, J., & Farley, S. , R. (2004). The Effects of Algorithm Visualizations with Storylines on Retention: An Experimental Study. In Proceedings 2004 IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 226 - 228). Piscataway, NJ: IEEE.
Hundhausen, C., Vatrapu, R., & Wingstrom, J. (2004). The Evolving User-Centered Design of the Algorithm Visualization Storyboarder. In Proceedings 2004 IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 62- 64). Piscataway, NJ: IEEE.
Hundhausen, C., Vatrapu, R., & Wingstrom, J. (2003). End-user programming as translation: An experimental framework and study. In Proceedings 2003 IEEE Symposium on Human-Centric Computing (pp. 47-49). Piscataway, NJ: IEEE.
Suthers, D., Hundhausen, C., & Girardeau, L. (2003). An exploratory comparison of the roles of representations in face-to-face and online collaborative learning. In Proceedings of the 36th Hawai`i International Conference on the System Sciences. Los Alamitos, CA: IEEE Press.
Suthers, D., Hundhausen, C., & Girardeau, L. (2003). Comparing the roles of representations in face-to-face and online collaborations. In Proceedings 2003 International Conference on Computers and Education.
Hundhausen, C. (2002). The "Algorithms Studio" Project: Using sketch-based visualization technology to construct and discuss visual representations of algorithms. In Proceedings 2002 IEEE Symposia on Human Centric Computing Langauges and Environments (pp. 99-100). Los Alamitos, CA: IEEE Computer Society Press.
Suthers, D.D., Girardeau, L.E., & Hundhausen, C. (2002). The Roles of Representations in Online Collaborations. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), New Orleans, April 1-5.
Suthers, D. D., & Hundhausen, C. D. (2002). The effects of representation on students' elaborations in collaborative inquiry. In Computer Supported Collaborative Learning: Foundations for a CSCL Community (Proceedings of CSCL 2002) (pp. 472-480). Hillsdale, NJ: Lawrence Erlbaum.
Puntambekar, S., Stylianou, A., Suthers, D., Hundhausen, C., & Hubscher-Younger, T. (2002). External representations for collaborative learning and assessment. In Computer Supported Collaborative Learning: Foundations for a CSCL Community (Proceedings of CSCL 2002) (pp. 714-715). Hillsdale, NJ: Lawrence Erlbaum. Available at
Hundhausen, C.D. & Douglas, S.A. (2001). Communicative Dimensions of End-User Environments. In Proceedings of the 2001 IEEE Symposium on Human-Centric Computing Languages and Environments (pp. 127-134). Los Alamitos, CA: IEEE Computer Society Press.

Presents a provisional framework of communicative dimensions, derived from my ethnographic fieldwork of an undergraduate algorithms course (see article below), that describe aspects of end-user environments that impact human social interaction. Here are the presentation slides.

Suthers, D.A. & Hundhausen, C.D. (2001). Learning by Constructing Collaborative Representations: An Empirical Comparison of Three Alternatives. In Proc. European Conference on Computer-Supported Collaborative Learning, Maastrict, the Netherlands, March, 2001.

Reports on a comparative study of three alternative notations—text, graph, and matrix—for documenting scientific inquiry and reasoning. The study is one outcome of the NSF-funded Representational Bias Project.
Hundhausen, C.D. & Douglas, S.A. (2000). SALSA and ALVIS: A Language and System for Constructing and Presenting Low Fidelity Algorithm Visualizations. In 2000 IEEE Symposium on Visual Languages (pp. 67-68). Los Alamitos, CA: IEEE Computer Society Press.

Draws on ethnographic studies conducted as part of my dissertation research to motivate and define the requirements for a new breed of "low fidelity" algorithm visualization technology to be used as part of an alternative teaching approach in which students construct their own visualizations, and then present those visualizations to their instructor and peers for feedback and discussion. Presents SALSA (Spatial ALgorithmic Language for StoryboArding), a high-level, interpreted language for programming low fidelity visualizations, along with ALVIS (ALgorithm VIsualization Storyboarder), a graphical environment for constructing SALSA scripts by direct-manipulation. SALSA and ALVIS pioneer a novel spatial relations-based method for defining algorithm visualizations, along with a novel visualization presentation interface that supports reverse execution, and dynamic mark-up and modification.

Hundhausen, C.D. & Douglas, S.A. (2000). Using Visualizations to Learn Algorithms: Should Students Construct Their Own, or View an Expert's? In 2000 IEEE Symposium on Visual Languages (pp. 21-28). Los Alamitos, CA: IEEE Computer Society Press.

Motivates and presents an controlled experiment that tested the hypothesis that students who construct their own algorithm visualizations will learn an algorithm better than students who view an algorithm visualization constructed by an expert. This experiment is also presented in chapter 6 of my dissertation.

Hundhausen, C.D. & Douglas, S.A. (2000). Shifting From "High Fidelity" to "Low Fidelity" Algorithm Visualization Technology. In SIGCHI 2000 Extended Abstracts: 2000 ACM Conference on Human Factors in Computing Systems (pp. 179-180). New York: ACM Press.

Develops the distinction between "high fidelity" and "low fidelity" algorithm visualization technology, and introduces the prototype "low fidelity" system that I developed in Chapter 7 of my dissertation.

Hundhausen, C.D. (1998). Toward Effective Algorithm Visualization Artifacts: Designing for Participation and Negotiation in an Undergraduate Algorithms Course. In CHI 98 Summary (pp. 54-55). New York: ACM Press.

An early synopsis of my dissertation research, presented at the ACM SIGCHI '98 Doctoral Consortium in Los Angeles.
Douglas S.A., Hundhausen, C.D. & McKeown, D. (1996) Exploring Human Visualization of Computer Algorithms. Graphics Interface Proceedings, (pp. 9-16). Toronto, Canada: Canadian Human-Computer Communications Society.

Describes and analyzes a series of empirical studies that used conversational analysis and constructive interaction to explore the human conceptualization of computer algorithms.
Douglas, S.A., Hundhausen, C.D., & McKeown, D. (1995). Toward empirically-based software visualization languages. In Proceedings of the 1995 IEEE Symposium on Visual Languages (pp. 342-349). Los Alamitos, CA: IEEE Computer Society Press.

Illustrates the manner in which a research method called visualization storyboarding, together with a semantic-level analytical framework, can be used to derive an empirically-based, semantic-level software visualization (SV) language for the bubblesort algorithm. Demonstrates how the semantic-level language can be used as a framework for evaluating the usability of existing computer-based SV systems.

Naps, T.L, & Hundhausen, C.D. (1991). The evolution of an algorithm visualization system. Proc. 24th Annual Small College Computing Symposium (Morris, MN), 252-257.

Describes the four-year evolution of the GAIGS (Generalized Algorithm Illustration through Graphical Software) algorithm visualization system, which has been used as the basis for the laboratory component of Lawrence University's computer science courses since 1988. PC- and Windows-based versions of the system, complete with extensive documentation and supporting software, are available via anonymous ftp from Lawrence's ftp site in the /anonymous/math directory.

Back to Top

Workshop Papers

Crescenzi, P., Hundhausen, C., Stasko, J., Faltin, N., Naeher, S., Fleischer, R., Roessling, G., & Sutinen, E. (2002). The Algorithm Animation Repository. Paper presented at the Second Program Visualization Workshop, Hornstrup Centret, Denmark, June 27-28.
Hundhausen, C.D. (2002). The Algorithms Studio Project. Paper presented at the Second Program Visualization Workshop, Hornstrup Centret, Denmark, June 27-28.
Hundhausen, C., & Douglas, S. (2000). Low fidelity algorithm visualization. Paper presented at The Visual End User Workshop, 2000 IEEE Symposium on Visual Languages, Seattle, WA, September 10.
Hundhausen, C.D. (1999). Using Representations to Assess Level of Membership in a Community of Practice. Paper accepted for presentation at the CSCL '99 Workshop "Collaborative Use of Representations: Analyzing Learning Interactions."

Develops an empirical method, rooted in Cultural Consensus Theory, that uses the way in which an individual constructs and interprets external representations as a basis for quantitatively assessing that individual's level of membership in a community of practice.
Hundhausen, C.D. (1994). Toward the development of highly interactive software visualization systems: A user-centered approach. Paper presented at the International Workshop on Software Visualization, SIGCHI '94 (Boston, MA).

Outlines the human-process centered approach to interactive software visualization that has formed the foundation of my research, and describes my forays into exploring two of those processes using a research technique called constructive interaction.

Back to Top

Technical Reports and Unpublished Writings

Hundhausen, C.D. (2006). Using HP Mobile Technology to Support a Human-Computer Interaction Design Studio. Grant proposal funded by Hewlett Packard's "Technology for Teaching" grant program (no. U06TFH0033E).
Hundhausen, C.D. (1999). Toward Effective Algorithm Visualization Artifacts: Designing for Participation and Communication in an Undergraduate Algorithms Course. Unpublished Doctoral Dissertation (Tech Rep. No. CIS-TR-99-07). Eugene: Dept. of Computer and Information Science, University of Oregon.

My doctoral dissertation. Follow the above link to my dissertation page.
Hundhausen, C.D. (1997) A Meta-Study of Software Visualization Effectiveness. Unpublished comprehensive exam paper, Department of Computer and Information Science, University of Oregon, Eugene.

Presents a critique of software visualization technology with respect to its effectiveness in the tasks for which it is designed, drawing on published empirical research. I aim to submit a revised version of this paper to the Journal of Visual Languages and Computing.

Douglas, S.A., Hundhausen, C.D., & McKeown, D. (1995). Toward empirically-based software visualization languages. Technical Report CIS-TR-95-12, Department of Computer & Information Science, University of Oregon, Eugene.

An expanded version of the VL '95 conference paper available above

Douglas, S.A., McKeown, D., & Hundhausen, C.D. (1994). Exploring human visualization of computer algorithms. Technical report CIS-TR-94-27, Department of Computer & Information Science, University of Oregon, Eugene, OR.

A preliminary version of the Graphics Interface '96 paper available above.
Hundhausen, C.D., & Malony, A.D. (1993). ObjectView: A software design architecture for breakpoint-based program visualization. Techical report CIS-TR-93-22, Department of Computer & Information Science, University or Oregon, Eugene OR.

Describes a distributed architecture for breakpoint-based program monitoring and visualization.

Hundhausen, C.D. (1993). Exploring the potential for conversational analysis in the evaluation of interactive algorithm visualization systems. (Appendix B comes as a separate document.) Unpublished technical report, Department of Computer & Information Science, University of Oregon, Eugene, OR.

Thoroughly documents a usability study I conducted on Lens, an interactive, single-user software visualization system developed by S. Mukherjea and J. Stasko at the Georgia Institute of Technology.
Hundhausen, C.D. (1993). Subverting the comparative research paradigm: The potential for ethnomethodology in evaluating the effects of algorithm visualization on learning. Unpublished technical report, Department of Computer & Information Science, University of Oregon, Eugene, OR.

Presents a polemic against using factors analysis as a means for assessing the effects of algorithm visualization on learning, drawing extensively from the first ever empirical study to consider the value of algorithm visualization as a learning aid (viz., J. Stasko, A. Badre, & C. Lewis. "Do algorithm animations assist learning? An empirical study and analysis. In Proc. INTERCHI '93 (Amsterdam, The Netherlands), pp. 61-66, 1993).

Hundhausen, C.D. (1993). The search for an empirical and theoretical foundation for algorithm visualization. Unpublished technical report, Department of Computer & Information Science, University of Oregon, Eugene, OR.

Critically assesses the claims that computer scientists have made about algorithm visualization systems by attempting to quantify and qualify their benefits. The analysis draws from around 50 published sources spanning several disciplines, including cognitive psychology, cognitive science, and computer science.

Back to Top