Alex Kirlik

Alex Kirlik
Alex Kirlik
  • Professor Emeritus
(217) 778-8166
4220 Siebel Center for Comp Sci

Education

  • Ph.D. Industrial & Systems Engineering, The Ohio State University, 1989.

Biography

Alex Kirlik is Professor in the Department of Computer Science with additional appointments in the Department of Industrial & Enterprise Systems Engineering, the Department of Electrical and Computer Engineering, the Beckman Institute for Advanced Science and Technology, and the Information Trust Institute, the Coordinated Science Laboratory, the Intelligent Robotics Laboratory and the Illinois Informatics Institute. He previously served as acting head of Illinois's Human Factors program in the Institute of Aviation from 2006-2010. Alex earned his B.S., M.S. and Ph.D. degrees in Industrial & Systems Engineering (Human-Machine Systems) at The Ohio State University. His Ph.D. thesis, "The organization of perception and action in complex control skills" earned the George Briggs Award from APA's Division of Applied Experimental and Engineering Psychologists, as the best dissertation of the year. During his academic career, in addition to positions held with his home institutions at the University of Illinois (2002-date) and Georgia Tech (1989-2001), Alex has held visiting positions at Stanford University and NASA Ames Research Center (ASEE-NASA Stanford Summer Faculty Fellow, 1989, 1990), Yale University, Haskins Laboratory and the University of Connecticut (Visiting Scholar, 2001-02 academic year), Draper Laboratory, Cambridge, MA (Sabbatical Research, 2012-13 academic year), and the Liberty Mutual Research Institute for Safety (Visiting Scholar, summer 2015).

Alex's research interests include human-computer interaction, human factors, visual analytics to support judgment and decision making, human-robot interaction, social computing, human-automation interaction and decision support is sociotechnical systems such as aviation, space, intelligence analysis, severe weather forecasting, disaster and emergency response, healthcare and medicine, autonomous vehicles, education and so forth.

Teaching Statement

Alex's approach to teaching and mentoring students is naturally dependent of the level of instruction involved. Perhaps one notable aspect of his educational approach is that no crisp line can be drawn between his interests and activities in research and teaching. For example, he has advised 3 PhD dissertations on the development and evaluation of new techniques and technologies for teaching engineering design.

His research and educational activities also dovetail in the realm of his graduate seminars, which are intensively group- and project-based, typically involving students in actual research projects to motivate and animate the course material. For example, in 2010 Alex seized on an opportunity afforded by a U.S. “Challenge.gov” Health and Human Services competition that required competing project teams to design a Facebook app that would be useful to people in the aftermath of natural disasters and emergencies. This project not only involved the students, working as a design team, to create a conceptual design for the app, but to also create a working software prototype and a video demo. The competition was open to any group who wanted to enter – it was not specifically targeted to the educational community or to educational institutions. The students’ design earned 3rd place nationally: www.hhs.gov/news/press/2012pres/02/20120223b.html

Research Statement

Alex Kirlik’s research program in human-computer interaction, human factors, and cognitive science & engineering has focused on understanding and supporting the cognition (judgment, decision making, prediction, problem solving and system control), of professionals working in technological workplaces, operational contexts and sociotechnical systems. His research contributing to commercial aviation safety in both airborne and ground operations has been supported by NASA for over 25 years.

Recently, aspects of these lines of research have matured into NSF- and NASA-sponsored multidisciplinary projects, joint with collaborators in aerospace, mechanical and software engineering, to create and evaluate formal techniques and general principles for the design of safe and robust cyber-physical-human systems comprised of people and hardware and software automation: Engineering Safety-Critical Cyber-Physical-Human (CPH) Systems. The aim of this research, which is relevant to applications not solely in aviation but in contexts such as healthcare and highways, is to achieve levels of human-automation system performance, robustness and safety exceeding what would be achievable by either a human or automation acting alone. A 5-minute public video demo illustrating this work in an aviation context is available at: www.youtube.com/watch.

A second major thrust of Alex's research concerns support for judgment and decision making in high-stakes tasks. This line of research developed into an NSF-sponsored project to develop and evaluate quantitative models of judgment in technological systems (e.g., KIrlik, 2006, Adaptive Perspectives on Human-Technology Interaction, NY: Oxford; see: www.oup.com/us/companion.websites/9780195171822/).

Recently, he and his multi-disciplinary team began a 3-year research project involving the design and use of domestic, aerial and ground robotics to support aging-in-place called ASPIRE: Automation Supporting Prolonged Independent Residence for the Elderly, sponsored by the National Robotics Initiative.  A brief video showing progress to date, presented at the October, 2016 "Aging 2.0" conference in San Francisco can be viewed here.

Also, Alex has co-edited (with J.D. Lee) the first authoritative handbook of its kind, The Oxford Handbook of Cognitive Engineering, representing the contributions of more than 60 of the discipline’s most influential and accomplished researchers. He has been editor of the Oxford Series in Human-Technology Interaction for Oxford University Press for more than 10 years, a series that includes more than a dozen scholarly books and edited volumes by prominent researchers published to date.

Undergraduate Research Opportunities

Alex often has paid or for-credit undergraduate research opportunities in both human-computer interaction and human factors.

Books Edited or Co-Edited (Original Editions)

  • Lee, J.D. & Kirlik, A. (Eds.) The Oxford Handbook of Cognitive Engineering. New York: Oxford University Press, 2013.
  • Vicente, K (Au), Kirlik, A. (Ed.). Human-Tech: Ethical and Scientific Foundations. New York, Oxford University Press, 2011.
  • Kramer, A., Weigman, D. & Kirlik, A. (Eds.). Attention: From Theory to Practice. New York, Oxford University Press, 2007.
  • Kirlik, A. (Ed). Adaptive Perspectives on Human-Technology Interaction: Methods and Models for Cognitive Engineering and Human-Computer Interaction. New York, Oxford University Press, 2006.

Chapters in Books

  • Kirlik, A. & Byrne, M.D. (2019). Computational models of expertise. (P. Ward et al., Eds.) The Oxford Handbook of Expertise. NY: Oxford University Press.
  • Kirlik, A., Ackerman, K., Seefeldt, B., Xargay, E., Riddle, K., Talleur, D., Carbonari, R., Sha, L. & Hovakimyan N. (2017). Visualizing automation in aviation interfaces. In (J. Flach, P. Tsang, and M. Vidulich, Eds.), Advances in Aviation Psychology, Vol. 2. Routledge.
  • Lee, J.D. & A. Kirlik (2013). Introduction to the handbook. In J.D. Lee & A. Kirlik, The Oxford Handbook of Cognitive Engineering. NY: Oxford University Press.
  • Kirlik, A. (2013). Judgment analysis. In J.D. Lee & A. Kirlik, The Oxford Handbook of Cognitive Engineering. NY: Oxford University Press.
  • Kirlik, A. (2012). An overview of human factors. In S.W.J Kozlowski (Ed.), The Oxford Handbook of Organizational Psychology. New York: Oxford University Press.
  • Kirlik, A. & Bertel, S. (2011). Decision making under pressure and constraints: Bounded rationality. Wiley Encyclopedia of Operations Research and Management Science. NY: Wiley.
  • Bertel, S. & Kirlik (2011). Fast and frugal heuristics. Wiley Encyclopedia of Operations Research and Management Science: NY: Wiley.
  • Kirlik, A. (2011). Introduction. In K. Vicente & A. Kirlik, Human-Tech, (pp. 3-8). NY: Oxford University Press.
  • Kirlik, A. (2011). The origins of human-tech. In K. Vicente & A. Kirlik, Human-Tech, (pp. 9-20). NY: Oxford University Press.
  • Kirlik, A. (2011). A human-tech research agenda and approach. In K. Vicente & A. Kirlik, Human-Tech, (pp. 21-30). NY: Oxford University Press.
  • Kirlik, A. (2011). Inventing possibilities: Understanding work systems and tasks. In K. Vicente & A. Kirlik, Human-Tech, (pp. 53-59). NY: Oxford University Press.
  • Kirlik, A. (2011). Psychological distance: Manipulating an interface versus controlling a system. In K. Vicente & A. Kirlik, Human-Tech, (pp. 77-83). NY: Oxford University Press.
  • Kirlik, A. (2011). Statistics for human-tech research. In K. Vicente & A. Kirlik, Human-Tech, (pp. 107-111). NY: Oxford University Press.
  • Kirlik, A. (2011). Constructing the subject: Cognitive modeling. In K. Vicente & A. Kirlik, Human-Tech, (pp. 145-156). NY: Oxford University Press.
  • Kirlik, A. (2011). Sociotechnical systems, risk, and error. In K. Vicente & A. Kirlik, Human-Tech, (pp. 191-195). NY: Oxford University Press.
  • Kirlik, A. (2011). Nested systems: Economic, cultural and political dimensions. In K. Vicente & A. Kirlik, Human-Tech, (pp. 221-225). NY: Oxford University Press.
  • Kirlik, A. and Storkerson, P. (2010). Naturalizing Peirce’s semiotics: Ecological psychology’s solution to the problem of creative abduction. In L. Magnani (Ed.), Model-Based Reasoning in Science and Technology: Studies in Computational Intelligence, 314, pp. 31-50. Berlin: Springer-Verlag.
  • Kirlik, A. (2007). Ecological resources for modeling interactive behavior and embedded cognition. In W. Gray (Ed.), Integrated Models of Cognitive Systems (pp. 194-210). New York: Oxford University Press.
  • Byrne, M., Kirlik, A. & M. D. Fleetwood (2007) Closing the loop on computational models of interactive human performance models in aviation. In D. Foyle & B. Hooey (Eds.), Human Performance Models in Aviation (pp. 77-104). Boca Raton: CRC Press.
  • Foyle, D.C., Hooey, B.L., Byrne, M.D., Kirlik, A., Lebiere, C., Archer, R., Corker, K., Deutsch, S., Pew, R. W., Wickens, C.D. & McCarley, J. (2007). Human performance modeling: A virtual roundtable discussion. . In D. Foyle & B. Hooey (Eds.), Human Performance Models in Aviation (pp. 285-320). Boca Raton: CRC Press.
  • Sternberg, R. J., Birney, D., Jarvin, L., Kirlik, A., Stemler, S. & E. Grigorenko (2006). From Molehill to mountain: The process of scaling up educational interventions. In R. J. Sternberg & M. Constas (Eds.), Translating Educational Theory and Research into Practice (pp. 205-222). Mahwah, NJ: Erlbaum.
  • Kirlik, A. (2006). Cognitive engineering: Toward a workable concept of mind. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 3-9_NY: Oxford University Press.
  • Kirlik, A. (2006). Abstracting situated action: Implications for cognitive modeling and interface design. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 212-226). New York: Oxford University Press.
  • Degani, A., Shafto & A. Kirlik (2006). What makes vicarious functioning work? Exploring the geometry of human-automation interaction. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 179-196). NY: Oxford University Press.
  • Bisantz, A., Kirlik, A., Gay, P., Walker, N. & Fisk, A.D. (2006). Knowledge versus execution in dynamic judgment tasks. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 29-42). NY: Oxford University Press.
  • Byrne, M. & A. Kirlik (2006). Kilograms matter: Computational cognitive modeling of closed loop dynamic decision making in system control. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 267-286) NY: Oxford University Press
  • Horrey, W. J., Wickens, C. D., & Stewart, T. & A. Kirlik (2006). Supporting situation assessment through attention guidance and diagnostic aiding: Benefits, costs, and the impact of automation on judgment skill. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 55-70). NY: Oxford U. Press.
  • Rothrock, L. & A. Kirlik (2006). A technique for inferring fast and frugal heuristics from behavioral data in dynamic, interactive judgment tasks. In A. Kirlik (Ed.), Adaptive Perspectives on Human-Technology Interaction (pp. 131-148). NY: Oxford University Press.
  • Kirlik, A. (2005). Work in progress: Reinventing intelligence for an invented world. In R. J. Sternberg and D. Preiss (Eds.), Intelligence and Technology: Impact of Tools on the Nature and Development of Human. Skills (pp. 105-134). Mahwah, NJ: Erlbaum.
  • Kirlik, A. and Strauss, R., (2001). Medical information uncertainty and the older patient: Implications for human factors and cognitive aging research. In W. Rogers and A.D. Fisk, (Eds.) Human Factors Interventions for the Health Care of Older Adults. Mahwah: NJ: Lawrence Erlbaum Associates.
  • Kirlik, A. (2001). On Gibson's review of Brunswik. In K. R. Hammond and T. Stewart, (Eds.), The Essential Brunswik: Beginnings, Explications, and Applications. NY: Oxford University Press.
  • Kirlik, A. (2001). Human factors. In K. R. Hammond and T. Stewart, (Eds.) The Essential Brunswik: Beginnings, Explications, and Applications, 238-242. NY: Oxford University Press, 2001.
  • Kirlik, A., (1998). Everyday life environments. In W. Bechtel and G. Graham, (Eds.). A Companion to Cognitive Science, Oxford: Blackwell, 1998.
  • Kirlik, A., Fisk, A.D., Walker, N. and Rothrock, L. (1998). Feedback augmentation and part-task practice in training dynamic decision making skills. In J. Cannon-Bowers and E. Salas, (Eds.), Decision Making Under Stress: Implications for Individual and Team Training Washington, DC: American Psychological Association Press.
  • Kirlik, A., and Bisantz, A., (1998). Cognition in human-machine systems: Experiential and environmental aspects of adaptation. In P. Hancock, (Ed.), Handbook of Perception and Cognition: Human Performance and Ergonomics. San Diego, CA: Academic Press.
  • Fisk, A.D., and Kirlik, A. (1996). Practical relevance and cognitive aging research: Can theory develop without application? In W. Rogers, A.D. Fisk, and N. Walker (Eds.), Aging and Skilled Performance: Advances in Theory and Application. Hillsdale, NJ: Erlbaum.
  • Kirlik, A., (1995) Requirements for psychological models to support design: Toward ecological task analysis. In J. Flach, P. Hancock, J. Caird, and K. J. Vicente, (Eds.), Global Perspectives on the Ecology of Human-Machine Systems, Hillsdale, NJ: Erlbaum.

Selected Articles in Journals

  • Kirlik, A. (2018). Automation and adaptive behavior. Journal of Cognitive Engineering and Decision Making, Volume 12, Number 1, March 2018, pp. 70–73. DOI: 10.1177/1555343417724963
  • Nam, M-Y., Choi, J. , Kirlik, Sha, L. & R. Berlin (2017). Supporting emergency medical care teams with an integrated status display providing real-time access to medical best practices, workflow tracking, and patient data. Journal of Medical Systems, December 2017, 41:186.
  • Lin, J-H, Kirlik, A, & Xu, X. (2017). New technologies in human factors and ergonomics research and practice. Applied Ergonomics, 66, 179-181. Introduction to an edited (Lin, Kirlik, Xu) special journal issue with 19 peer-reviewed technical articles. Special Issue editors: Lin, Kirlik & Xu.
  • Ackerman, K., Talleur, D., Carbonari, R., Xargay, X., Seefeldt, B,, Kirlik, A., Hovakimyan, N, and Trujillo, A, (2017). Aviation situation awareness display for a flight envelope protection system. Journal of Guidance, Control and Dynamics (E-Version printed: DOI: 10.2514/1.G000338).
  • Marinho, T, Widdowson, C,, Oetting, A, Lakshmananm, A., Cui, H., Hovakimyan, N., Wang, F., Kirlik, A., Laviers, A., and Stipanovic (2016). Carebots: Prolonged elderly independence using small mobile robots. Mechanical Engineering, September, 2016.
  • Hettinger, L. J., Kirlik, A., Goh, Y. M. & Buckle, P. (2015). Modelling and simulation of complex sociotechnical systems: Envisioning and analysing work environments. Ergonomics, 58, (4), 600-614.
  • Miller, S., Bailey, B. & A. Kirlik (2014). Exploring the utility of Bayesian truth serum for assessing design knowledge. Human-Computer Interaction, 29(5-6), 487-515. 
  • Fraccone, G.C., Valenzuela-Vega, R., Siddique, S., Volovoi, V. & A. Kirlik (2013). Nested modeling of hazards associated with off-nominal scenarios in the national airspace system. Journal of Aircraft, 50(2), March-April.
  • Kirlik, A. (2012). Relevance versus generalization in cognitive engineering. (Invited) Cognition, Technology and Work, 14(3), 213-220.
  • Kirlik, A. (2010). Editorial: Brunswikian theory and method as a foundation for simulation-based research on clinical judgment. (Invited). Simulation in Healthcare, 5(5). 255-259.
  • Kirlik, A. (2009). Brunswikian resources for event perception research. Perception, Vol. 38, 376-398.
  • Weiss, D.J., Brennan, K., Thomas, R., Kirlik, A., and Miller, S.M. (2009). Criteria for performance evaluation. Judgment and Decision Making, 4(2), 164-174).
  • Araujo, D. & Kirlik, A. (2008). Toward an ecological approach to visual anticipation in sport. International Journal of Sport Psychology, Vol. 39(2), 122-140.
  • Kirlik, A. & Strauss, R. (2006). Situation awareness as judgment I: Theoretical framework, modeling, and quantitative measurement. International Journal of Industrial Ergonomics. Special Issue on New Insights in Human Performance and Decision Making, 36, 463-474.
  • Strauss, R. & Kirlik, A. (2006). Situation awareness as judgment II: Experimental evaluation and demonstration. International Journal of Industrial Ergonomics: Special Issue on New Insights in Human Performance and Decision Making. 36, 475-484.
  • Byrne, M. & Kirlik, A. (2005). Using computational cognitive modeling to diagnose possible sources of aviation error. International Journal of Aviation Psychology, 15(2), 135-155.
  • Kirlik, A. (2004). Stoffregen's analysis of affordances. Ecological Psychology, 16(1), 73-77.
  • Kirlik, A. & Maruyama, S. (2004). Human-technology interaction and music perception and performance: Toward the robust design of sociotechnical systems. Proceedings of the IEEE, Vol. 92, No. 4, 616-632.
  • Kirlik, A. (2003). Human factors distributes its workload. Review of E. Salas (Ed.), "Advances in Human Performance and Cognitive Engineering Research." Contemporary Psychology, Vol. 48, No. 6.
  • Rothrock, L. & A. Kirlik (2003). Inferring rule-based strategies in dynamic judgment tasks. IEEE Transactions on Systems, Man, and Cybernetics: Part A: Systems and Humans, 33(1) 58-72.
  • Kirlik, A. (2003). Charting a midcourse between neuroscience and cognitive science. Review of J.E.R. Staddon's, "Adaptive Dynamics: The Theoretical Analysis of Behavior." Contemporary Psychology, 48(3), 382-384.
  • Cianciolo, A. & Kirlik, A. (2003). A multi-level, differential perspective on human performance. Review of "Human Performance: Cognition, Stress, and Individual Differences" by G. Matthews, R.D. Davies, S.J. Westerman, & R. B. Stammers. Contemporary Psychology, 48(2), 221-223.
  • Kirlik, A. (2001). Life without Bayes: Judgment and decision making in Sweden (review of Juslin and Montgomery: Judgment and Decision Making: Neo-Brunswikian and Process Tracing Approaches). Applied Cognitive Psychology.
  • Bisantz, A., and Kirlik, A., (2000). Adaptivity and rule verification: An empirical investigation. International Journal of Cognitive Ergonomics, 4(1), 1-18.
  • Bisantz, A., Kirlik, A., Gay, P., Phipps, D., Walker, N., and Fisk, A.D., (2000). Modeling and analysis of a dynamic judgment task using a lens model approach. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 30, 6, 605-616.
  • Degani, A., Shafto, M. and Kirlik, A. (1999). Modes in human-machine systems: Review, classification, and application. International Journal of Aviation Psychology, Vol. 9, No. 2.
  • Kirlik, A., Rediscovering Turing's brain. (1997). Commentary on Ballard. Behavioral and Brain Sciences, Vol. 20, No. 4.
  • Kirlik, A., Walker, N. and Fisk, A.D., (1996). Supporting perception in the service of dynamic decision making. Human Factors, Vol. 38, No. 2.
  • Kirlik, A., (1993). Modeling strategic behavior in human-automation interaction: Why an "aid" can (and should) go unused. Human Factors, Vol. 34, No. 2.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J., (1993). Supervisory control in a dynamic uncertain environment: A process model of skilled human-environment interaction. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23(4).
  • Kirlik, A., Jagacinski, R.J., Miller, R.A., Plamondon, IT, and Lytton, L., (1993). Supervisory control in a dynamic uncertain environment: Comparisons of one and two-person crews. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23(4), 1993.
  • Vicente, K. and Kirlik, A., Putting the cart before the horse: Taking perception seriously in unified theories of cognition. Commentary on Newell. Behavioral and Brain Sciences, Vol. 15, No. 3, 1992.

Articles in Conference Proceedings

  • Deloatch, R., Bailey, B., Kirlik, A. and Zilles (2017). I Need Your Encouragement! Requesting Supportive Comments on Social Media Reduces Test Anxiety. ACM CHI'17, May 6-11, 2017, Denver, CO.
  • Deloatch, R., Bailey, B. & A. Kirlik (2016). Measuring Effects of Modality on Perceived Test Anxiety for Computer Programming Exams. Proceedings of the 47th ACM Technical Symposium on Computing Science Education. Memphis, TN, USA.
  • Eslami, M., Karahalios, K., Sandvig, C., Vaccaro, K., Rickman, A. & Kirlik, A. (2016). First I "like" it, then I hide it: Folk Theories of Social Feeds. ACM CHI’16, May 07 - 12, 2016, San Jose, CA, USA
  • Kirlik, A., Ackerman, K., Seefeldt, B., Xargay, E., Talleur, D., Carbonari, R., Hovakimyan, N. and Sha, L. (2015). Inverting the human/automation equation to support situation awareness and prevent loss of control. Proceedings of the 2015 International Symposium on Aviation Psychology. Dayton, OH.
  • Ackerman, K. A., S. T. Pelech, R. S. Carbonari, N. Hovakimyan, and A. Kirlik (2014). Pilot-in-the-loop flight simulator for NASA’s Transport Class Model. In Proceedings of the AIAA Guidance, Navigation and Control Conference, National Harbor, MD.
  • Chongvisal, J., N. Tekles, E. Xargay, D. A. Talleur, A. Kirlik, and N. Hovakimyan (2014). Loss-of-control prediction and prevention for NASA’s Transport Class Model. In Proceedings of the AIAA Guidance, Navigation and Control Conference, National Harbor, MD.
  • Deloatch, R., Marmarchi, A. & Kirlik A. (2013). Testing conditions for acquiring intuitive expertise in judgment: Evidence from a study of NCAA basketball tournament predictions. To appear in the Proceedings of the 2013 Human Factors and Ergonomics Society Annual Meeting. Santa Monica: CA.
  • Moehlenbrink, C., Manske, P. & Kirlik, A. (2012). An analysis of a ground traffic control decision support system based on the 3-step principle of heuristic decision making. Proc. Human Factors and Ergonomics Society Europe Chapter Conference, Toulouse, France.
  • Tsai, J. and Kirlik, A. (2012). Coherence and correspondence competence: Implications for the elicitation and aggregation of probabilistic forecasts of world events. Proceedings of the 2012 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Riddle, K., Kirlik, A., Talleur, D. and Carbonari, R. (2012). A comparison of visualization and command-based decision aiding in a simulated aircraft departure sequencing and timing task. Proceedings of the 2012 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Miller, S., Bailey, B.P., and Kirlik, A. (2012). Toward the development of an objective assessment technique for use in engineering design education. Proceedings of the 119th Annual American Society for Engineering Education (ASEE) Conference. San Antonio, TX.
  • Tsai, J., Miller, S. and Kirlik, A. (2011). Interactive visualizations to improve Bayesian reasoning. Proceedings of the 2011 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Miller, S., Kirlik, A. & Hendren, N. (2011). Applying knowledge and confidence information to predict achievement in forecasting. Proceedings of the 2011 Human Factors and Ergonomics Society Annual Meeting. Santa Monica, CA.
  • Tsai, J., Kirlik, A., Kosorukoff, A., Miller, S. (2008) Rule and instance based strategies in expert judgment. Proceedings of the 52nd Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Miller, S., Kirlik, A., Kosorukoff, A., Tsai, J. (2008) Supporting joint human-computer judgment under uncertainty. Proceedings of the 52nd Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Byrne, M. D., Kirlik, A., Allard, T., Foyle, D. C., Hooey, B. L., Gluck, K. A., Wickens, C. D., Pritchett, A. R. (2008) Issues and challenges in human performance modeling in aviation: Goals, advances, and gaps. Proceedings of the 52nd Annual Fleeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A. (2007) Lessons learned from the design of the decision support system used in the hurricane Katrina evacuation decision. Proceedings of the 51st Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A., Bisantz, A., Burns, C., Cooke, N. J., Guerlain, S., Lee, J. D., Sarter, N., Serfaty, D. (2007) Design specifications for a cognitive engineering textbook. Proceedings of the 51st Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Kirlik, A. (2007) Conceptual and technical issues in extending computational cognitive modeling to aviation. Proceedings of Human-Computer Interaction International 2007, Beijing, China.
  • Carlson, R., Gray, W. D., Kirlik, A., Kirsh, D., Payne, S. J., Neth, H. (2007) Immediate interactive behavior: How embodied and embedded cognition uses and changes the world to achieve its goals. Proceedings of the Cognitive Science Society 2007 Annual Meeting, Nashville, TN.
  • Miller, S. & Kirlik, A. (2006). Rational analysis and the lens model. Proceedings of the Human Factors Society 2006 Meeting, San Francisco, CA.
  • Nunes, A., Kirlik, A. (2005) An empirical study of calibration in air traffic control expert judgment. Proceedings of the 49th Annual Meeting of the Human Factors and Ergonomics Society (pp. 422-426). Santa Monica, CA: Human Factors and Ergonomics Society.
  • Byrne, M. D., Kirlik, A., Fleetwood, M. D., Huss, D. G., Kosorukoff, A., Lin, R. S., Fick, C.S. (2004) A closed-loop, ACT-R approach to modeling approach and landing with and without synthetic vision system (SVS) technology. Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
  • Rothrock, L. & A. Kirlik (2003). Explorations in modeling human decision making in dynamic contexts. Proceedings of HCI International 2003, Crete, Greece.
  • Kirlik, A. "Conducting generalizable research in the age of the field study." IEA/HFES 2000. San Diego, CA, 2000.
  • Strauss, R. and Kirlik, A. "Measuring the judgmental components of situation awareness." IEAI/HFES 2000. San Diego, CA, 2000.
  • Kirlik, A. (1999). "Ecological modeling of human-machine interaction." Proceedings of the 1999 IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, Japan.
  • Bisantz, A.M. and Kirlik, A., "Investigating the effect of problem format and task-related experience on evidential reasoning. " Proceedings of the Symposium on Human Interaction with Complex Systems. Dayton, OH, 1988.
  • Degani, A., and Kirlik, A., "Describing the design contributors to mode error. Proceedings of the Symposium on Human Interaction with Complex Systems. Dayton, OH, 1998.
  • Kirlik, A., (1988). The ecological expert: Acting to create information to guide action. Proceedings of the Fourth Symposium on Human Interaction with Complex Systems (HICS-98). Dayton, OH: IEEE Computer Society Press.
  • Turns, J.A and Kirlik, A. "Structural assessment to support engineering education." Proceedings of the 1998 American Society of Engineering Educators Conference, Seattle, WA, 1998.
  • Bisantz, A.M. Gay, P., Phipps, D., Walker, N., Kirlik, A., and Fisk, A.D. "Specifying training needs in a dynamic judgment task using a Lens Model approach." Proceedings of the 1997 IEEE Conference on Systems, Man, and Cybernetics. 1997.
  • Shafto, M., Degani, A. And Kirlik, A., "Canonical correlation analysis of data on human-automation interaction.” Proceedings of the Human Factors and Ergonomic Society Annual Meeting. Santa Monica, CA: 1997.
  • Degani, A., and Kirlik, A. "Modeling human interaction with semi-automated control systems to identify interface design problems." Proceedings of the International Symposium on Artificial Intelligence, Robotics, and Human Activity Support for Nuclear Applications. Wako-Shi, Saitama, Japan, 1997.
  • Gay, P., Phipps, D., Bisantz, A.M., Walker, N., Kirlik, A., and Fisk, A.D. "Operator specific modeling of identification judgments in a complex dynamic task." Proceedings of the Human Factors and Ergonomic Society Annual Meeting. Santa Monica, CA: 1997.
  • Kirlik, A., Rothrock, L., Walker, N. And Fisk, A.D., "Simple strategies or simple tasks? Dynamic decision making in "complex" worlds." Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting. Santa Monica, CA, 1996.
  • Walker, N., Fisk, A.D., .Phipps, D., Kirlik, A., "Training perceptual-rule-based skills." Proceedings of the Human Factors and Ergonomics Society, Santa Monica, 1995.
  • Kirlik, A., "The design of perceptually augmented displays to support interaction with dynamic systems," Proceedings of the 1995 IFAC Conference on Man-Machine Systems, Cambridge, MA, 1995.
  • Degani, A., Shafto, M. and Kirlik, A., "Modes in human-automation interaction," Proceedings of the 1995 IFAC Conference on Man-Machine Systems, Cambridge, MA, 1995.
  • Degani, A., Shafto, M., and Kirlik, A., "A modeling framework for human interaction with modal systems." Proceedings of the 1995 IEEE International Conference on. Systems, Man, and Cybernetics, Vancouver, CA, 1995.
  • Kirlik, A. "Perceptual augmentation to support skilled interaction," Proceedings of the 1993 IEEE International Conference on Systems, Man, and Cybernetics, Le Touquet, France, 1993.
  • Kirlik, A. "Requirements for design-relevant psychological models," Proceedings of the 1992 IEEE International Conference on Systems, Man., and Cybernetics, Chicago, IL, 1992.
  • Kirlik, A. and Rothrock, L., "Constraints on neural net modeling to support display design for skilled decision-making," Proceedings of the Second Workshop on Neural Networks: Academic/Industrial /NASA/Defense, Auburn, Alabama, 1991.
  • Kirlik, A., Markert, W.J., and Shively, R.J. "Perceptual and contextual influences on dynamic decision-making performance," Proceedings of the 1990 IEEE International Conference on Systems, Man, and Cybernetics, Los Angeles, CA, 1990.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J. "A process model of skilled human performance in a dynamic uncertain environment," Proceedings of the 1989 IEEE Int'l Conference on Systems, Man, and Cybernetics, Cambridge, MA, 1989.
  • Kirlik, A., Miller, R.A. and Jagacinski, R.J. "Route Planning as a Perceptual Task," Proceedings of the Twenty-Third Annual Conference on Manual Control, Cambridge, NIA, 1988.
  • Miller, R.A., Jagacinski, R.J., Plamondon, B.D., Lytton, L.E., and Kirlik, A., "A Comparison of One-and-Two-Person Crew Performance in a Supervisory Control Task," Proceedings of the Fourth Symposium on Aviation Psychology, Columbus, OH, 1987.
  • Kirlik, A., Miller, R.A., and Jagacinski, R.J. "A study of the effects of display aiding in a task with random components," Proceedings of the 1986 IEEE International Conference on Systems, Man, and Cybernetics, Atlanta, GA 1986.
  • Miller, R.A., Plamondon, B.D., Jagacinski, R.J. and Kirlik, A. "Investigation of Crew Performance in a Multi-Vehicle Supervisory Control Task," Proceedings of the Twenty-First Annual Conference on Manual Control, Columbus, OH, 1986.

Recent Courses Taught

  • CS 465 - User Interface Design
  • CS 498 KA3 (CS 498 KA4) - Experimental Methods for HCI
  • CS 565 (CS 591 HCI) - Human-Computer Interaction
  • CS 591 HCI - Advanced Seminar
  • CS 598 AK - Experimental HCI