Skip to article
AHFE AHFE Discoveries AHFE International Open Access Journal
AHFE OPEN ACCESS OPEN ACCESS CONFERENCE PROCEEDINGS PAPER

Interaction between designers and AI: literature review of research to highlight the characteristics of co-creation and methods for analyzing it

Università Iuav di Venezia, VE, Italy ↗
Publication year
Digital Object Identifier10.54941/ahfe1004509

Abstract

The proposal begins with a literature review and aims to investigate how the user experience of designers changes when transitioning from traditional software to artificial intelligence. AI tools automate tasks and take on a more active role compared to traditional computer-aided design tools, often referred to as "co-creators." This work seeks to identify the differences between using traditional software and software integrated with AI. In particular, it aims to outline the characteristics of the interaction between designers and AI, such as user satisfaction, trust, or surprise with the outcomes, role coordination, and more. Subsequently, the methods used by studies to analyze these aspects will be defined. This analysis serves as a foundation for creating protocols to systematically study designer-AI co-creation interactions and shed light on the unexplored aspects in existing research

INTRODUCTION

In the recent period, hardware implementations have provided the oppor- tunity to develop increasingly performative AI and make it accessible to a wider and wider audience not strictly related to the field of computer sci- ence. AI-based design tools are proliferating in the design field, acting as agile co-creators and assisting designers in increasingly complex design tasks, where the term indicates object processing activities with countless optimiza- tion goals. These tools are a valuable resource, but their effective use requires a new set of skills from human agents compared to traditional CAD software (Gmeiner et al., 2023). For example, designers do not directly manipulate 3D geometry, but formulate design goals from which the AI system must start.

While directions of possible applications are multiplying, we still know relatively little about how designers can cognitively collaborate with AI-based design tools.

The difference between traditional software and AI with which we design becomes relevant and the starting point of this thesis, a study also aimed at helping to fill the gap in the literature on the topic. While the study of the

© 2024. Published by AHFE Open Access. All rights reserved. 446

Interaction Between Designers and AI: Literature Review of Research 447

cognitive interaction between human agents and AI has been examined in computer science and engineering and in some artistic contexts (Kantosalo & Riihiaho 2019; Karimi, Rezwana et al. 2020; Lin et al. 2020); so far the research related to AI and design that has focused mainly on the analysis of interaction with AI, points out that few studies consider the nature of cogni- tive design problems (Bernal et al., 2015) and that only a few of these have analyzed computational support in the early stages of design where designers play a key role (Liao et al., 2020). Early research on the design and evaluation of AI applications rarely delves into how AI and designers interact cognitively during design; only some new research on mental models has been able to describe some aspects of it (Bansal et al., 2019; Cai et al., 2019; Holstein et al., 2020; Wang et al., 2020; Zhang et al., 2021,).

Based on the recent literature in the area of Human-Computer Interaction (Gmeiner et al., 2023; Holstein et al., 2020; Wang et al., 2020; Zhang et al., 2021) this study aims to identify and explore how to study the cognitive aspects characterizing designer-AI interaction, in particular to understand what are the most effective and least invasive methodologies of experiments to analyze conflict resolution and goal negotiation.

USES OF AI: AUTOMATION AND CO-DESIGN PARTNERSHIPS From the utilization of AI in design (an increasingly growing number of case studies) and the industry literature, relevant themes are emerging regard- ing the potential impact of artificial intelligence (AI) on the design process. However, it is noted that the use of these technologies can lead to a limited understanding among designers and end users regarding how these tech- nologies affect both the design process and the final outcome (Stige et al., 2023). As indicated by Asatiani et al. (2020), artificial intelligence is consid- ered a “black box” that currently lacks the capacity to provide explanations regarding decision-making processes. Therefore, even though AI-enabled dig- ital solutions can be accurate, designers and end users may not immediately (at least in the short term) comprehend the causal relationships that under- pin them. This mode of interaction can make it challenging for designers to quickly develop a comprehensive understanding of how the tool works, thus potentially limiting their creativity. This represents an important start- ing point to understand how the design process currently takes place and what the limitations are regarding the collaboration between designers and end users.

Collaboration between UX designers, computer scientists, and engineers is necessary to achieve effective integration of AI into the design process. Fur- thermore, considering that AI is unable to directly understand or utilize the implicit knowledge guiding certain phases of the design, there is doubt about its ability to completely replace human designers for the time being. How- ever, this partnership will require designers to expand their skills by gaining knowledge in artificial intelligence and machine learning. In this way, they will be able to discern which challenges can or cannot be addressed by AI, as indicated by Sun et al. (2020) and Yang (2017).

448 Cavallin

Recent research has developed generative design interfaces that allow for interactive exploration of multiple design options or for more iterative involvement of the designer in the process through real-time generation and evaluation of the design (Gmeiner et al., 2023). However, there are still limited empirical studies that assess how engineers and designers learn to work with AI-based design tools in realistic contexts, with one of the first comprehensive studies conducted by Gmeiner and his colleagues.

It is, therefore, important to distinguish when AI can automate a phase and when it can serve as a co-creator. Let’s begin by examining the first theme, which is automation.

AUTOMATION The automation of key phases in the design processes is an aspect that, despite the growing practical interest in its completion, has not received sufficient attention thus far.

It is essential to explore how AI can be specifically used to automate these phases and provide support for the creative challenges that designers encounter during the design process. This involves identifying the tedious and repetitive tasks that can be automated and understanding how automation can enhance the workflow of designers, thus increasing their creativity.

Since the design process encompasses a series of diverse phases and activ- ities, it is equally relevant to examine how the potential automation of some of these phases can alter the nature of the work carried out by the designer and the entire design process.

As previously mentioned, the introduction of AI requires designers to pro- vide essential input regarding what is required as the outcome of the design. Consequently, designers collaborating with AI can place a greater empha- sis on formalizing conceptual, structural, functional, and aesthetic aspects of the design. This process necessitates a combination of creativity, problem- solving, meaning creation, empathy, and collaboration, as emphasized by Oulasvirta et al. (2020).

CO-CREATOR AI tools, when they take on a more active role compared to traditional computer-aided design tools, and therefore not just in automation, are referred to as “co-creators” (Gmeiner et al., 2023).

Today, the design process, especially in user-centric contexts, involves the participation (sometimes referred to as co-design) of various stakeholders, such as the client who commissioned the product/service and, increasingly, the intended end users.

In addition to developing the skills necessary to support these participatory approaches with human agents, designers will increasingly be called upon to acquire technical competencies for co-designing with AI-based tools, which means becoming familiar with these tools and learning how to use them effectively as co-creators.

Interaction Between Designers and AI: Literature Review of Research 449

Up to now, published literature has offered limited insights into the pro- cess through which designers acquire the skills needed to use AI-based design tools.

A significant example of this knowledge gap has been discussed by Yang et al. (2020), who highlighted how UX designers currently have deficiencies in relevant knowledge, particularly when it comes to Deep Neu- ral Networks (DNN). Therefore, it becomes imperative to comprehensively understand the competencies and skills required of designers, both in the short and long term, in order to enable them to keep up with the constantly evolving developments in the field of AI.

Furthermore, it is important to emphasize that effective and practical collaboration with AI presents a complex challenge for designers because it requires a significant learning process. These professionals must learn to work synergistically and think collaboratively with artificial intelligence agents, which operate differently from human collaborators or complex CAD tools (Gmeiner et al., 2023).

ANALYSIS & CATEGORIZATION Given the premises regarding the role that AI can assume and the analysis of case studies examined in the literature, several key aspects characteriz- ing the interaction between designers and artificial intelligence (AI) during the co-creation process emerge. These aspects, identified and structured in a table, have been associated with effective analysis methods for in-depth understanding.

The analysis of interaction aspects begins with an overall framework of the experience and an exploration of the designers’ expectations. These initial aspects are followed by more specific considerations related to the operational roles of both designers and AI, as well as the organization and coordination of these roles. In particular, the concept of the “mental model,” often mentioned in the literature, proves to be a fundamental ele- ment in understanding how co-creation projects between designers and AI develop.

Further analysis elements concern very detailed aspects and have there- fore been grouped into two categories: the first set includes the analysis of conflict resolution, timing, and project flow; the second set encompasses evaluations of satisfaction with design outcomes, elements of surprise, trust, and reassurance.

It is important to note that, for analyzing the co-creation process or prod- ucts, mainly two methods are employed: observation, with a qualitative focus, and document collection, with a quantitative focus. On the other hand, to obtain direct feedback from users, primarily two other methods are used: interviews, with a qualitative focus, and questionnaires, with a quantitative focus. These analysis tools allow for a detailed examination of the interaction between designers and AI, as well as the dynamics involved in this co-creation process.

450 Cavallin

Table 1. Key aspects of designer-AI interaction and related research methods.

Table available in the original PDF paper.

Aspects Analyzed Reference Bibliography Investigation Methods General experience Cabrera et al., 2023; Rezwana & Maher, n.d., 2022

pre-task interviews (qualitative) questionnaires (quantitative)

COFI (Co-Creative Framework for Interaction Design) think aloud (qualitative) interviews during and post task (qualitative) questionnaires (quantitative) Expectations Chong et al., 2022; Figoli et al., 2022; Galdon et al., 2020; Israelsen & Ahmed, 2019; Lotfalian Saremi & Bayrak, 2021; Uusitalo et al., 2022 Roles and Coordination Rezwana & Maher, n.d., 2022 supervision during the activity & think aloud (qualitative) interviews during and post task (qualitative) questionnaires (quantitative) Single mental model and shared

Bansal, et al., 2019; Bernal et al., 2015; Gmeiner et al., 2023; He et al., 2023

Amershi, et al., 2019; Cabrera et al., 2023; Wang, et al., 2020

think aloud (qualitative) interviews during and post task (qualitative) questionnaires (quantitative) Conflict resolution, timing and project flow

Amershi, et al., 2019; Gmeiner et al., 2023

supervision think aloud (qualitative) interviews during and post task (qualitative) questionnaires (quantitative) Satisfaction with the result of the design, surprise, trust and reassurance

think aloud (qualitative) interviews during and post task (qualitative) questionnaires (quantitative)

CONCLUSION

From the literature, it is evident that the think-aloud method is the most widely used and effective approach for interaction analysis. However, as observed in other case studies, it allows designers to spend less time in the design process and leverage more neurocognitive resources during the design process (Shealy et al., 2023). In fact, Wright & Monk in 1991 concluded that user testing with think-aloud methods is not only an effective evaluation technique for designers but also that designers can benefit significantly from conducting their evaluations.

Interaction Between Designers and AI: Literature Review of Research 451

It is hypothesized that, through interaction with AI, designers can also ben- efit from reworking their thoughts and acquiring information. This is because they must continuously make their thoughts and information explicit (e.g., when interaction occurs through writing prompts) to the AI and formulate them in ways that are comprehensible.

This categorization is intended to create protocols for systematically study- ing designer-AI co-creation interactions. It aims to identify specific areas for analysis and determine which design phases are best suited for using the meth- ods described. This paper highlights that many aspects are still unexplored in existing research and that each of these aspects requires more in-depth investigation.

REFERENCES

Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for Human-AI Interaction. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3290605. 3300233 Asatiani, A., Malo, P., Nagbøl, P. R., Penttinen, E., Rinta-Kahila, T., & Salovaara, A.

(2020). Challenges of Explaining the Behavior of Black-Box AI Systems. M I S Quarterly Executive, 19(4), 259–278. https://doi.org/10.17705/2msqe.00037 Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E.

(2019). Beyond Accuracy: The Role of Mental Models in Human-AI Team Per- formance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 7, 2–11. https://doi.org/10.1609/hcomp.v7i1.5285 Bernal, M., Haymaker, J. R., & Eastman, C. (2015). On the role of computational support for designers in action. Design Studies, 41, 163–182. https://doi.org/10. 1016/j.destud.2015.08.001 Cabrera, Á. A., Perer, A., & Hong, J. I. (2023). Improving Human-AI Collaboration

With Descriptions of AI Behavior. Proceedings of the ACM on Human-Computer Interaction, 7(CSCW1), 1–21. https://doi.org/10.1145/3579612 Cai, C. J., Winter, S., Steiner, D. F., Wilcox, L., & Terry, M. (2019). ‘Hello AI’: Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proceedings of the ACM on Human-Computer Interaction, 3, 1–24. https://doi.org/10.1145/3359206 Chong, L., Raina, A., Goucher-Lambert, K., Kotovsky, K., & Cagan, J. (2022,

November 11). Collaborative Design Decision-Making With Artificial Intelli- gence: Exploring the Evolution and Impact of Human Confidence in AI and in Themselves. https://doi.org/10.1115/DETC2022-88574 De-Arteaga, M., Fogliato, R., & Chouldechova, A. (2020). A Case for Humans-inthe-Loop: Decisions in the Presence of Erroneous Algorithmic Scores. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, null, null. https://doi.org/10.1145/3313831.3376638 Figoli, F. A., Rampino, L., & Mattioli, F. (2022). AI in the Design Process: Training

the Human-AI Collaboration. DS 117: Proceedings of the 24th International Con- ference on Engineering and Product Design Education (E&PDE 2022), London South Bank University in London, UK. 8th - 9th September 2022. 24th Interna- tional Conference on Engineering & Product Design Education (E&PDE 2022). https://doi.org/10.35199/EPDE.2022.61

452 Cavallin

Gmeiner, F., Yang, H., Yao, L., Holstein, K., & Martelaro, N. (2023, April 19).

Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10. 1145/3544548.3580999 Galdon, F., Hall, A., & Ferrarello, L. (2020). Designing Trust in Artificial Intelligence: A Comparative Study Among Specifications, Principles and Levels of Control. In T. Ahram, R. Taiar, V. Gremeaux-Bader, & K. Aminian (Eds.), Human Interaction, Emerging Technologies and Future Applications II (Vol. 1152, pp. 97–102). Springer International Publishing. https://doi.org/10.1007/978-3- 030-44267-5_14 Green, B., & Chen, Y. (2019). The Principles and Limits of Algorithm-in-the-Loop

Decision Making. Proceedings of the ACM on Human-Computer Interaction, 3, 1–24. https://doi.org/10.1145/3359152 He, Z., Song, Y., Zhou, S., & Cai, Z. (2023). Interaction of Thoughts: Towards Mediating Task Assignment in Human-AI Cooperation with a Capability-Aware Shared Mental Model. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 1–18. https://doi.org/10.1145/3544548.3580983 Holstein, K., Aleven, V., & Rummel, N. (2020). A Conceptual Framework for

Human–AI Hybrid Adaptivity in Education. Artificial Intelligence in Education, 12163, 240–254. https://doi.org/10.1007/978-3-030-52237-7_20 Israelsen, B. W., & Ahmed, N. R. (2019). “Dave... I can assure you...that it’s going to be all right...” A Definition, Case for, and Survey of Algorithmic Assurances in Human-Autonomy Trust Relationships. ACM Computing Surveys, 51(6), 1–37. https://doi.org/10.1145/3267338 Lai, V., & Tan, C. (2018). On Human Predictions with Explanations and Predictions

of Machine Learning Models: A Case Study on Deception Detection. Proceed- ings of the Conference on Fairness, Accountability, and Transparency, null, null. https://doi.org/10.1145/3287560.3287590 Liao, J., Hansen, P., & Chai, C. (2020). A framework of artificial intelligence augmented design support. Human–Computer Interaction, 35(5–6), 511–544. https://doi.org/10.1080/07370024.2020.1733576 Lotfalian Saremi, M., & Bayrak, A. E. (2021, November 17). A Survey of Important

Factors in Human—Artificial Intelligence Trust for Engineering System Design. ASME 2021 International Design Engineering Technical Conferences and Com- puters and Information in Engineering Conference. https://doi.org/10.1115/DE TC2021-70550 Oulasvirta, A., Dayama, N. R., Shiripour, M., John, M., & Karrenbauer, A. (2020).

Combinatorial Optimization of Graphical User Interface Designs. Proceedings of the IEEE, 108(3), 434–464. https://doi.org/10.1109/JPROC.2020.2969687 Poursabzi-Sangdeh, F., Goldstein, D., Hofman, J., Vaughan, J. W., & Wallach, H. (2018). Manipulating and Measuring Model Interpretability. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, null, null. https://doi.org/10.1145/3411764.3445315 Rezwana, J., & Maher, M. L. (n.d.). COFI: A Framework for Modeling Interaction

in Human-AI Co-Creative Systems. Rezwana, J., & Maher, M. L. (2022). Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems. ACM Transactions on Computer-Human Interaction, 3519026. https://doi.org/ 10.1145/3519026

Interaction Between Designers and AI: Literature Review of Research 453

Shealy, T., Gero, J., Ignacio, P., & Song, I. (2023b). Changes in Cognition and Neurocognition When Thinking Aloud During Design. Proceedings of the Design Society, 3, 867–876. https://doi.org/10.1017/pds.2023.87 Stige, Å., Zamani, E. D., Mikalef, P., & Zhu, Y. (2023). Artificial intelligence

(AI) for user experience (UX) design: A systematic literature review and future research agenda. Information Technology & People, ahead-of-print (ahead-of- print). https://doi.org/10.1108/ITP-07-2022-0519 Sun, L., Zhou, Z., Wu, W., Zhang, Y., Zhang, R., & Xiang, W. (2020). Developing a Toolkit for Prototyping Machine Learning-Empowered Products: International Journal of Design, 14(2), 16. Uusitalo, S., Kantosalo, A., Salovaara, A., Takala, T., & Guckelsberger, C. (2022).

Co-creative Product Design with Interactive Evolutionary Algorithms: A Practice- Based Reflection. In T. Martins, N. Rodríguez-Fernández, & S. M. Rebelo (Eds.), Artificial Intelligence in Music, Sound, Art and Design (pp. 292–307). Springer International Publishing. https://doi.org/10.1007/978-3-031-03789-4_19 Wang, D., Churchill, E., Maes, P., Fan, X., Shneiderman, B., Shi, Y., & Wang, Q. (2020). From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3334480.3381069 Wright, P. C., & Monk, A. F. (1991). The use of think-aloud evaluation methods

in design. ACM SIGCHI Bulletin, 23(1), 55–57. https://doi.org/10.1145/122672. 122685 Yang, Q. (2017). The Role of Design in Creating Machine-Learning-Enhanced User Experience (Technical Report SS-17-04; 2017 AAAI Spring Symposium Series, p. 6). Association for the Advancement of Artificial Intelligence. https://www.aaai.o rg/ocs/index.php/SSS/SSS17/paper/viewFile/15363/14575 Yin, M., Vaughan, J. W., & Wallach, H. (2019). Understanding the Effect of Accuracy

on Trust in Machine Learning Models. Proceedings of the 2019 CHI Confer- ence on Human Factors in Computing Systems, null, null. https://doi.org/10.1145/ 3290605.3300509 Zhang, Y., Liao, Q., & Bellamy, R. (2020). Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, null, null. https://doi.org/10.1145/3351095.3372852

Cover of the proceedings volume Intelligent Human Systems Integration (IHSI 2024): Integrating People and Intelligent Systems

Explore the complete digital volume

Intelligent Human Systems Integration (IHSI 2024): Integrating People and Intelligent Systems

Read this individual research paper free through the original publisher, or explore the full digital proceedings book.

ISBN 978-1-958651-95-7

Explore this ISBN in the AHFE Bookstore Listed in the July 2026 bookstore catalogue; search by ISBN to confirm current availability · Digital book purchase optional

Explore Related Research

Related research 8 matches

More papers from this volume

← Back to Research ExplorerBrowse the full library →