This dataset contains the nine think-aloud tests conducted in April-June 2021.

Think-aloud tests were designed to test the extent an academic search could be conducted in the two AI-powered search systems, Iris.ai (https://Iris.ai/) and Yewno Discover (https://www.yewno.com/discover). Pilot tests and validation tests were undertaken with two independent reviewers in March 2021. The validity tests were based on the principles outlined in Kim 2009, testing the content, face and construct validity of the test instrument (appendix 1). Consequently, the grammar and consistency of the language were improved and questions were reframed before the final think aloud tests were conducted in April-June 2021.



Ten information specialists were invited to take part in the tests. One test person from the Yewno tests dropped out of the study, resulting in an overall drop-out rate of 10%. Accordingly, five think-aloud tests in Iris.ai and four in Yewno were held at the university libraries in Aarhus and Copenhagen.

Two testers ran each test. One conducted the dialogue and guided the test person through the tasks set in the think-aloud test. The second, noted down the test persons behavior, humour and comments. All tests were recorded using Zoom, both audio, and screen were recorded as well as the test persons behaviour was observed. The recordings were saved to Edumedia for the duration of the project and destroyed thereafter.