Check-inYou can join session 5 minutes before start time.
AI/Emerging Technologies and Standards | Annual Meeting Marquis Ballroom/Salon D
Jun 19, 2025 04:00 PM - 04:45 PM(America/New_York)
20250619T1600 20250619T1645 America/New_York Developing an AI Assessment Approach Using the Primo Research Assistant

Generative AI (Gen AI) has the potential to offer a more intuitive, meaningful discovery experience. However, it also has the potential to obfuscate and distort information. Given the growing number of AI tools emerging, libraries must balance the need to make discovery both as easy and as accurate as possible. In this presentation, we describe how we developed an approach to assessing user-focused AI tools and our assessment of the Primo Research Assistant. We will discuss common issues with AI, testing and assessment strategies, and what we found in our evaluation of the Research Assistant.

Marquis Ballroom/Salon D Ex Libris Knowledge Days and ELUNA Conference 2025 eluna-conf-planning@exlibrisusers.org
16 attendees saved this session

Generative AI (Gen AI) has the potential to offer a more intuitive, meaningful discovery experience. However, it also has the potential to obfuscate and distort information. Given the growing number of AI tools emerging, libraries must balance the need to make discovery both as easy and as accurate as possible. In this presentation, we describe how we developed an approach to assessing user-focused AI tools and our assessment of the Primo Research Assistant. We will discuss common issues with AI, testing and assessment strategies, and what we found in our evaluation of the Research Assistant.

Primo
None - General Audience
Describe strategies to evaluate the output of Gen AI tools.
Categorize different types of questions and errors.
Evaluate the output of Primo Research Assistant prompts.
Discovery Technologies Librarian
,
University of Regina
Library User Services Manager
,
University of Regina
Digital Services and Liaison Librarian
,
University of Regina
Associate Dean (Research)
,
University of Regina
Library User Services Assistant
,
University of Regina
No moderator for this session!
No attendee has checked-in to this session!
Upcoming Sessions
25 visits