Loading Session...

Developing an AI Assessment Approach Using the Primo Research Assistant

Back to Schedule Check-inYou can join session 5 minutes before start time.

Session Information

Generative AI (Gen AI) has the potential to offer a more intuitive, meaningful discovery experience. However, it also has the potential to obfuscate and distort information. Given the growing number of AI tools emerging, libraries must balance the need to make discovery both as easy and as accurate as possible. In this presentation, we describe how we developed an approach to assessing user-focused AI tools and our assessment of the Primo Research Assistant. We will discuss common issues with AI, testing and assessment strategies, and what we found in our evaluation of the Research Assistant.

Primo
None - General Audience
Describe strategies to evaluate the output of Gen AI tools.
Categorize different types of questions and errors.
Evaluate the output of Primo Research Assistant prompts.
Jun 19, 2025 04:00 PM - 04:45 PM(America/New_York)
Venue : Marquis Ballroom/Salon D
20250619T1600 20250619T1645 America/New_York Developing an AI Assessment Approach Using the Primo Research Assistant

Generative AI (Gen AI) has the potential to offer a more intuitive, meaningful discovery experience. However, it also has the potential to obfuscate and distort information. Given the growing number of AI tools emerging, libraries must balance the need to make discovery both as easy and as accurate as possible. In this presentation, we describe how we developed an approach to assessing user-focused AI tools and our assessment of the Primo Research Assistant. We will discuss common issues with AI, testing and assessment strategies, and what we found in our evaluation of the Research Assistant.

Marquis Ballroom/Salon D Ex Libris Knowledge Days and ELUNA Conference 2025 eluna-conf-planning@exlibrisusers.org
58 visits

Session Participants

User Online
Session speakers, moderators & attendees
Discovery Technologies Librarian
,
University of Regina
Library User Services Manager
,
University of Regina
Digital Services and Liaison Librarian
,
University of Regina
Associate Dean (Research)
,
University of Regina
Library User Services Assistant
,
University of Regina
 Jose Vila
Cataloging and Metadata Librarian - Unit Lead for Interdisciplinary Collections
,
University Of Miami
No attendee has checked-in to this session!
27 attendees saved this session

Session Chat

Live Chat
Chat with participants attending this session

Questions & Answers

Answered
Submit questions for the presenters

Session Polls

Active
Participate in live polls

Need Help?

Technical Issues?

If you're experiencing playback problems, try adjusting the quality or refreshing the page.

Questions for Speakers?

Use the Q&A tab to submit questions that may be addressed in follow-up sessions.