Developing Rubrics for AI tools on Article Databases

Title

Developing Rubrics for AI tools on Article Databases

Description

As AI tools become increasingly integrated into library databases, librarians at California State University, Dominguez Hills developed a rubric to evaluate these technologies before implementation. Created by the University Library AI Working Group (AIWG) in consultation with subject experts, the rubric assesses chat assistants and generative AI features across 15 criteria, including effectiveness, pedagogy, transparency, usability, and ethics. Using a 0–3 rating scale, the rubric is currently being tested. This presentation will highlight its development and evaluation process.

Creator

Warriner, Samantha

Date

2026-04-24

Rights

This item is protected by copyright but is made available here under a claim of fair use (17 U.S.C. Section 107) for non-profit research and educational purposes. Users of this work assume the responsibility for determining copyright status prior to reusing, publishing, or reproducing this item for purposes other than what is allowed by fair use or other copyright exemptions. Any reuse of this item in excess of fair use or other copyright exemptions requires express permission of the copyright holder.

Format

application/pdf

Language

eng

Type

Text; Document; Presentation

Abstract

In the coming wave of AI tools used in library databases, librarians at the California State University aimed to create a clear rubric for analyzing these tools before implementation. The CSU Dominguez Hills University Library AI working group (AIWG) was charged to provide information and recommendations related to AI tools integrated into library databases. In consultation with relevant subject-experts, the AIWG identifies these tools and develops assessment instruments to guide their evaluation. AI tools included chat assistant and generative AI integrations into the article databases by the vendor. The AIWG considered criteria like effectiveness, pedagogy, transparency, usability, ethics, and more. The AWIG created a 0-3 scale rubric for 15 criteria, and is currently in the testing phase before full implementation. This presentation will discuss how the rubric was created and how each criteria is judged.

Date Available

2026-04-24

Date Issued

2026-04-24

Rights Holder

Warriner, Samantha

Position: 1115 (5 views)

Files

WarrinerS - CALA Spring 26 Slides - AI Rubric.pdf
Warriner Sam-Supplemental-CALA 2026.zip

Citation

Warriner, Samantha, “Developing Rubrics for AI tools on Article Databases,” CALASYS - CALA Academic Resources & Repository System, accessed June 24, 2026, https://ir.cala-web.org/items/show/1603.