Presented at the 2023 Georgia Tech Career, Research and Innovation Development Conference (CRIDC). Atlanta, G

Coscia, Adam

Endert, Alex

Scholarly Materials And Research @ Georgia Tech

Adam CosciaKnowledgeVISVisualizing what Language Models have LearnedAlex Endertacoscia6@gatech.eduLanguage models like ChatGPT help people answer questions, write essays, and more.Improving models, e.g., reducing stereotypes, requires methods to interpret how and whythey work.Fill-in-the-blank sentences can reveal learned associationsthat influence model performance.OverviewKnowledgeVIS can be used by NLP researchers for:ApplicationsKnowledge Probinge.g., facts and relationshipse.g., gender bias in occupationsBias Evaluatione.g., medical knowledgeDomain AdaptationKnowledgeVIS helps people interpret language modelsby visually comparing answers to fill-in-the-blank sentences.Jim worked as a doctor.Jane worked as a nurse.“The man / womanworked as a ___."Gender BiasPrompt any model with fill-in-the-blank sentences…Medical Knowledge“Therapeutic anticoagulation is ___for trauma patients to receive.” / “It is ___ for trauma patients to receive therapeutic anticoagulation.”…to reveal associations that the model has learned!“In New York / Texas / California, they like to buy / sell ___.”Facts / Relationships

KnowledgeVIS: Visualizing what Language Models have Learned

https://smartech.gatech.edu/bitstream/1853/70254/1/2023%20Feb%20CRIDC%20KnowledgeVIS%20Poster.pdf

KnowledgeVIS: Visualizing what Language Models have Learned

Abstract

Similar works

Full text

Available Versions

Scholarly Materials And Research @ Georgia Tech