Shh, don’t say that! Domain Certification in LLMs

Abstract

Large language models (LLMs) are often deployed to do constrained tasks, with narrow domains. For example, customer support bots can be built on top of LLMs, relying on their broad language understanding and capabilities to enhance performance. However, these LLMs are adversarially susceptible, potentially generating outputs outside the intended domain. To formalize, assess and mitigate this risk, we introduce \emph{domain certification}; a guarantee that accurately characterizes the out-of-domain behavior of language models. We then propose a simple yet effective approach dubbed VALID that provides adversarial bounds as a certificate. Finally, we evaluate our method across a diverse set of datasets, demonstrating that it yields meaningful certificates.

Paper Link TBD

BibTex

@misc{emde_shh_2024, title = {Shh, don’t say that! {Domain} {Certification} in {LLMs}}, abstract = {Large language models (LLMs) are often deployed to do constrained tasks, with narrow domains. For example, customer support bots can be built on top of LLMs, relying on their broad language understanding and capabilities to enhance performance. However, these LLMs are adversarially susceptible, potentially generating outputs outside the intended domain. To formalize, assess and mitigate this risk, we introduce {\textbackslash}emph{domain certification}; a guarantee that accurately characterizes the out-of-domain behavior of language models. We then propose a simple yet effective approach dubbed VALID that provides adversarial bounds as a certificate. Finally, we evaluate our method across a diverse set of datasets, demonstrating that it yields meaningful certificates.}, language = {en}, urldate = {2024-10-04}, author = {Emde, Cornelius and Paren, Alasdair and Arvind, Preetham and Kayser, Maxime Guillaume and Rainforth, Tom and Lukasiewicz, Thomas and Torr, Philip and Bibi, Adel}, month = oct, year = {2024}, file = {Full Text PDF:/Users/cornelius/Zotero/storage/SJ22GG3Z/Emde et al. - 2024 - Shh, don’t say that! Domain Certification in LLMs.pdf:application/pdf}, }