Generating training datasets for legal chatbots in Korean - Université Gustave Eiffel Access content directly
Conference Papers Year : 2023

Generating training datasets for legal chatbots in Korean

Abstract

Chatbots are robots that can communicate with humans using text or voice signals. Legal chatbots improve access to justice, since legal representation and legal advice by lawyers come with a high cost that excludes disadvantaged and vulnerable people. However, capturing the diversity of actual user input in datasets for deep-learning dialog systems (chatbots) is a technical challenge. Diversity requires large volumes of data, which must also be labelled in order to classify the user's intent, while the cost of labelling datasets increases with volume. Instead of labelling large volumes of authentic data from users, our approach consists in jointly generating large volumes of utterances and high-quality labels. The generator of labelled datasets is based on language resources that take the form of local grammar graphs (LGG), which capture and generalize the vocabulary and local syntax observed by linguists in text. The LGGs associate labels to the utterances according to a domain-specific classification system. We tested this approach by implementing LIGA, a legal chatbot in Korean. The chatbot answers users' conversational queries on legal situations by providing information on similar legal cases, made publicly available by the Korean government. We generated labelled utterances from the LGGs with the aid of the open-source Unitex platform. This process produced 700 million utterances. We trained a DIET classifier on a dataset made of these utterances, and the trained model reached 91% f1-score performance. We implemented a chatbot called LIGA, which uses the results of the model to select a link to a web page that documents similar legal cases.
Fichier principal
Vignette du fichier
gener-dataset.pdf (824.57 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04006155 , version 1 (27-02-2023)

Identifiers

  • HAL Id : hal-04006155 , version 1

Cite

Changhoe Hwang, Jee-Sun Nam, Eric Laporte. Generating training datasets for legal chatbots in Korean. International conference on Law and Society, P. Suresh, Feb 2023, Hanoï, Vietnam. pp.1-4. ⟨hal-04006155⟩
79 View
152 Download

Share

Gmail Facebook X LinkedIn More