RAG-based data extraction: Mining information from second-life battery documents
2024 (Engelska)Självständigt arbete på avancerad nivå (yrkesexamen), 20 poäng / 30 hp
Studentuppsats (Examensarbete)
Abstract [en]
With the constant evolution of Large Language Models (LLMs), methods for minimizing hallucinations are being developed to provide more truthful answers. By using Retrieval-Augmented Generation (RAG), external data can be provided to the model on which its answers should be based. This project aims at using RAG for a data extraction pipeline specified for second-life batteries. By pre-defining the prompts the user may only provide the documents that are wished to be analyzed, this is to ensure that the answers are in the correct format for further data processing. To process different document types, initial labeling takes place before more specific extraction suitable for the document can be applied. Best performance is achieved by grouping questions that allow the model to reason around what the relevant questions are so that no hallucinations occur. Regardless of whether there are two or three document types, the model performs equally well, and it is clear that a pipeline of this type is well suited to today's models. Further improvements can be achieved by utilizing models containing a larger context window and initially using Optical Character Recognition (OCR) to read text from the documents.
Ort, förlag, år, upplaga, sidor
2024. , s. 43
Serie
UPTEC F, ISSN 1401-5757 ; 24025
Nyckelord [en]
RAG, Retrieval-Augmented Generation, LLM, AI, Data extraction, second-life battery, data extraction pipeline, data extraction
Nationell ämneskategori
Språkbehandling och datorlingvistik
Identifikatorer
URN: urn:nbn:se:uu:diva-533357OAI: oai:DiVA.org:uu-533357DiVA, id: diva2:1877456
Externt samarbete
Cling Systems AB
Utbildningsprogram
Civilingenjörsprogrammet i teknisk fysik
Presentation
2024-05-30, Zoom, Uppsala, 10:45 (Engelska)
Handledare
Examinatorer
2024-06-262024-06-252025-02-07Bibliografiskt granskad