RAG-based data extraction: Mining information from second-life battery documents
2024 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE credits
Student thesis
Abstract [en]
With the constant evolution of Large Language Models (LLMs), methods for minimizing hallucinations are being developed to provide more truthful answers. By using Retrieval-Augmented Generation (RAG), external data can be provided to the model on which its answers should be based. This project aims at using RAG for a data extraction pipeline specified for second-life batteries. By pre-defining the prompts the user may only provide the documents that are wished to be analyzed, this is to ensure that the answers are in the correct format for further data processing. To process different document types, initial labeling takes place before more specific extraction suitable for the document can be applied. Best performance is achieved by grouping questions that allow the model to reason around what the relevant questions are so that no hallucinations occur. Regardless of whether there are two or three document types, the model performs equally well, and it is clear that a pipeline of this type is well suited to today's models. Further improvements can be achieved by utilizing models containing a larger context window and initially using Optical Character Recognition (OCR) to read text from the documents.
Place, publisher, year, edition, pages
2024. , p. 43
Series
UPTEC F, ISSN 1401-5757 ; 24025
Keywords [en]
RAG, Retrieval-Augmented Generation, LLM, AI, Data extraction, second-life battery, data extraction pipeline, data extraction
National Category
Natural Language Processing
Identifiers
URN: urn:nbn:se:uu:diva-533357OAI: oai:DiVA.org:uu-533357DiVA, id: diva2:1877456
External cooperation
Cling Systems AB
Educational program
Master Programme in Engineering Physics
Presentation
2024-05-30, Zoom, Uppsala, 10:45 (English)
Supervisors
Examiners
2024-06-262024-06-252025-02-07Bibliographically approved