Content Summarization and Question Answering System Using LLM

Content Summarization and Question Answering System Using LLM

Manikanta S, Mythri Varadaraju, Rithika M Choudhary, Ravuri Sri Venkata Naga Sai Mani Pavan, Sarvamangala D R

School of CIT

REVA University

Bengaluru, India

Abstract—This paper presents a novel approach to content summarization, a pivotal task in information processing and knowledge extraction. Our methodology integrates cutting-edge technologies, including large language models (LLMs) and ad-vanced retrieval techniques, to efficiently distill extensive textual data into concise and informative summaries. By leveraging Anyscale LLMs for language comprehension and employing prompt engineering for model guidance, we propose a frame-work that prioritizes efficient document indexing and rapid retrieval using DuckDB vector stores. Additionally, we introduce the RetrievalQAWithSourcesChain framework, which combines LLMs with retrievers for proficient question answering. Em-pirical validation demonstrates the efficacy of our approach in generating high-quality content summaries with minimal manual intervention, thereby enhancing information retrieval and knowledge extraction processes.

Index Terms—LLMs, Anyscale, prompt engineering, document indexing, DuckDB, vector stores, RetrievalQAWithSourcesChain framework, question answering, empirical validation