AUTOSUMM: A Comprehensive Framework for LLM-Based Conversation Summarization
We present AUTOSUMM, a large language model (LLM)-based summarization system to generate accurate, privacy-compliant summaries of customer-advisor conversations. The system addresses challenges unique to this domain, including speaker attribution errors, hallucination risks, and short or low-information transcripts. Our architecture integrates dynamic transcript segmentation, thematic coverage tracking, and a domain specific multi-layered hallucination detection module that combines syntactic, semantic, and entailment-based checks.
Accepted to the Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Industry Track)