Name: Fine-Tuning Large Language Models Using Entity Hallucination Index for Text Summarization (Video) | JoVE Journal
Uploaded: 2026-01-09T13:45:00.000+00:00
Duration: 4 min 16 s
Description: Discover how to fine-tune large language models using the Entity Hallucination Index to reduce factual errors in abstractive text summarization. This computational method improves accuracy without sacrificing informativeness.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

The objective of this study is to fine-tune a language model (LM) to generate summaries with reduced entity hallucination. Hallucinations occur when a model "confidently produces incorrect or irrelevant output" because it generates text according to statistical likelihood rather than factual verification. This is achieved by designing a reward function based on the Entity Hallucination Index (EHI) and applying reinforcement learning to maximize it.
Problem formulation 
Given an input document Xi, the goal is to generate a summary Yi such that entities mentioned in Yi are grounded in Xi. Traditional maximum likelihood training does not explicitly optimize factual consistency. These training methods do not penalize the inclusion of fabricated entities. Therefore, a reward-driven fine-tuning strategy is introduced where the reward is proportional to entity faithfulness, measured using EHI.
Data set and method 
Two corpora are used: firstly, a dialogue transcription dataset of multi-turn meeting transcripts and abstractive gold summaries, and secondly, the XSUM news summarization benchmark22,23. Each dataset was cleaned, flattened, and split into 80% train, 10% validation, and 10% test partitions. Dialogues are rich in informal language and pronouns, whereas XSUM contains concise news articles; the combination allows us to evaluate both in-domain and out-of-domain generalization.
Entity extraction is performed on both source documents and summaries for computing the Entity Hallucination Index (EHI). During fine-tuning, this study exclusively utilize the training split, while validation EHI scores are monitored to select the best checkpoint. Final evaluations are reported on the held-out test set, which remains zero-shot before and after the fine-tuning of the models.
In summary, firstly, transcripts are organized into a flattened format and split the data. The pre-trained model generates baseline summaries. Secondly, EHI is computed using transformer-based NER and the five hallucination factors. During fine-tuning, the model is updated with the EHI reward via LoRa adapters. Finally, summaries are generated using the fine-tuned model and evaluated using EHI, Entity F1, and other metrics (Figure 2). All experiments are reproducible through the provided code and configuration files. Figure 3 shows the stepwise process flow for dataset preparation, baseline summarisation, EHI computation, fine-tuning, and evaluation.
Baseline summarization 
Three pre-trained LLMs are chosen, and their baseline summarizations are captured: Flan-T5, Mistral (Nous-Hermes-2-Mistral-7B-DPO), and DistilBART24,25,26. Each model was run in zero-shot mode to produce an initial summary (Yi) for every input document(xi). Beam search with a beam width of 4 and a length penalty of 1.0 was used to encourage fluent yet concise summaries. These baseline summaries served to estimate the prevalence of hallucination and provided starting points for fine-tuning.
Entity extraction and EHI computation 
Accurately computing the Entity Hallucination Index (EHI) requires robust NER. Initially, Spacy was used for NER operations. It is understood that transformer-based NER models are more accurate, but Spacy was the initial choice for the following reasons: (1) Transformer-based NER models themselves have proven to hallucinate than Spacy. (2) Spacy being statistical brings in computational efficiency in terms of implementation cost and execution time. (3) It also helps us prove that EHI is robust in reducing hallucination even with a weaker NER model. However, given the fact that the experiments are done on established datasets and spaCy's en_core_web_sm model is brittle on colloquial transcripts13. Spacy is replaced with a transformer-based NER model (dslim/bert-base-NER), which is a BERT model fine-tuned on the CoNLL-2003 dataset. BERT-based NER systems have been shown to outperform spaCy models on domain-specific tasks-for example, an Aviation-BERT-NER model reached an F1 of 94.78% while identifying 17 entities compared with 93.73% for spaCy NER that recognized seven entities27. The BERT NER model was configured via Hugging Face Transformers28 and performed case-insensitive matching. To capture pronouns and surface-form variations, this method additionally applied simple rules that map "Mr. Smith" and "Smith" to the same canonical form; however, full coreference resolution remains future work. The comparative analysis of the NER models on a sample of 200 records from XSUM dataset can be inferred from Table 1.
The Entity Hallucination Index (EHI) is calculated as:
<img alt="Equation illustrating energy balance; variables: e^PH_i, e^EF_i; context: thermodynamics." src="/files/ftp_upload/68962/68962eq1.jpg" style="margin: auto;" data-altupdatedat="1784606404000" data-alt="Equation 1">
where PH, EF, OF, NH, LF represent scores corresponding to Positive Hallucination (PH), Extractiveness Factor (EF), Negative Hallucination (NH), Overfocused Entities (OF), and Lost Focus (LF), respectively, for article i.
Details of hallucination factors:
Positive Hallucination (PH): Measures of newly introduced entities that are factually correct and beneficial.
Extractiveness Factor (EF): Measures entities accurately extracted from the input document into the summary.
Negative Hallucination (NH): Captures hallucinated entities that are incorrect or not grounded in the input.
Over Focused (OF): Penalizes summaries that overly focus on a narrow subset of entities, missing diversity.
Lost Focus (LF): Penalizes summaries that omit important entities present in the input.
Computation of above factors is detailed in Figure 4 with a sample computation for illustration purposes. Considering an example of Input Document Entities (I):" John"," AI"," conference" Reference Summary Entities (R):" John"," AI" Generated Summary Entities (G):" John"," AI"," technology". Higher values of EHI indicate better entity faithfulness, rewarding summaries that are both extractive and positively hallucinated (introducing useful but faithful entities), while penalizing ungrounded, excessive, or missing entity20. These factors were normalized by the total number of detected entities to produce an EHI score between 0 and 1. EHI validation was monitored during training to select the best checkpoint. PH and EF reward beneficial new entities and correct extraction, whereas OF, NH, and LF penalize repetition, fabrication, and omission. A perfect score of 1.0 means that all entities in the summary are grounded or beneficially hallucinated, while a score of 0 indicates that no named entity in the summary appears in the source.
Fine - tuning procedure with RL 
The detailed hyperparameter configuration for fine-tuning are provided separately in Table 2, Table 3, and Table 4, which depict optimizer types, learning rates, batch sizes, hardware specifications, and other configuration details for Mistral-7B, DistilBart, and Flan-T5, respectively. The objective here is to fine-tune the model parameters θ by maximizing the expected Entity Hallucination Index (EHI) reward across generated summaries. Formally, for an input document Xi, a generated summary Yi, and model parameters θ the expected reward objective is defined as:
<img alt="Bayesian optimization equation, J(theta)=E_y~p_theta(y|x)[EH1(y,x)], mathematical formula." src="/files/ftp_upload/68962/68962eq2.jpg" style="margin: auto;" data-altupdatedat="1784606404000" data-alt="Equation 2">     (2)
where EHI (y, x) denotes the Entity Hallucination Index computed between the generated summary Yi and the input Xi.
Following the REINFORCE algorithm25, the gradient of this objective is estimated as:
<img alt="Reinforcement Learning: Policy Gradient Equation, Symbolic Representation, θ, pθ, E, ∇θ." src="/files/ftp_upload/68962/68962eq3.jpg" style="margin: auto;" data-altupdatedat="1784606404000" data-alt="Equation 3">      (3)
In practice, summaries were sampled from the models, their corresponding EHI scores were computed, and policy gradient updates were applied to encourage higher-reward outputs. To enable parameter-efficient fine-tuning, this study used Low-Rank Adaptation (LoRA). Only LoRA adapters were updated while the base model weights remained frozen. Fine-tuning was performed on an A100 GPU with a small learning rate (e.g., 5 × 10-6), batch size of 4 and gradient accumulation over 8 steps with Adam optimizer29. Summaries were regenerated every 500 updates to refresh reward estimates, and training continued until validation EHI converged. The REINFORCE baseline was set to the running average of recent rewards to reduce variance. In addition to EHI, Entity F12, ROUGE-1/2/L scores were logged to monitor general quality. Summaries are regenerated periodically to reflect model improvements during fine-tuning.
Evaluation metrics 
The outputs were evaluated using Informativeness metrics like Rouge-1, Rouge-25. Fluency Metric like Rouge LCS5. Entity overlap metric Entity F1, and hallucination metrics like EHI, FactCC, and QAGS2,6,18,30. FactCC uses a classifier trained on synthetic contradiction data to label sentences as entailed or contradicted by the source. The factCC gives two scores; the scores were captured where the label is VALID. On the other hand, QAGS uses a question-and-answer method that runs on an LLM. Light model T5 small was used for generating questions on the text31. Roberta_base_Squad2 was used for generating answers over the output text32. These models were chosen for their convenient computation cost for execution.

<ol><li>Maynez, J., Narayan, S., Bohnet, B., McDonald, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((On+faithfulness+and+factuality+in+abstractive+summarization%5BTitle%5D)+AND+%22Proc+Annu+Meet+Assoc+Comput+Linguist%22%5BJournal%5D)">On faithfulness and factuality in abstractive summarization.</a> Proc Annu Meet Assoc Comput Linguist. 2020, 173-173 (2020).</li>
<li>FEQA: A question answering evaluation framework for faithfulness assessment in abstractive summarization. Durmus, E., He, H., Diab, M. Proc Conf Empir Methods Nat Lang Process, , 454-454 (2020).</li>
<li>A short summary of automatic summarization. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=%22NLG+Blog%22">NLG Blog</a>. , Andong. https://andongluis.github.io/nlg-blog/Summarization-post/ (2018).</li>
<li>Understanding factuality in abstractive summarization. Pagnoni, A., Padmakumar, V., May, J. Proc Conf North Am Chapter Assoc Comput Linguist Hum Lang Technol, 2021, 4812-4829 (2021).</li>
<li>Lin, C. Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((ROUGE%3A+A+package+for+automatic+evaluation+of+summaries%5BTitle%5D)+AND+%22Workshop+Text+Summarization+Branches+Out%22%5BJournal%5D)">ROUGE: A package for automatic evaluation of summaries.</a> Workshop Text Summarization Branches Out. 2004, 74-81 (2004).</li>
<li>Evaluating the factual consistency of abstractive text summarization. Kryściński, W., McCann, B., Xiong, C., Socher, R. Proc Conf Empir Methods Nat Lang Process, 2020, 750-750 (2020).</li>
<li>Goyal, T., Durmus, E., Cardie, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Fact+checking+summarization+with+self+supervised+and+few+shot+learning%5BTitle%5D)+AND+%22Proc+Annu+Meet+Assoc+Comput+Linguist%22%5BJournal%5D)">Fact checking summarization with self supervised and few shot learning.</a> Proc Annu Meet Assoc Comput Linguist. 2022, 564-579 (2022).</li>
<li>QuestEval: Summarization asks for fact-based evaluation. Scialom, T., Dray, P. A., Lamprier, S., Piwowarski, B., Staiano, J., Wang, A., Gallinari, P. Proc Conf Empir Methods Nat Lang Process, 2021, 6594-6604 (2021).</li>
<li>Mukesh, K. Hallucinations in abstractive summarization. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aMukesh%2C+K+%22Medium%22">Medium</a>. , https://medium.com/@mukesh.kr/hallucinations-in-abstractive-summarization-b5904bc1c5c5 (2023).</li>
<li>Factual error correction for abstractive summarization models. Cao, M., Dong, Y., Wu, J., Cheung, J. C. K. Proc Conf Empir Methods Nat Lang Process, 2020, 6251-6258 (2020).</li>
<li>Yan, E. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aYan%2C+E+%22Evaluation+%26+hallucination+detection+for+abstractive+summaries%22">Evaluation & hallucination detection for abstractive summaries</a>. , https://eugeneyan.com/writing/abstractive-summarization-evaluation/ (2021).</li>
<li>Uekawa, A. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aUekawa%2C+A+%22Evaluation+metrics+for+summarization%22">Evaluation metrics for summarization</a>. , https://dev.to/akuer/evaluation-metrics-for-summarization-1d7f (2023).</li>
<li>Honnibal, M., Montani, I. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((spaCy+2%3A+Natural+language+understanding+with+Bloom+embeddings+convolutional+neural+networks+and+incremental+parsing%5BTitle%5D)+AND+%22Zenodo%22%5BJournal%5D)">spaCy 2: Natural language understanding with Bloom embeddings convolutional neural networks and incremental parsing.</a> Zenodo. , (2017).</li>
<li>Reinforcement learning from human feedback: Aligning large language models. , At
 <a target="_blank" href="https://neptune.ai/blog/reinforcement-learning-from-human-feedback">https://neptune.ai/blog/reinforcement-learning-from-human-feedback</a> (2023).</li>
<li>Shakil, H., Farooq, A., Kalita, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Abstractive+text+summarization%3A+State+of+the+art%2C+challenges%2C+and+improvements%5BTitle%5D)+AND+%22Neurocomputing%22%5BJournal%5D)">Abstractive text summarization: State of the art, challenges, and improvements.</a> Neurocomputing. 603, 128255-128255 (2024).</li>
<li>AI, Z. Reducing LLM hallucinations: A developer's guide. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aAI%2C+Z+%22GetZep%22">GetZep</a>. , https://www.getzep.com/ai-agents/reducing-llm-hallucinations/ (2025).</li>
<li>Ouyang, L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Training+language+models+to+follow+instructions+with+human+feedback%5BTitle%5D)+AND+%22Adv+Neural+Inf+Process+Syst%22%5BJournal%5D)">Training language models to follow instructions with human feedback.</a> Adv Neural Inf Process Syst. 2022, 27730-27744 (2022).</li>
<li>Entity hallucination index in abstractive summarization-A metric. Praveenkumar, K., Balbantaray, R. C., Vittala, K. P. Proc Int Conf Commun Circuits Syst, 2023, 1-5 (2023).</li>
<li>Multi-reward reinforced summarization with saliency and entailment. Pasunuru, R., Bansal, M. Proc Conf North Am Chapter Assoc Comput Linguist Hum Lang Technol, 2018, 646-653 (2018).</li>
<li>Williams, R. J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Simple+statistical+gradient-following+algorithms+for+connectionist+reinforcement+learning%5BTitle%5D)+AND+%22Mach+Learn%22%5BJournal%5D)">Simple statistical gradient-following algorithms for connectionist reinforcement learning.</a> Mach Learn. 8 (3-4), 229-256 (1992).</li>
<li>Katwe NLP. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=%22EHI_XLSUM_XSUM_Finetuning%22">EHI_XLSUM_XSUM_Finetuning</a>. , GitHub. https://github.com/katweNLP/EHI_XLSUM_XSUM_Finetuning (2025).</li>
<li>ELITR minuting corpus: A novel dataset for automatic minuting from multi-party meetings in English and Czech. Nedoluzhko, A., Singh, M., Hledíková, M., Ghosal, T., Bojar, O. Proc Int Conf Lang Resour Eval (LREC), 2022, 2623-2632 (2022).</li>
<li>Don't give me the details, just the summary! Topic aware convolutional neural networks for extreme summarization. Narayan, S., Cohen, S. B., Lapata, M. Proc Conf Empir Methods Nat Lang Process, 2018, 1797-1807 (2018).</li>
<li>Lewis, M., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Denoising+sequence+to+sequence+pre+training+for+natural+language+generation%2C+translation%2C+and+comprehension%5BTitle%5D)+AND+%22Proc+Annu+Meet+Assoc+Comput+Linguist%22%5BJournal%5D)">Denoising sequence to sequence pre training for natural language generation, translation, and comprehension.</a> Proc Annu Meet Assoc Comput Linguist. 2020, 7871-7880 (2020).</li>
<li>Chung, H. W., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Scaling+instruction+fine-tuned+language+models%5BTitle%5D)+AND+%22J+Mach+Learn+Res%22%5BJournal%5D)">Scaling instruction fine-tuned language models.</a> J Mach Learn Res. 25 (1), 1-53 (2024).</li>
<li>Jiang, A. Q., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Mistral+7B%5BTitle%5D)+AND+%22arXiv%22%5BJournal%5D)">Mistral 7B.</a> arXiv. , (2023).</li>
<li>Chandra, C., Ojima, Y., Bendarkar, M. V., Mavris, D. N. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Aviation+BERT+NER%3A+Named+entity+recognition+for+aviation+safety+reports%5BTitle%5D)+AND+%22Aerospace%22%5BJournal%5D)">Aviation BERT NER: Named entity recognition for aviation safety reports.</a> Aerospace. 11 (11), 890-890 (2024).</li>
<li>Lim, D. S. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aLim%2C+DS+%22bert-base-NER%22">bert-base-NER</a>. , https://huggingface.co/dslim/bert-base-NER (2021).</li>
<li>Adam: A method for stochastic optimization. Kingma, D. P., Ba, J. Int Conf Learn Represent, , (2015).</li>
<li>QAGS: Evaluating question answering and generation for summarization. Wang, A., Cho, K. Proc Conf Empir Methods Nat Lang Process, 2020, 390-402 (2020).</li>
<li>Patil, S. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aPatil%2C+S+%22valhalla%2Ft5-small-qg-hl%22">valhalla/t5-small-qg-hl</a>. , https://huggingface.co/valhalla/t5-small-qg-hl (2020).</li>
<li><a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=%22deepset%2Froberta-base-squad2%22">deepset/roberta-base-squad2</a>. , Deepset GmbH. https://huggingface.co/deepset/roberta-base-squad2 (2020).</li>
<li>Factually consistent summarization via reinforcement learning with textual entailment feedback. Roit, P., et al. Proc Annu Meet Assoc Comput Linguist, 2023, 8027-8044 (2023).</li>
<li>Hallucination diversity aware active learning for text summarization. Xia, Y., et al. Proc Conf North Am Chapter Assoc Comput Linguist Hum Lang Technol, 2024, 3885-3900 (2024).</li>
<li>Wei, Z., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((TruthRL%3A+Incentivizing+truthful+large+language+models+via+reinforcement+learning%5BTitle%5D)+AND+%22arXiv%22%5BJournal%5D)">TruthRL: Incentivizing truthful large language models via reinforcement learning.</a> arXiv. , (2025).</li>
</ol>

The authors have nothing to disclose.

QA-based metrics (e.g., FEQA/QuestEval/QAFactEval) and NLI-based metrics (e.g., FactCC/SummaC) require auxiliary QA/entailment components and often provide sentence-level judgments. In contrast, EHI is a lightweight, reference-free, entity-level score that (i) directly targets the primary failure mode we observe -- entity hallucination; (ii) is model-agnostic and fast to compute; and (iii) serves as a dense reward for RL fine-tuning. Empirically, EHI complements QA/NLI metrics by pinpointing which entities drive factuali...

Abstractive summarization models, powered by large language models (LLMs), have achieved impressive results across various domains. However, a persistent challenge remains hallucination, where generated summaries include incorrect or fabricated information not grounded in the source input1,2. In high-stakes applications such as meeting summarization, medical reporting, or financial documentation, hallucinations, particularly involving named entities, can significantly undermine trustworthiness and utility3.
Researchers conducted a large-scale human evaluation and found that summarizers frequently produce hallucinations -- content that is not supported by the source document -- and that these hallucinations correlate with repetition and incoherence1. Another study showed that models with higher abstractiveness tend to be less faithful; their study reported that outputs with more abstraction had lower factual accuracy and more unfaithful sentences2. The FRANK benchmark reported that roughly 30% of summaries contain factual inconsistencies, and another popular study noted similar error rates, arguing that high hallucination levels render summaries virtually useless1,2. Hallucinations can be categorized as intrinsic (contradicting the source) or extrinsic (not verifiable from the source). A tutorial on hallucinations in abstractive summarization explains that intrinsic hallucinations occur when generated content contradicts the input (e.g., misreporting an approved vaccine as being rejected), while extrinsic hallucinations add unverifiable facts, such as claiming clinical trials for a vaccine that are not mentioned4. It also reported that state-of-the-art summarizers produce hallucinated content in roughly 25% of their outputs when evaluated with ROUGE, BLEU, and METEOR, and cautions that hallucinations can be harmful in domains such as health, law, or cybersecurity.
Traditional n-gram metrics (ROUGE5, BLEU, METEOR) correlate poorly with human judgments of factuality, prompting the development of reference-based and reference-free metrics6. QA-based metrics such as FEQA and QuestEval evaluate summaries by asking whether question-answer pairs derived from the summary can be answered using the source text. FEQA correlates more strongly with human judgments and shows that more abstractive summaries tend to be less faithful, whereas QuestEval substantially improves correlation with human judgments across consistency, coherence, fluency, and relevance. QAFactEval refines this approach by selecting noun-phrase answers and generating questions before answering them; this strategy improves correlation with human assessments on the SummaC benchmark. Information-extraction (IE) metrics represent knowledge as subject-relation-object tuples, but they are vulnerable to errors in the extraction process. Natural language inference (NLI) metrics -- such as FactCC and SummaC -- classify summary sentences as entailed or contradicted by the source4. FactCC uses weakly supervised data to train a classifier that detects factual consistency and highlights inconsistent spans2. SummaC applies NLI models at the appropriate granularity and yields strong factuality estimates, but the FRANK benchmark notes that these metrics still treat factuality as binary and lack a unified framework1,7,8. Human evaluation dimensions proposed by researchers fluency, coherence, relevance and consistency are widely adopted9. Another evaluation study emphasizes that consistency is the most objective dimension because it simply checks whether the summary is entailed by the source; it points out that up to 92% of XSum summaries contain faithfulness errors9,10. However, human evaluation is time-consuming and expensive, so automatic metrics are essential for scalable evaluation8. Current metrics often aggregate intrinsic and extrinsic hallucinations into a single score, hindering error diagnosis4.
Since maximum-likelihood training does not directly optimize for summary quality, reinforcement learning (RL) has been applied to improve relevance and factuality. Pasunuru and Bansal introduced a multi-reward RL framework that combines saliency (ROUGE) and entailment rewards and demonstrated state-of-the-art performance11. RL was applied for extractive summarization using the REINFORCE algorithm; their model maximizes ROUGE scores and yields more informative summaries than classifier-based approaches, as shown by human question-answering evaluations12. Multi-task models further incorporate question generation and entailment generation to ensure coverage and coherence12. A comprehensive 2024 survey on abstractive summarization highlights factual consistency as a fundamental challenge and advocates RL to encourage truthful summarization. The survey suggests rewarding factually consistent summaries and incorporating external knowledge sources and attribute control to enhance accuracy13. RL from human feedback (RLHF) extends this idea by training a reward model on human preferences and fine-tuning the summarizer to maximize this learned reward9. Reinforcement learning from human feedback (RLHF) has gained traction for aligning model outputs with desired qualities, such as factuality and helpfulness4,14.While multi-reward RL and RLHF align models with human notions of fidelity, they rely on coarse metrics like ROUGE or binary factuality. In contrast, the work detailed here proposes using a fine-grained entity-level hallucination index as the reward, which is empirical and computationally less expensive without human feedback.
Despite numerous metrics, several limitations persist. N-gram metrics ignore semantic correctness, QA-based and IE-based metrics propagate errors from question generation and extraction models, and NLI metrics reduce factuality to binary entailment decisions1,4,6. In the research work, it was emphasized that existing model-based metrics struggle to identify hallucinations at a fine granularity because they operate at the sentence or document level and cannot isolate specific entities causing errors4. Human evaluations remain the gold standard but are costly and subjective15. Moreover, existing metrics do not distinguish between intrinsic and extrinsic hallucinations or capture the over and under-focus of relations1. Large language models can hallucinate because they predict text based on statistical likelihood rather than factual verification. Models generate confident but incorrect outputs due to limitations in training data, probabilistic generation and lack of fact-checking, and overconfidence and biases can cause them to state false information with high certainty; the guide advocates retrieval-augmented generation and long-term memory to ground models in external data15. However, these techniques focus on retrieval-based tasks; summarization still requires metrics that identify and penalize hallucinated entities.&#160;Prior work has recognized the importance of entity-level evaluation for factuality. Metrics like FEQA and QuestEval attempt to assess factual consistency using question answering techniques16,17. However, these methods often require reference summaries or external QA systems, limiting scalability. Our work builds on this line by employing the Entity Hallucination Index (EHI), a lightweight empirical metric focusing specifically on named entity faithfulness by categorizing the entities into five types of hallucination factors as depicted in Figure 1.
Evidence indicates that hallucination is pervasive, evaluation metrics are imperfect, and RL techniques lack fine-grained rewards. Human studies show that summarization models hallucinate in a significant fraction of cases, often swapping entities or fabricating details9. Existing metrics either emphasize n-gram overlap or treat factuality as binary, and current RL methods optimize ROUGE or coarse factuality signals. There is a gap for entity-level metrics that measure when a summary mentions entities that are not present in the source (Negative hallucination), omits key entities (Lost focus hallucination), and other scenarios. The proposed fine-tuning method over Entity Hallucination Index (EHI) fills this gap by quantifying hallucinations at the entity level and providing a structured reward for reinforcement learning. By integrating EHI into RLHF, we aim to fine-tune large language models to minimize entity-level hallucination and produce summaries that are both fluent and factually faithful.
In this work, we propose a novel fine-tuning approach that leverages the Entity Hallucination Index (EHI) as a reward signal to reduce hallucinations at the entity level. EHI quantifies the correctness and grounding of entities by comparing extracted entities from model outputs to those present in the input document, enabling a reduction in dependency on references18. The method described here biases the model towards producing more entity-faithful summaries without requiring human factuality annotations.
In summary, factuality-aware reward models have been used for fine-tuning19,20. Unlike previous approaches that rely on coarse factuality rewards or human-labeled datasets, we propose fine-tuning using EHI as a direct, automatic reward signal, thereby promoting entity-grounded summarization without additional supervision. The novel contributions of this study are as follows: (i) the study introduces an EHI-guided fine-tuning framework that improves entity faithfulness in abstractive summarization, (ii) the study presents a scalable reinforcement learning pipeline that does not depend on human-labeled factuality datasets, (iii) the study demonstrates empirical improvements in EHI scores across meeting transcript datasets, XSUM news dataset and conduct qualitative analysis to highlight reductions in hallucination, (iv) the study shares a reproducible Colab-based implementation to facilitate further research on hallucination-aware summarization21.
This study assesses the hypothesis that optimizing language models with fine-grained entity-focused rewards like EHI provides an effective pathway for enhancing faithfulness and reliability in summarization tasks with minimal computation. The approach contributes to the growing field of parameter-efficient fine-tuning for faithfulness in summarization by: (i) demonstrating effectiveness across both encoder-decoder (DistilBART, FlanT5) and decoder-only (Mistral) architectures, (ii) providing a framework that can be adapted to different model types, domains, and scales, and (iii) offering computational efficiency compared to full retraining.

<table><tbody><tr><td>Colab NVIDIA A100 GPU</td><td>NVIDIA</td><td>N/A</td><td>Google Colaboratory Pro</td></tr><tr><td>DistilBART (Encoder&amp;ndash;Decoder)</td><td>Hugging Face</td><td>https://huggingface.co/sshleifer/distilbart-cnn-12-6</td><td></td></tr><tr><td>dslim/bert-base-NER</td><td>Hugging Face (dslim)</td><td>https://huggingface.co/dslim/bert-base-NER</td><td>Fine-tuned BERT base for English NER</td></tr><tr><td>Evaluation Models&amp;nbsp; QAGS (QA-based)</td><td>Salesforce Research</td><td>N/A</td><td>Factuality classifier</td></tr><tr><td>Evaluation Models (Factuality) FactCC</td><td>Google Research</td><td>N/A</td><td>Factuality classifier</td></tr><tr><td>Flan-T5 (Encoder&amp;ndash;Decoder)</td><td>Google</td><td>https://huggingface.co/docs/transformers/main/en/model_doc/flan-t5</td><td>open-source, text-to-text, large language model</td></tr><tr><td>Hugging Face Transformers</td><td>Hugging Face, Inc.</td><td>https://huggingface.co/docs/transformers/index</td><td>Model loading &amp;amp; fine-tuning</td></tr><tr><td>Nous-Hermes-2-Mistral-7B-DPO</td><td>Mistral</td><td>https://huggingface.co/NousResearch/Nous-Hermes-2-Mistral-7B-DPO</td><td>7 billion parameter Language model</td></tr><tr><td>Programming Language&lt;br/&gt; Python 3.10 (Colab runtime)</td><td>Python Software Foundation</td><td>Version 3.10</td><td>Core implementation</td></tr><tr><td>Streamlit</td><td>Open Source&amp;nbsp;</td><td>https://streamlit.io/</td><td>Factuality classifier</td></tr><tr><td>XLSUM dataset</td><td>BUET</td><td>https://github.com/csebuetnlp/xl-sum</td><td></td></tr><tr><td>XSUM dataset</td><td>University of Edinburgh</td><td>https://github.com/EdinburghNLP/XSum</td><td></td></tr></tbody></table>

fine-tuning large language models using entity hallucination index for text summarization

Fine-Tuning Large Language Models Using Entity Hallucination Index for Text Summarization

Recent advancements in large language models (LLMs) have led to notable improvements in abstractive summarization quality. However, hallucination - especially entity-level hallucination where non-existent or incorrect entities are introduced - remains a critical challenge. In this work, we propose a reward-driven fine-tuning framework for summarization models using the Entity Hallucination Index (EHI) as a guiding metric. The methodology here begins with generating initial summaries from pre-trained models such as Flan-T5, DistilBART, and Mistral (or other popular LLM) on structured transcript datasets, XSUM. We compute EHI by extracting named entities from both generated summaries and gold references, evaluating precision, and penalizing fabricated entities. The fine-tuning process is guided by reinforcement learning, where EHI serves as the reward signal. We adopt a REINFORCE-style update mechanism to optimize the summarization model towards maximizing entity faithfulness. Experiments demonstrate that models fine-tuned with EHI achieve lower hallucination rates without compromising informativeness. Furthermore, we show that EHI-guided models generalize better on out-of-domain summarization tasks, suggesting enhanced robustness. The approach here offers a practical direction for improving factuality in summarization, emphasizing the critical role of accurate entity representation.

The experiments here focus on quantitative evidence for the impact that EHI-guided fine-tuning makes in reducing entity-level hallucinations across multiple model architectures and datasets. The results demonstrate consistent improvements in hallucination metrics while maintaining factual consistency and preserving question-answering capabilities.
Dataset performances 
Dialogue dataset performance: 
Table 5 presents the results for hallu...

We propose a reinforcement-learning-based fine-tuning approach for large language models that uses the Enti&#8239;Hallucination&#8239;Index (EHI) as a reward signal to reduce entity-level hallucination in text summarization. Experiments on meeting transcripts show that this method improves entity faithfulness and accuracy.

Recent advancements in large language models (LLMs) have led to notable improvements in abstractive summarization quality. However, hallucination - ...

This study uses the Entity Hallucination Index as a reward signal to reduce incorrect entity generation in AI-summarized text. Current metrics are two coarse, this protocol employs fine-grained entity rewards to improve factuality without human labels. To begin, use two primary corpora, including a dialogue transcription data set of multi-turn meeting transcripts and the XSum News summarization benchmark.Clean each data set, flatten the data, and partition it into 80%training, 10%validation, and 10%test sets. Perform tokenization and entity extraction using a transformer-based NER model D slim/BERT-based NER to ensure robust grounding. Generate initial summaries in zero shot mode using beam search with a width of four to estimate baseline hallucination prevalence.Compute the entity hallucination index as a reference-free entity level metric that categorizes entities into five factors to quantify faithfulness. Reward extractiveness and positive hallucinations and penalize negative hallucinations, over-focused entities, and lost focus. Define the reward function to be proportional to entity faithfulness and maximize the expected EHI reward across generated summaries.Apply a reinforced style update mechanism to optimize model parameters toward maximizing entity faithfulness. Use low rank adaptation to enable parameter efficient fine tuning and update only the LoRA adapters while keeping the base model weights frozen. Then apply policy gradient updates to encourage higher reward outputs and regenerate summaries for every 500 updates to refresh reward estimates.Finally, generate final summaries using the fine-tuned models and compare them against baseline results. Evaluate models for informativeness using Rouge one, Rouge two, and Rouge L, fluency and factual consistency using fact CC and CAGs. EHI fine tuning reduced hallucinations and improved factuality across models and data sets with rightward shifts in EHI, and fact CC distributions confirming increased entity faithfulness and factual consistency, while CAGS scores remained largely unchanged.The harmful hallucination types of negative, over focus, and lost focus were reduced in Mistral after fine-tuning, while the extractiveness factor almost doubled. Correlation analysis showed EHI and CAGS had a weak correlation in Mistral and DistilBART, but Flan-T5 showed a stronger positive correlation. Researchers can measure entity level faithfulness and hallucination rates in summaries using the automated EHI reward signal.The most critical challenge is NER accuracy, as extraction errors can propagate into incorrect reward calculations during training. Future studies can integrate co-reference resolution and informativeness rewards to better balance faithfulness with summary coverage.

fine-tuning-large-language-models-using-entity-hallucination-index

Research

JoVE Journal

Engineering

In this protocol, foundation large language model response quality is improved via augmentation with peer-reviewed, domain-specific scientific articles through a vector embedding mechanism. Additionally, code is provided to aid in performance comparison across large language models.

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Organic photovoltaic (OPV) materials are inherently inhomogeneous at the nanometer scale. Nanoscale inhomogeneity of OPV materials affects performance of photovoltaic devices. In this paper, we describe a protocol for quantitative measurements of electrical and mechanical properties of OPV materials with sub-100 nm resolution.

Concurrent Quantitative Conductivity and Mechanical Properties Measurements of Organic Photovoltaic Materials using AFM

This paper demonstrates a protocol for recasting experimental simplified model limits into conservative and aggressive limits on an arbitrary new physics model. Publicly available LHC experimental results can be recast in this manner into limits on almost any new physics model with a supersymmetry-like signature.

Setting Limits on Supersymmetry Using Simplified Models

A methodology for preparing solid-state nanopores in solution for biomolecular translocation experiments is presented. By applying short pulses of high electric fields, the nanopore diameter can be controllably enlarged with subnanometer precision and its electrical noise characteristics significantly improved. This procedure is performed in situ using standard laboratory equipment under experimental conditions.

Fine-tuning the Size and Minimizing the Noise of Solid-state Nanopores

Physical models of biomolecules can facilitate an understanding of their structure-function for the researcher, aid in communication between researchers, and serve as an educational tool in pedagogical endeavors. Here, we provide detailed guidance for the 3D printing of accurate models of biomolecules using fused filament fabrication desktop 3D printers.

3D Printing of Biomolecular Models for Research and Pedagogy

This method aims at locating vertical subsurface defects. Here, we couple a laser with a spatial light modulator and trigger its video input to heat a sample surface deterministically with two anti-phased modulated lines while acquiring highly resolved thermal images. The defect position is retrieved from evaluating thermal wave interference minima.

Subsurface Defect Localization by Structured Heating Using Laser Projected Photothermal Thermography

Through the sulfurization of pre-deposited transition metals, large-area and vertical 2D crystal hetero-structures can be fabricated. The film transferring and device fabrication procedures are also demonstrated in this report.

Preparation of Large-area Vertical 2D Crystal Hetero-structures Through the Sulfurization of Transition Metal Films for Device Fabrication

This article shows the method for the surgical placement in mice of an intraperitoneal catheter attached to an access port that is positioned at the back of the animal. Moreover, it explains the procedure for a 5/6 nephrectomy to resemble the uremic state of PD patients.

Surgical Techniques for Catheter Placement and 5/6 Nephrectomy in Murine Models of Peritoneal Dialysis

A protocol is presented demonstrating a two-step fabrication technique to grow large-sized single-layer rectangular shaped SnSe flakes on low-cost SiO2/Si dielectrics wafers in an atmospheric pressure quartz tube furnace system.

Atmospheric Pressure Fabrication of Large-Sized Single-Layer Rectangular SnSe Flakes

This protocol describes the fabrication of microfluidic devices from MY133-V2000 to eliminate artifacts that often arise in microchannels due to the mismatching refractive indices between microchannel structures and an aqueous solution. This protocol uses an acrylic holder to compress the encapsulated device, improving adhesion both chemically and mechanically.

Fabrication of Refractive-index-matched Devices for Biomedical Microfluidics

Discover how to fine-tune large language models using the Entity Hallucination Index to reduce factual errors in abstractive text summarization. This computational method improves accuracy without sacrificing informativeness.

Fine-Tuning Large Language Models Using Entity Hallucination Index for Text Summarization

Explore More Videos