A subscription to JoVE is required to view this content. Sign in or start your free trial.

Research Article

Case-Based Reasoning with Deep Learning for a Hybrid Approach to Legal Text Summarization

483 views

DOI:

10.3791/69287

December 12th, 2025

In This Article

Summary

This protocol integrates Case-Based Reasoning (CBR) with multi-stage transformer models to summarize legal texts. It preprocesses legal cases, retrieves similar precedents, adapts reasoning structures, and generates accurate, coherent summaries. Applications include legal research, judgment analysis, and decision-support systems, ensuring factual consistency and domain-specific reasoning fidelity.

Abstract

Legal documents are known to be long and complicated, which makes it essentially impossible for legal practitioners and researchers to quickly identify and extract relevant information. Here, a hybrid approach is presented that outperforms prior extractive and abstractive baselines on both lexical overlap and domain-specific reasoning metrics, which uses Case-Based Reasoning (CBR) for legal texts and concrete deep learning techniques for summary representation, accurately and efficiently producing summaries. Using a larger dataset of 4,968 legal cases from Kaggle, a multi-stage transformer architecture was constructed on top of the general CBR retrieval model created before to produce brief summaries along with CBR for context comprehension. The system was evaluated on legal outcome prediction and coherence of summary, with results showing performance superior to existing extractive and abstractive methods and trained the proposed model until 98% accuracy of legal entities, along with 46% more coherent legal corpus (baseline-enhanced) than state-of-the-art methods, compared using ROUGE scores above previous types by 23%. This study presents a hybrid legal text summarization framework that integrates CBR with transformer-based models. Extensive experiments show superior performance over recent baselines, achieving higher factual accuracy, reasoning fidelity, and legal entity preservation.

Introduction

The extensive legal documentation has necessitated advanced methods to retrieve pertinent data in a timely manner. Legal text summarization is important for improving accessibility and decision-making. Legal opinions, judgments, and precedents are so verbose that judges, practitioners, and researchers can have a difficult time working their way through them, thus leading to the development of automated methods to summarize these documents in an accurate and efficient manner1.

Despite their state-of-the-art performance in more general cases, existing summarization methods struggle to capture the unique complexity and legal jargon that characterizes legal documents. Simply picking the top sentences without rearranging merely based on the log-likelihood obtains good ROUGE scores but loses to the context and the complete semantics. Abstractive approaches use natural language generation to compose the coverage, so they can capture the contextual nuance, but they struggle to preserve the logical thought process and legal reasoning of courtroom cases2. The proposed method is particularly effective for long-form legal case texts containing structured sections (e.g., facts, arguments, precedents, and judgments). It excels when applied to corpora with explicit citations and standardized formatting, such as appellate or supreme court decisions. However, performance may be limited to noisy or unstructured datasets (e.g., scanned PDFs with OCR errors, or documents lacking clear rhetorical segmentation). Thus, the method is best suited for well-structured digital case repositories where both linguistic and citation features are accessible3.

The proposed superior hybrid framework that combines case-based reasoning (CBR) with the advanced Natural Language Processing (NLP) is used to generate a summary. It uses a multi-stage transformer architecture with legal domain-specific attention layers and proposes a cross-document reasoning module. CBR allows the system to load similar past cases that can be used for examining all contextual variables for legal reason4. The proposed model achieved superior accuracy compared with state-of-the-art baselines, as demonstrated by quantitative gains across ROUGE, BLEU, and Legal-SemSim metrics, and validated by human expert evaluation. For instance, the proposed model outperformed Legal-BART and PALM-Law by margins of 15%-20% on reasoning chain accuracy. Embracing general representations and sophisticated approaches adds case-specific knowledge alongside neural summarization and divining 98% precision for legal entity recognition and 97% for precedent retrieval, vastly exceeding previous works5.

Related work

Legal text summarization, a subdomain of natural language processing (NLP), has gained increasing attention due to the growing demand for efficient legal document processing, including judicial opinions, statutes, and case law. The primary challenge lies in preserving semantic integrity, legal reasoning, and domain-specific context in the generated summaries. Prior research spans across extractive, abstractive, and hybrid approaches, with recent emphasis on domain-adapted neural architectures6.

Literature review

Legal text summarization has evolved as a critical area within natural language processing, driven by the pressing need to make voluminous, complex legal documents accessible and actionable. The domain's literature reflects a trajectory from surface-level extractive models to sophisticated hybrid architectures that attempt to balance fluency, factual integrity, and legal logic. Early efforts focused on extractive summarization techniques, which prioritized sentence importance based on lexical similarity and statistical patterns. Though effective in selecting legally salient fragments, these approaches, such as TextRank and LexRank, often ignore the deeper semantic structure and fail to capture the rhetorical and argumentative layers essential in legal reasoning6. As legal texts differ markedly from general corpora due to their rigid semantics and domain-specific expressions, these models produced summaries that lacked coherence and contextual adequacy. With the advent of pre-trained transformer architectures, the research focus shifted to abstractive methods. Models like BART, T5, and PEGASUS began to exhibit the capacity to synthesize summaries using learned language generation patterns. Their legal adaptations, such as LegalBART and LegalPEGASUS, further refined the performance by incorporating law-specific pretraining corpora7. However, abstractive methods continued to suffer from limitations in reasoning consistency and explainability-challenges particularly problematic in legal settings, where even minor factual deviations can lead to misinterpretation.

Hybrid models emerged in response to these deficits, incorporating symbolic reasoning or retrieval-based strategies to improve contextual grounding. A notable direction was the integration of CBR, where knowledge from precedent cases was utilized to contextualize the summary generation process. These models attempt to retain the factual rigor of extractive methods while generating linguistically coherent and legally valid outputs8.

Recent trends emphasize multi-stage architectures that combine legal entity recognition, cross-document reasoning, and rhetorical role parsing, suggesting a shift towards holistic document understanding rather than mere summarization. Research now increasingly considers legal ontology alignment, domain-specific evaluation metrics (e.g., Legal-SemSim), and human-centric evaluation to assess the quality and usability of summaries for legal professionals9.

Recent surveys, such as Exploring LLMs Applications in Law in 2023 and Exploring the Use of LLMs in the Italian Legal Domain in 2024, highlight the growing role of large language models (LLMs) in automating legal reasoning, summarization, and retrieval tasks10. These works emphasize not only the capacity of LLMs like GPT-4, PaLM, and LLaMA to capture contextual nuances of legal discourse but also the challenges of domain adaptation, explainability, and factual consistency11. Hybrid systems that integrate retrieval-augmented generation (RAG) or CBR with LLMs are increasingly being explored to combine the strengths of precedent-aware reasoning with the generative fluency of transformers6. Positioning the work within this trend, proposed multi-stage hybrid model extends prior retrieval-augmented frameworks by explicitly encoding legal reasoning chains, while maintaining coherence through transformer-based abstractive summarization.

Despite significant progress, there remains a gap in models that can synthesize factual, logically structured, and domain-consistent legal summaries while maintaining interpretability12. The present work addresses this void by proposing a multi-stage hybrid approach grounded in legal CBR and deep neural architecture, offering a model that is both accurate and practically usable.

Extractive summarization approaches

The term extractive summarization is used for methods that extract and stitch together the most informative sentences from the document. Graph-based algorithms, e.g., TextRank13 and LexRank14, are traditional approaches that rank sentences based on their importance. Though computationally feasible, such approaches typically struggle with complex legal reasoning and argumentation8. With the advent of pre-trained language models, BERT-based methods like BERTSUM8 demonstrated significant improvements. BERTSUM fine-tunes BERT embeddings for sentence-level extractive summarization, capturing contextual nuance better than statistical models9. Legal domain adaptations such as Legal-BERTSUM further refined performance by incorporating legal-specific corpora, enabling improved legal term recognition and sentence selection. Nonetheless, extractive methods are limited in reconstructing the argumentative flow or legal reasoning chain, particularly when sentences are interdependent or references are implicit15.

Abstractive summarization approaches

Abstractive summarization generates novel phrases and sentences that rephrase the source content, often using encoder-decoder architectures. The BART model4 and PEGASUS7 are leading examples of pre-trained sequence-to-sequence models applied to general-purpose summarization. These have been adapted for the legal domain through fine-tuning on legal corpora-resulting in models like Legal-BART and Legal PEGASUS16,17. These models produce more fluent and human-like summaries and are better at capturing contextual meaning than extractive approaches18.

However, their application in legal summarization poses challenges. Abstractive models often struggle with factual consistency and preservation of legal semantics. Misinterpretation of legal clauses or omission of key legal entities can render a summary misleading19. Furthermore, neural text generation models are generally opaque, raising issues around explainability and verifiability, both of which are critical in legal domains.

Hybrid summarization models

To leverage the strengths of both paradigms, hybrid summarization models integrate extractive and abstractive components. One early strategy was to use extractive modules to select candidate sentences, which are then refined by an abstractive decoder. More recently, transformer architecture has been combined with knowledge-infused modules to enhance legal comprehension5.

CBR has emerged as a promising hybrid strategy. Waterworth pioneered the use of prior cases to inform current decisions, and its integration with neural models enables semantic enrichment through analogical reasoning6. In legal summarization, combining CBR with transformers allows for both contextual reuse and abstract synthesis. Models like BART+CBR integrate retrieval-based legal context with generative mechanisms, offering improved coherence and legal relevance20.

The proposed Multistage + CBR architecture builds on this line of work by embedding domain-specific reasoning chains into the summarization pipeline. It features hierarchical transformer blocks, cross-document attention, and CBR-enhanced retrieval layers, tailored specifically for legal applications. This multi-layered design facilitates both fine-grained content understanding and macro-level structure preservation21.

Legal-specific challenges and considerations

Legal documents exhibit unique structural and linguistic features, including hierarchical formatting, cross-referencing of precedents, statutory citations, and domain-specific terminology22. Summarization models must therefore not only handle syntactic and semantic complexities but also respect logical coherence and legal argument progression23. Effective summarization in this context hinges on accurate legal entity recognition, reasoning structure preservation, and interpretation of rhetorical roles such as facts, arguments, and judgments.

Legal ontologies and citation networks have been employed to improve domain understanding. For instance, integrating structured legal knowledge bases during model training has been shown to enhance legal entity linking and citation consistency24. These efforts contribute to summarizing models that better align with legal practitioners' expectations25.

Another challenge is interpretability. In legal settings, output must be auditable and interpretable. Hence, explainable AI (XAI) frameworks such as LIME and SHAP are increasingly explored to justify summarization decisions, though integration with large-scale models remains an ongoing research challenge26.

Evaluation metrics in legal summarization

Standard summarization metrics such as ROUGE8, BLEU27, and METEOR are commonly used for lexical overlap evaluation. However, these measures are insufficient for capturing semantic fidelity, legal consistency, and argumentative coherence.

Recent efforts introduce domain-specific metrics like Legal-SemSim, which incorporates legal ontologies to assess semantic similarity, and reasoning chain accuracy, which evaluates preservation of logical flow and conclusion validity28. Human expert evaluation remains indispensable, particularly for measuring legal correctness, coherence, and actionability. Inter-annotator agreement using metrics such as Fleiss' Kappa ensures reliability of qualitative assessments29.

Recent advancements and future directions in legal summarization

Legal summarization research is moving toward more robust, context-aware, and explainable systems. Hybrid symbolic-neural architectures that integrate rule-based reasoning with transformer models are gaining traction. These systems maintain the interpretability of logic-based approaches while benefiting from the generalization capacity of deep learning28.

Multilingual legal summarization is another emerging frontier, addressing the global nature of legal texts and proceedings30. Temporal reasoning, necessary for understanding time-dependent legal sequences, and argumentative discourse modeling are also under exploration9.

Moreover, advancements in contrastive learning and curriculum learning are being used to enhance model generalization across diverse legal domains17. By gradually increasing task complexity and differentiating fine-grained semantic classes, these techniques improve the model's robustness in real-world scenarios31.

Access restricted. Please log in or start a trial to view this content.

Protocol

This protocol uses publicly available legal datasets. No sensitive personal or confidential data were used. The study complies with institutional ethical guidelines for the use of legal corpora in research (Koneru Lakshmaiah Education Foundation (Deemed to be University), Hyderabad, Telangana, India, Approval No.: KLEF/CS/2024/IRB-017). The study uses a dataset of 4,968 legal cases, each with inclusive annotations. Table 1 shows the dataset description.

precedent_citationsStructured citations to precedent cases
reasoning_chainsAnnotated logical reasoning sequences

Table 1: Dataset attribute description.

Dataset for the study

After pre-processing, the dataset is normalized to standardize outcomes. The length of the case texts ranges between 1,000 and 5,000 words, comprehensive for training and evaluation. We gathered case results into primary labels according to their frequency in the dataset, allowing us to explore summarization performance across different legal contexts. Annotation was conducted by a team of five legal professionals, including three practicing attorneys and two doctoral researchers specializing in legal informatics. Each case was independently annotated by two experts, with conflicts resolved by a senior annotator. The annotation schema included legal entities, precedent citations, and reasoning chains. Inter-annotator agreement was measured using Fleiss' Kappa (κ = 0.82), indicating strong consistency across annotators. This process ensured both the legal validity and reproducibility of the dataset.

Dataset distribution

The dataset includes cases that contain various legal domains, as shown in Table 2.

Legal DomainNumber of CasesPercentage
Contract Law1,27825.70%
Intellectual Property1,05321.20%
Constitutional Law51210.30%
Administrative Law4328.70%
Criminal Law3086.20%
Tort Law2194.40%
Other/Miscellaneous1,16623.50%

Table 2: Cases containing various legal domains.

The distribution of case outcomes across the dataset is shown in Table 3.

Case OutcomeCountPercentage
Cited2,46049.20%
Referred to85517.10%
Followed4719.40%
Applied4478.90%
Considered3537.10%
Other outcomes3828.30%

Table 3: Distribution of case outcomes across the dataset.

Therefore, it confirmed a sensible depiction across domains in training, validation, and test splits using stratified sampling to prevent domain-specific biases. The dataset was divided into training (80%), validation (10%), and test (10%) sets.

Text length distribution

The analysis of the text length distribution is presented in Table 4.

Length Range (words)CountPercentage
Under 5004659.40%
500-1,0001,35927.40%
1,000-5,0002,69854.30%
5,000-10,0003236.50%
Over 10,0001543.10%

Table 4: Analysis of the text length distribution.

This distribution highlights the variety in document lengths, with the majority falling in the medium-length range (1,000-5,000 words), which presents an appropriate challenge for summarization techniques.

Enhanced data pre-processing

The preprocessing pipeline was informed by recent studies on the impact of preprocessing in transformer-based legal NLP tasks. Chalkidis et al. demonstrate that domain-aware tokenization and citation normalization significantly improve downstream summarization accuracy30. Similarly, Bommarito and Katz show that preprocessing choices, particularly entity normalization, directly affect transformer performance in legal summarization32. Based on these insights, the pipeline employed section-aware tokenization, legal citation normalization, and rhetorical role parsing to maximize contextual coherence. A novel pre-processing pipeline was developed, integrating general pre-processing methods and domain-specific techniques to obtain high-quality legal text and filter out a few cases of empty or very short case text fields at first, in order to ensure the integrity of the data. Next, input normalization was done, where legal tokenization rules were employed to ensure input usability33. Key entities were extracted using a custom high-performing legal entity recognition Legal Entity Recognition (LER) model (F1 score of 98%), and discourse parsing techniques were used to grasp structural elements. To enhance precedent analysis, a citation graph construction step was introduced. Other pre-processing steps are domain-specific to the regular expression parsers, validating that their input precisely corresponds to the very strict formats for standardized legal citations. Section-aware tokenizers for hierarchical document structures were applied, and a fine-tuned RoBERTa classifier labeled with rhetorical roles like facts, arguments, and decisions was added for each legal text. This wider pipeline lets us trivially augment the downstream tasks like legal text retrieval, reasoning, and summarization.

Advanced case-based reasoning module

The study presents for the first time a stepping-up application of a state-of-the-art Case-Based Reasoning (CBR) system that can use semantic similarity as well as knowledge about the legal domain to deliver relevant and comparable cases with a 98% retrieval accuracy on the benchmark dataset. Enhanced Case Representation encodes each case with a hybrid vector that combines contextualized embeddings - produced by a domain-focused BERT model on legal text - with structural embeddings that reflect the position of elements in the document, entity-aware embeddings that emphasize the legal relations present in the cases, and citation network embeddings that represent how precedents are bound together. Multi-stage case retrieval acts as a multi-step approach by first performing Approximate Nearest Neighbor (ANN) search to get seed candidates, applying cross-attention to get optimal matches from candidates, and using a domain-specific scoring function and ensemble-based relevance scoring to select the best-case retrievals. During the Advanced Case Adaptation Stage (ACAS), the system extracts reasoning patterns through a graph-based representation template that captures logical dependencies among legal arguments. It then identifies precedent relevance via citation analysis, weighing each case component according to its contextual importance to the query. Finally, the argumentation structure is maintained using discourse parsing-based methods to ensure the logical flow of legal reasoning is preserved. The final module, the Knowledge Integration module, aids retrieval through legal ontologies, records temporal precedent relationships, and retains validity in complex chains of legal reasoning. The proposed CBR system achieves a 98% correct retrieval rate, which is higher than previously reported benchmarks (e.g., LexGLUE, 92%-95%) for the retrieval and adaptation of legal cases.

Multi-stage transformer architecture

Based on the references mentioned above, the study proposes an artificial neural network-based method on a transformer-based multi-stage architecture model that takes advantage of the best elements of all the mentioned algorithms to improve the automated processing, reasoning, and summarization of legal documents. The document understanding stage uses a BERT encoder adapted to the legal domain, hierarchical attention mechanisms, and modules for legal entity recognition, relationship extraction, and citation graph processing to gain deep structural and contextual understanding of legal documents. The cross-document reasoning stage assists in case-based reasoning by linking queries with retrieved cases through a cross-attention mechanism in the form of extracting and validating legal reasoning chains, a model of precedent application, and preservation of argumentation structure. SBERT and Bi-LSTM were used in the sentence embedding formation level, while a custom decoder with legal domain constraints was used in the abstract summary generation level to accurately maintain legal terms, factual consistency, and hierarchy in the summary as per legal writing requirements. By splitting the process into different stages, it can ensure document processing preserves factual consistency, contextual coherence, and fidelity citation. The proposed model training process is shown in Table 5.

HyperparameterValue
Batch size32
Learning rate3e-5 with warmup
Epochs15
Max sequence length2048 tokens
Dropout rate0.15
Gradient accumulation8 steps
Warmup steps1000
Weight decay0.01
Label smoothing0.1

Table 5: Model training process.

To enhance model performance and generalization, we have implemented multiple advanced training techniques, which are covered in detail. It employed curriculum learning to gradually increase task complexity, enabling the model to acquire basic skills before tackling more challenging instances. By conducting experiments on the training dataset, the researcher confirmed that fine-tuning successfully refined semantic representations by helping the model differentiate between highly similar and dissimilar data, thus increasing its understanding of the dataset. With respect to multi-task learning, summarization was coupled with an auxiliary task(s), e.g., classification or entailment recognition, that fostered a more comprehensive sense of the legal domain. Transfer of important knowledge through knowledge distillation that retains high-level knowledge without making the model huge has already been transferred for larger domain-focused models7.

Multi-stage hybrid legal summarization methodology

To operationalize the proposed framework, stepwise algorithm 1 is presented, representing the multi-stage hybrid legal summarization methodology.

Algorithm 1:
Algorithm: Multi-Stage Hybrid Legal Summarization
Input: Legal Case Dataset D with fields {case_text, legal_entities, citations, outcome}
Output: Summary S for each case with legal reasoning preserved
Begin
// Stage 1: Data Preprocessing
For each case in D:
Normalize the text to remove noise and unify formatting.
Apply Legal Entity Recognition (LER) to extract legal entities.
Build a citation graph from referenced precedents.
Tokenize the text using domain-aware legal tokenization rules.
NOTE: If the input corpus contains noisy or incomplete texts, perform additional normalization such as stop-word filtering or section segmentation.

// Stage 2: Case-Based Retrieval
For each case:
Generate contextual embeddings using a domain-adapted BERT encoder.
Generate structural embeddings based on section position.
Generate citation network embeddings.
Retrieve similar past cases using Approximate Nearest Neighbor (ANN) search.
Refine retrieved cases using cross-attention scoring and ensemble-based relevance ranking.

// Stage 3: Case Adaptation
For each retrieved case:
Extract reasoning patterns using discourse parsing.
Identify relevant legal arguments and assign weights based on their importance.
Preserve the argumentation flow during adaptation.
NOTE: If precedent cases contain irrelevant or contradictory arguments, exclude them during adaptation.

// Stage 4: Multi-Stage Transformer-Based Summarization
For each input case and its adapted precedents:
Encode the input case using a legal-domain BERT encoder with hierarchical and entity-aware attention.
Apply cross-document reasoning between the query and retrieved cases.
Encode sentences using SBERT and Bi-LSTM for enhanced contextual embeddings.
Decode the summary using a domain-constrained decoder to preserve factual and legal accuracy.

// Stage 5: Output and Validation
For each generated SHORT ABSTRACT:
Validate the generated summary for coherence, factual correctness, and legal reasoning fidelity.
Return the finalized summary S.
NOTE: If expert validation is required, include an additional human-in-the-loop review step before deployment.
End

To setup the computing environment, Python 3.10 was installed. Installation requires libraries: PyTorch (v2.0), Hugging Face Transformers (v4.32.0), SpaCy (v3.6), NLTK (v3.8.1), NetworkX (v3.1), DGL (v1.1). The GPU support was configures(two GPUs with 40 GB memory each). See Table of Materials for exact versions and sources.

The legal case dataset (≈ 5,000 cases) was downloaded from the specified dataset source and each case was verified to include fields: facts, arguments, citations, and judgment outcome. Store documents in UTF-8 plain text format. Removal of empty or short texts using a Python script (preprocess.py) was done. Removal of noise and unification of formatting of text was carried out. Legal-domain tokenization was applied with SpaCy (spacy.load("en_core_legal_sm")). Legal Entity Recognition was performed using a fine-tuned BERT model (transformers.pipeline("ner", model="legal-bert-ler")). A citation graph was built with NetworkX (nx.DiGraph()), linking nodes by referenced precedents. If OCR-based documents are included, an additional text cleaning script (ocr_clean.py) was run.

Contextual embedding was generated with a domain-specific BERT model (bert-legal) and citation embeddings were generated using DGL graph encoders. Approximate Nearest Neighbor search was performed using FAISS (faiss.IndexFlatIP). Cross-attention scoring was applied with a PyTorch module (CrossAttentionScorer) and the results obtained were ranked by ensemble weighting of contextual and citation similarity. The discourse structure was parsed using a rhetorical role classifier (roberta-legal-rhetoric) and relevant reasoning patterns were extracted by aligning rhetorical roles. Weights were assigned to argument segments based on frequency and citation strength. Exclude contradictory or irrelevant precedents.

Documents were encoded with a domain-adapted BERT encoder and hierarchical attention modules was applied (implemented in hierarchical_encoder.py). SBERT and Bi-LSTM (sentence-transformers package) were used for sentence embeddings. Abstractive summaries were decoded using a constrained decoder (legal_decoder.py). Limit maximum sequence length to 2048 tokens. To train the model, set batch size = 32, learning rate = 3e-5, Train for 15 epochs with gradient accumulation (8 steps), Apply dropout = 0.15 and weight decay = 0.01, Enable label smoothing = 0.1. Modify hyperparameters in train_config.json.

To evaluate performance, compute ROUGE (1,2, L) using rouge_score library, BLEU using nltk.translate.bleu_score, and BERTScore using bert_score package. Evaluate Legal-SemSim using ontology-based semantic similarity scripts and entity F1 using SpaCy and gold annotations. Runtime efficiency (seconds per fold) was recorded, and the summaries were compared against gold references. Two legal experts were asked to review factual correctness and the final validated summaries of results were saved. Following this protocol will produce domain-specific legal summaries that preserve legal reasoning, factual accuracy, and citation fidelity.

Access restricted. Please log in or start a trial to view this content.

Results

Evaluation metrics

The system was evaluated using a comprehensive set of metrics, which is shown in Table 6.

Metric CategorySpecific MetricsDescription
Lexical OverlapROUGE-1, ROUGE-2, ROUGE-LMeasures n-gram overlap between generate...

Access restricted. Please log in or start a trial to view this content.

Discussion

The effectiveness of the CBR augmentation to the multi-stage transformer design has been achieved by establishing a new performance benchmark in legal domain text summarization. The results indicate a significant improvement in ROUGE scores of 78.4 ROUGE-1, 54.8 ROUGE-2, and 75.3 ROUGE-L, and domain-specific metrics of 98% legal entity recognition F1. To further validate the contribution of each component, introduced CBR-only and Transformer-only baselines. The CBR only baseline exhibited strong factual accuracy an...

Access restricted. Please log in or start a trial to view this content.

Disclosures

The authors declare that no potential conflicts of interest related to the content of this study.

Acknowledgements

The authors express their sincere gratitude to the Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation (Deemed to be University), Hyderabad, Telangana, India, for providing the computational facilities and research infrastructure essential to this work. Special thanks are extended to the legal experts and domain specialists who contributed to the annotation and evaluation of the legal corpus used in this study.

Access restricted. Please log in or start a trial to view this content.

Materials

List of materials used in this article
NameCompanyCatalog NumberComments
CPU HardwareAMD EPYC 7742 (64-Core, 2.25 GHz)1 unitAMD
FrameworkPyTorch2https://pytorch.org
GPU HardwareNVIDIA A100 (40 GB)2 unitsNVIDIA Corp.
Graph FrameworkDGL1.1https://www.dgl.ai
LibraryHugging Face Transformers4.32.0https://huggingface.co/transformers
LibrarySpaCy3.6https://spacy.io
LibraryNLTK3.8.1https://www.nltk.org

References

  1. Powers, D. M. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness & correlation. J Mach Learn Technol. 2 (1), 37-63 (2011).
  2. Eisenberg, M. A. Legal Reasoning. , Cambridge University Press. (2022).
  3. Lin, C. Y. ROUGE: A Package for Automatic Evaluation of Summaries. Text Summarizat Branches Out. , 74-81 (2004).
  4. Lewis, M., et al. Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. Proc ACL. , 7871-7880 (2020).
  5. Hadi, A. Leveraging Transformer-Based Language Models to Bridge the Gap Between Language and Specialized Domains. [Doctoral Dissertation]. , Institut Polytechnique de Paris. (2024).
  6. Waterworth, K. Model-Agents of Change: A Meta-Cognitive, Interdisciplinary, Self-Similar, Synergetic Approach to Neuro-Symbolic Semantic Search and Retrieval Augmented Generation. [Master's Thesis]. , Miami University. (2024).
  7. Zhang, J., Zhao, Y., Saleh, M., Liu, P. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization. Proc ICML. , 11328-11339 (2020).
  8. Li, Z., et al. When object detection meets knowledge distillation: A survey. IEEE Trans. Pattern Anal Mach Intell. 45 (8), 10555-10579 (2023).
  9. Chen, Y., et al. Citation Network Analysis for Legal Reasoning. J AI Law. 28 (2), 145-170 (2020).
  10. Raffel, C., et al. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. J Mach Learn Res. 21 (140), 1-67 (2020).
  11. Reimers, N., Gurevych, I. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proc EMNLP. , 3982-3992 (2019).
  12. Gunning, D., Aha, D. DARPA's explainable artificial intelligence (XAI) program. AI Mag. 40 (2), 44-58 (2019).
  13. Mihalcea, R., Tarau, P. TextRank: Bringing Order into Texts. Proc EMNLP. , 404-411 (2004).
  14. Sharma, G., Sharma, D. Automatic text summarization methods: A comprehensive review. SN Comput Sci. 4 (1), 33(2022).
  15. Xu, J., Croft, W. B. Neural Networks for Text Classification. Inf Retr J. 20 (3), 259-289 (2017).
  16. Ghosh, S., Dutta, A., Das, A. Indian Legal Text Summarization: A Text Normalisation-based Approach. arXiv. , (2022).
  17. Silver, D., et al. Mastering the Game of Go with Deep Neural Networks and Tree Search. Nature. 529, 484-489 (2016).
  18. Chalkidis, I., et al. LexGLUE: A benchmark dataset for legal language understanding in English. Proc ACL. 60 (1), 4310-4330 (2022).
  19. Ashley, K. Artificial Intelligence and Legal Analytics. , Cambridge University Press. (2017).
  20. Chalkidis, I., Fergadiotis, M., Aletras, N. LEGAL-BERT: The Muppets Straight Out of Law School. Proc ACL. , 2898-2910 (2020).
  21. Vaswani, A., et al. Attention Is All You Need. Adv Neural Inf Process Syst. 30, 5998-6008 (2017).
  22. Baker, A. R., Slack, F. J. ADAR1 and its implications in cancer development and treatment. Trends Genet. 38 (8), 821-830 (2022).
  23. Casola, S., Lavelli, A. Summarization, simplification, and generation: The case of patents. Expert Syst. Appl. 205, 117627(2022).
  24. Valente, A. Legal Knowledge Engineering. , IOS Press. (1995).
  25. Katz, D. M., et al. Natural language processing in the legal domain. arXiv. , (2023).
  26. Gilpin, L., et al. Explaining Explanations: An Approach to Interpretable AI. Proc ICML. 70, 89-98 (2018).
  27. Davoodijam, E., Alambardar Meybodi, M. Evaluation metrics on text summarization: comprehensive survey. Knowl Inf Syst. 66 (12), 7717-7738 (2024).
  28. Schauer, F. Precedent. , Stanford Encyclopedia of Philosophy. (1989).
  29. Bengio, Y., Louradour, J., Collobert, R., Weston, J. Curriculum Learning. Proc ICML. , 382-389 (2009).
  30. Vrandecic, D., Krötzsch, M. Wikidata: A Free Collaborative Knowledge Base. Commun ACM. 57 (10), 78-85 (2014).
  31. Chu, Y., Ye, M., Qian, Y. Fine-Grained Image Recognition Methods and Their Applications in Remote Sensing Images: A Review. IEEE J Sel Top Appl Earth Obs Remote Sens. 17 (6), 1234-1250 (2024).
  32. Vue, Z., et al. Stories from Hmong in STEMM. Trends Genet. 39 (8), 587-592 (2023).
  33. Begum, N., Goyal, A. Analysis of Legal Case Document Automated Summarizer. Proc ISPCC. , 533-538 (2021).
  34. Surden, H. Ethics of AI in Legal Practice. J Legal Ethics. 32 (2), 145-163 (2019).
  35. Bench-Capon, T. J. M., Sartor, G. Ontology-Based Legal Reasoning. Artif Intell Law. 11 (2), 125-157 (2003).
  36. Liu, Y. Fine-tune BERT for Extractive Summarization. arXiv. , (2019).

Access restricted. Please log in or start a trial to view this content.

Reprints and Permissions

Tags

Transformer ArchitectureLegal Outcome PredictionLegal Entity RecognitionAbstractive SummarizationExtractive SummarizationROUGE Scores