This paper presents our contribution to the RadSum23 shared task organized as part of the BioNLP 2023. We compared state-of-the-art generative language models in generating high-quality summaries from radiology reports. A two-stage fine-tuning approach was introduced for utilizing knowledge learnt from different datasets. We evaluated the performance of our method using a variety of metrics, including BLEU, ROUGE, bertscore, CheXbert, and RadGraph. Our results revealed the potentials of different models in summarizing radiology reports and demonstrated the effectiveness of the two-stage fine-tuning approach. We also discussed the limitations and future directions of our work, highlighting the need for better understanding the architecture design’s effect and optimal way of fine-tuning accordingly in automatic clinical summarizations.
Read it at [DOI:10.18653/v1/2023.bionlp-1.54](https://aclanthology.org/2023.bionlp-1.54/)
Jinge Wu, Daqian Shi, Abul Hasan, and Honghan Wu. 2023. “KnowLab at RadSum23: comparing pre-trained language models in radiology report summarization.” In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 535–540, Toronto, Canada. Association for Computational Linguistics. DOI:10.18653/v1/2023.bionlp-1.54
Post by: KnowLab