Harnessing Generative Pre-Trained Transformers for Construction Accident Prediction with Saliency Visualization
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Yoo, Byunghee | - |
dc.contributor.author | Kim, Jinwoo | - |
dc.contributor.author | Park, Seongeun | - |
dc.contributor.author | Ahn, Changbum R. | - |
dc.contributor.author | Oh, Taekeun | - |
dc.date.accessioned | 2024-02-18T01:00:23Z | - |
dc.date.available | 2024-02-18T01:00:23Z | - |
dc.date.issued | 2024-01 | - |
dc.identifier.issn | 2076-3417 | - |
dc.identifier.issn | 2076-3417 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/90463 | - |
dc.description.abstract | Leveraging natural language processing models using a large volume of text data in the construction safety domain offers a unique opportunity to improve understanding of safety accidents and the ability to learn from them. However, little effort has been made to date in regard to utilizing large language models for the prediction of accident types that can help to prevent and manage potential accidents. This research aims to develop a model for predicting the six types of accidents (caught-in-between, cuts, falls, struck-by, trips, and others) by employing transfer learning with a fine-tuned generative pre-trained transformer (GPT). Additionally, to enhance the interpretability of the fine-tuned GPT model, a method for saliency visualization of input text was developed to identify words that significantly impact prediction results. The models were evaluated using a comprehensive dataset comprising 15,000 actual accident records. The results indicate that the suggested model for detecting the six accident types achieves 82% accuracy. Furthermore, it was observed that the proposed saliency visualization method can identify accident precursors from unstructured free-text data of construction accident reports. These results highlight the advancement of the generalization performance of large language processing-based accident prediction models, thereby proactively preventing construction accidents. | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | MDPI | - |
dc.title | Harnessing Generative Pre-Trained Transformers for Construction Accident Prediction with Saliency Visualization | - |
dc.type | Article | - |
dc.identifier.wosid | 001148878900001 | - |
dc.identifier.doi | 10.3390/app14020664 | - |
dc.identifier.bibliographicCitation | APPLIED SCIENCES-BASEL, v.14, no.2 | - |
dc.description.isOpenAccess | Y | - |
dc.citation.title | APPLIED SCIENCES-BASEL | - |
dc.citation.volume | 14 | - |
dc.citation.number | 2 | - |
dc.type.docType | Article | - |
dc.publisher.location | 스위스 | - |
dc.subject.keywordAuthor | large language model | - |
dc.subject.keywordAuthor | generative pre-trained transformer | - |
dc.subject.keywordAuthor | fine-tuning | - |
dc.subject.keywordAuthor | accident prediction | - |
dc.subject.keywordAuthor | saliency visualization | - |
dc.subject.keywordAuthor | construction safety | - |
dc.subject.keywordPlus | SAFETY | - |
dc.subject.keywordPlus | SYSTEM | - |
dc.relation.journalResearchArea | Chemistry | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Materials Science | - |
dc.relation.journalResearchArea | Physics | - |
dc.relation.journalWebOfScienceCategory | Chemistry, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Engineering, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Materials Science, Multidisciplinary | - |
dc.relation.journalWebOfScienceCategory | Physics, Applied | - |
dc.description.journalRegisteredClass | scie | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.