Author: Lin, Haolei
Title: Capabilities and limitations of ChatGPT in classifying crane-related accident reports
Advisors: Chi, Hung-lin (BRE)
Degree: M.Sc.
Year: 2023
Subject: Cranes, derricks, etc -- Accidents
Natural language generation (Computer science) -- Computer programs
Artificial intelligence
Hong Kong Polytechnic University -- Dissertations
Department: Department of Building and Real Estate
Pages: iv, 35 pages : color illustrations
Language: English
Abstract: Cranes hold an indispensable and vital role in the realm of construction engineering. Efficiently summarizing and managing the causal factors behind crane-related accidents can significantly mitigate unnecessary hazards. This study focuses on the application of ChatGPT in the classification of crane-related accident reports, summarizing the fundamental framework of utilizing the Prompt for ChatGPT for conducting classification tasks. The aim is to diminish manual labeling time for researchers while constructing their own deep learning models, and concurrently enhance the accuracy of ChatGPT's classification abilities.
This research encompasses two distinct phases. The initial phase entails a preliminary data analysis of crane-related incident reports from 2002 to 2021, sourced from the Occupational Safety and Health Administration (OSHA). Subsequently, ChatGPT is applied to conduct classification experiments, with only the basic requirements of the Prompt being edited. The evaluation metric employed is the F1-Score, and the Prompt improvement focuses on addressing two specific limitations of ChatGPT: the difficulty in classifying due to vague classification standards, and high levels of expertise in labeling.
In the second phase, iterative experiments are carried out by using ChatGPT repeatedly refining and adjusting the Prompts. Ultimately, the study concludes that transforming a single classification task into a composite of multiple classification tasks, endowing ChatGPT with an assumed identity, and allocating adequate computational time are effective methods within the framework for crafting Prompts that enhance the accuracy of ChatGPT's classification performance.
Rights: All rights reserved
Access: restricted access

Files in This Item:
File Description SizeFormat 
7117.pdfFor All Users (off-campus access for PolyU Staff & Students only)1.15 MBAdobe PDFView/Open


Copyright Undertaking

As a bona fide Library user, I declare that:

  1. I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
  2. I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
  3. I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.

By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.

Show full item record

Please use this identifier to cite or link to this item: https://theses.lib.polyu.edu.hk/handle/200/12652