Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting

Jianzhang Zhang; Yiyang Chen; Chuang Liu; Nan Niu; Yinglin Wang

doi:10.1109/ICNGN59831.2023.10396810

Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting

Jianzhang Zhang, Yiyang Chen, Chuang Liu, Nan Niu, Yinglin Wang

Research output: Chapter or Contribution to Book › Literary contribution

Original language	English
Title of host publication	Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023
Editors	Gyu Myoung Lee, Pavel Loskot, Qinmin Yang, Ruidan Su
ISBN (Electronic)	9798350329070
DOIs	https://doi.org/10.1109/ICNGN59831.2023.10396810
State	Published - 2023
Externally published	Yes
Event	2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023 - Hangzhou, China Duration: Nov 17 2023 → Nov 18 2023

Publication series

Name	Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023

Conference

Conference	2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023
Country/Territory	China
City	Hangzhou
Period	11/17/23 → 11/18/23

ASJC Scopus Subject Areas

Artificial Intelligence
Computer Networks and Communications
Computer Science Applications
Computer Vision and Pattern Recognition
Safety, Risk, Reliability and Quality
Modeling and Simulation
Instrumentation

Keywords

ChatGPT
Empirical Evaluation
Natural Language Processing for Requirements Engineering
Requirements Information Retrieval

Access to Document

10.1109/ICNGN59831.2023.10396810

Cite this

Zhang, J., Chen, Y., Liu, C., Niu, N., & Wang, Y. (2023). Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting. In G. M. Lee, P. Loskot, Q. Yang, & R. Su (Eds.), Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023 (Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023). https://doi.org/10.1109/ICNGN59831.2023.10396810

Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting. / Zhang, Jianzhang; Chen, Yiyang; Liu, Chuang et al.
Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023. ed. / Gyu Myoung Lee; Pavel Loskot; Qinmin Yang; Ruidan Su. 2023. (Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023).

Research output: Chapter or Contribution to Book › Literary contribution

Zhang, J, Chen, Y, Liu, C, Niu, N & Wang, Y 2023, Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting. in GM Lee, P Loskot, Q Yang & R Su (eds), Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023. Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023, 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023, Hangzhou, China, 11/17/23. https://doi.org/10.1109/ICNGN59831.2023.10396810

Zhang J, Chen Y, Liu C, Niu N, Wang Y. Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting. In Lee GM, Loskot P, Yang Q, Su R, editors, Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023. 2023. (Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023). doi: 10.1109/ICNGN59831.2023.10396810

Zhang, Jianzhang ; Chen, Yiyang ; Liu, Chuang et al. / Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting. Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023. editor / Gyu Myoung Lee ; Pavel Loskot ; Qinmin Yang ; Ruidan Su. 2023. (Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023).

@inproceedings{d1d9afbb4d6645ba98c4a6cb855bd0d5,

title = "Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting",

keywords = "ChatGPT, Empirical Evaluation, Natural Language Processing for Requirements Engineering, Requirements Information Retrieval",

author = "Jianzhang Zhang and Yiyang Chen and Chuang Liu and Nan Niu and Yinglin Wang",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023 ; Conference date: 17-11-2023 Through 18-11-2023",

year = "2023",

doi = "10.1109/ICNGN59831.2023.10396810",

language = "English",

series = "Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023",

editor = "Lee, \{Gyu Myoung\} and Pavel Loskot and Qinmin Yang and Ruidan Su",

booktitle = "Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023",

}

TY - GEN

T1 - Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting

AU - Zhang, Jianzhang

AU - Chen, Yiyang

AU - Liu, Chuang

AU - Niu, Nan

AU - Wang, Yinglin

PY - 2023

Y1 - 2023

KW - ChatGPT

KW - Empirical Evaluation

KW - Natural Language Processing for Requirements Engineering

KW - Requirements Information Retrieval

UR - https://www.scopus.com/pages/publications/85184991119

UR - https://www.scopus.com/inward/citedby.url?scp=85184991119&partnerID=8YFLogxK

U2 - 10.1109/ICNGN59831.2023.10396810

DO - 10.1109/ICNGN59831.2023.10396810

M3 - Literary contribution

AN - SCOPUS:85184991119

T3 - Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023

BT - Proceedings of 2023 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023

A2 - Lee, Gyu Myoung

A2 - Loskot, Pavel

A2 - Yang, Qinmin

A2 - Su, Ruidan

T2 - 2nd International Conference on Intelligent Computing and Next Generation Networks, ICNGN 2023

Y2 - 17 November 2023 through 18 November 2023

ER -

Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting

Publication series

Conference

ASJC Scopus Subject Areas

Keywords

Access to Document

Other files and links

Cite this