Full Text:   <1771>

Summary:  <142>

CLC number: 

On-line Access: 2023-12-04

Received: 2023-08-08

Revision Accepted: 2023-12-05

Crosschecked: 2023-09-25

Cited: 0

Clicked: 740

Citations:  Bibtex RefMan EndNote GB/T7714

 ORCID:

Xin PENG

https://orcid.org/0000-0003-3376-2581

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering  2023 Vol.24 No.11 P.1513-1519

http://doi.org/10.1631/FITEE.2300537


Software development in the age of intelligence: embracing large language models with the right approach


Author(s):  Xin PENG

Affiliation(s):  School of Computer Science, Fudan University, Shanghai 200438, China

Corresponding email(s):   pengxin@fudan.edu.cn

Key Words: 


Share this article to: More |Next Article >>>

Xin PENG. Software development in the age of intelligence: embracing large language models with the right approach[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(11): 1513-1519.

@article{title="Software development in the age of intelligence: embracing large language models with the right approach",
author="Xin PENG",
journal="Frontiers of Information Technology & Electronic Engineering",
volume="24",
number="11",
pages="1513-1519",
year="2023",
publisher="Zhejiang University Press & Springer",
doi="10.1631/FITEE.2300537"
}

%0 Journal Article
%T Software development in the age of intelligence: embracing large language models with the right approach
%A Xin PENG
%J Frontiers of Information Technology & Electronic Engineering
%V 24
%N 11
%P 1513-1519
%@ 2095-9184
%D 2023
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.2300537

TY - JOUR
T1 - Software development in the age of intelligence: embracing large language models with the right approach
A1 - Xin PENG
J0 - Frontiers of Information Technology & Electronic Engineering
VL - 24
IS - 11
SP - 1513
EP - 1519
%@ 2095-9184
Y1 - 2023
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.2300537


Abstract: 
The emergence of large language models (LLMs), represented by ChatGPT, has had a profound impact on various fields, including software engineering, and has also aroused widespread concerns. To see a right way through the fog, we have recently been discussing and contemplating a theme of “software development in the age of LLMs,” or rather “the capability of LLMs in software development,” based on various technical literature, shared experiences, and our own preliminary explorations. Additionally, I have participated in several online interviews and discussions on the theme, which have triggered further insights and reflections. Based on the aforementioned thinking and discussions, this article has been composed to disseminate information and foster an open discussion within the academic community. LLMs still largely remain a black box, and the technology is still rapidly iterating and evolving. Moreover, the existing cases reported by practitioners and our own practical experiences with LLM-based software development are relatively limited. Therefore, many of the insights and reflections in this article may not be accurate, and they may be constantly refreshed as technology and practice continue to develop.

智能化时代的软件开发:拥抱大模型的正确姿势

彭鑫
复旦大学计算机科学技术学院,中国上海市,200438
摘要:以ChatGPT为代表的大语言模型技术对包括软件工程在内的很多领域都带来巨大冲击,也引发广泛焦虑。为在迷雾中看清一点方向,近期我们基于各种技术文献和实践分享以及我们自身的初步探索不断讨论和思考“大模型时代的软件工程”或者“大模型的软件开发能力”这一命题。同时我也参加了几次线上访谈,触发了更多认识和思考,在此基础上撰写了此篇文章,希望与大家分享一些观点并激发相关讨论。由于到目前为止大模型在很大程度上仍然是一个黑盒,并且大模型技术还在快速迭代和发展之中,同时目前看到的以及我们自己实践的基于大模型的软件开发案例还比较初步,因此本文的很多认识和思考不一定准确,未来还可能会随着技术和实践的发展而不断刷新。

关键词:大语言模型;ChatGPT;软件工程;软件开发

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Brooks FP Jr, 1987. No silver bullet essence and accidents of software engineering. Computer, 20(4):10-19.

[2]Dou SH, Shan JJ, Jia HX, et al., 2023. Towards understanding the capability of large language models on code clone detection: a survey. https://arxiv.org/abs/2308.01191

[3]Du XY, Liu MW, Wang KX, et al., 2023. ClassEval: a manually-crafted benchmark for evaluating LLMs on class-level code generation. https://arxiv.org/abs/2308.01861

[4]Hou XY, Zhao YJ, Liu Y, et al., 2023. Large language models for software engineering: a systematic literature review. https://arxiv.org/abs/2308.10620

[5]Liu JW, Xia CS, Wang YY, et al., 2023. Is your code generated by ChatGPT really correct? Rigorous evaluation of large language models for code generation. http://arxiv.org/abs/2305.01210

[6]Meyer B, 2023. AI does not help programmers. Commun ACM, early access.

[7]Open AI, 2023. GPT-4 technical report. https://arxiv.org/abs/2303.08774

[8]Wang JJ, Huang YC, Chen CY, et al., 2023. Software testing with large language model: survey, landscape, and vision. https://arxiv.org/abs/2307.07221

[9]Welsh M, 2023. The end of programming. Commun ACM, 66(1):34-35.

[10]Wu QY, Bansal G, Zhang JY, et al., 2023. AutoGen: enabling next-Gen LLM applications via multi-agent conversation. https://arxiv.org/abs/2308.08155

[11]Yuan ZQ, Liu JW, Zi QC, et al., 2023a. Evaluating instruction-tuned large language models on code comprehension and generation. https://arxiv.org/abs/2308.01240

[12]Yuan ZQ, Lou YL, Liu MW, et al., 2023b. No more manual tests? Evaluating and improving ChatGPT for unit test generation. https://arxiv.org/abs/2305.04207

[13]Zhao WX, Zhou K, Li JY, et al., 2023. A survey of large language models. https://arxiv.org/abs/2303.18223

[14]Zheng ZB, Ning KW, Chen JC, et al., 2023. Towards an understanding of large language models in software engineering tasks. https://arxiv.org/abs/2308.11396

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE