Experimenting with ChatGPT for Spreadsheet Formula Generation: Evidence of Risk in AI Generated Spreadsheets

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++ and Spreadsheets. These tools are powerful and relatively accurate and therefore provide broad access to computer programming regardless of the background or knowledge of the individual using them. This paper presents a series of experiments with ChatGPT to explore the tool's ability to produce valid spreadsheet formulae and related computational outputs in situations where ChatGPT has to deduce, infer and problem solve the answer. The results show that in certain circumstances, ChatGPT can produce correct spreadsheet formulae with correct reasoning, deduction and inference. However, when information is limited, uncertain or the problem is too complex, the accuracy of ChatGPT breaks down as does its ability to reason, infer and deduce. This can also result in false statements and "hallucinations" that all subvert the process of creating spreadsheet formulae.Comment: 15 Page

A Review of Spreadsheet Error Reduction Techniques

Academic and practitioner research shows that spreadsheet errors are prevalent in spreadsheet models and that occasionally these errors cause organisations significant financial loss. A considerable body of research literature now exists on spreadsheet errors and methods to reduce the impact of these errors through technical or organisational approaches. This paper critically examines the literature on spreadsheet error reduction methods and suggests areas and directions of research that would benefit the development of the specific spreadsheet research projects and assist in the mitigation of spreadsheet error