Automatic Grading System for Spreadsheet Formula

Spreadsheet is one of the tools that can be used to learn data analysis. Data analysis in spreadsheet can be done using formula. Spreadsheet tools can also be used for exams. For the assessment, there is a problem when the number of answers that need to be checked is large, that is it takes a long time to check all the answers. For this reason, an automatic grading system (autograder) that can evaluate formula in spreadsheet is needed. The method used in developing the autograder system is matching the answer key formula with the student's answer formula. The autograder system assesses the answer by calculating the similarity of the student's answer formula with the answer key formula. This paper explains how to build an autograder system that can evaluate the formula. At the end, an autograder system has been built successfully. It has been tested with 43 testcases and all of them are passed

Measuring hairiness in carpets by using surface metrology

Recently, an automatic system for grading appearance retention in carpets using our own scanner and image analysis techniques was proposed. A system for carpets with low pile construction and without color patterns has been developed. Appearance changes in carpets with high pile construction were still not well detected. We present an approach based on surface metrology that extract information given by the hairs on the carpet surface. These features are complementary to the texture features previously explored. By combining both features, we expand the use of the automatic grading system including some carpets types with high pile construction

Kassandra: The Automatic Grading System

An automatic grading system is presented for grading assignments in scientific computing. A student can interactively use this system to check the correctness of his program assignments. The grade for a correct solution is automatically recorded. This paper also considers the security problems with such an automatic grading system. (Also cross-referenced as UMIACS-TR-94-59

Considerations when using an Automatic Grading System within Computer Science Modules

[EN] This paper aims to investigate the effectiveness of automatic grading systems, with a focus on their uses within Computer Science. Automatic grading systems have seen a rise in popularity in recent years with publications concerning automatic grading systems usually linked to a specific system. This paper will discuss the factors that need to be considered when using automatic grading, regardless of which system is being used, and will make recommendations for each factor. This discussion is based on the authors' experience of using an automatic grading system in a CS1 environment. From the research conducted, many elements should be considered when using these systems. These include how the code will be tested, the need for plagiarism checks and how marks are awarded. The findings of this study suggest there is a lack of defined standards when using these systems. This analysis of the considerations provides valuable insight into how these systems should be used and what the standards should be built on.Thompson, A.; Mooney, A.; Noone, M.; Hegarty-Kelly, E. (2021). Considerations when using an Automatic Grading System within Computer Science Modules. En 7th International Conference on Higher Education Advances (HEAd'21). Editorial Universitat Politècnica de València. 589-597. https://doi.org/10.4995/HEAd21.2021.13045OCS58959

Using edit distance to analyse errors in a natural language to logic translation corpus

We have assembled a large corpus of student submissions to an automatic grading system, where the subject matter involves the translation of natural language sentences into propositional logic. Of the 2.3 million translation instances in the corpus, 286,000 (approximately 12%) are categorized as being in error. We want to understand the nature of the errors that students make, so that we can develop tools and supporting infrastructure that help students with the problems that these errors represent. With this aim in mind, this paper describes an analysis of a significant proportion of the data, using edit distance between incorrect answers and their corresponding correct solutions, and the associated edit sequences, as a means of organising the data and detecting categories of errors. We demonstrate that a large proportion of errors can be accounted for by means of a small number of relatively simple error types, and that the method draws attention to interesting phenomena in the data set

Image Processing Techniques for Harumanis Disease Severity and Weighting Estimation for Automatic Grading System Application

Harumanis Mango is known as the king of Mangoes. It is very nutritious and rich with carotenes. However, many of the farmers and agriculture experts reported that they have problems in grading and inspecting the Harumanis Mango. Sometimes, Mango production loses its quality due to diseases that are not even visible to the naked eyes. Traditionally, farmers and agriculture experts will estimate the severity of the disease using their experiences. While for weight estimation, manual inspection was done by using a weight scale. This traditional method has its own drawbacks as it can lead to some errors due to inconsistencies made by human inspection. Furthermore, they are less efficient and very time-consuming. Therefore, an automated procedure that able to classify the disease severities and weight estimations would be much appreciated. With the aid of image processing techniques, diseases can be classified according to its scale, and its weight can be estimated. A number of pixels of Harumanis Mango will be used for classification. The analysis will be done by using the statistical method of regression. It shows that the accuracy of weight estimation is 72.25%

Partial correctness and continuous integration in computer supported education

In this paper we support the idea that students and teachers will benefit from a computer-based system that assesses programming exercises and provide immediate and detailed feedback: students would be able to evolve in the right direction and teachers would follow and assess more fairly their students. This assessment should outperform the typical right/wrong evaluation returned by existing tools, allowing for a flexible partial evaluation. Moreover, we adopt a concept from Agile Development, the Continuous Integration (CI), to improve students’ effectiveness. The applicability of CI reflects a better monitoring by the teams and their individual members, also providing the ability to improve the speed of the development. Besides the description of the capabilities that we require from an Automatic Grading System (AGS), we discuss iQuimera, an improved AGS that we are working on, that implements our teaching/learning principles.Fundação para a Ciência e a Tecnologia (FCT

Plagiarism detection: A tool survey and comparison

We illustrate the state of the art in software plagiarism detection tools by comparing their features and testing them against a wide range of source codes. The source codes were edited according to several types of plagiarism to show the tools accuracy at detecting each type. The decision to focus our research on plagiarism of programming languages is two fold: on one hand, it is a challenging case-study since programming languages impose a structured writing style; on the other hand, we are looking for the integration of such a tool in an Automatic-Grading System (AGS) developed to support teachers in the context of Programming courses. Besides the systematic characterisation of the underlying problem domain, the tools were surveyed with the objective of identifying the most successful approach in order to design the aimed plugin for our AGS.(undefined

Automatic Grading of Diabetic Retinopathy on a Public Database

With the growing diabetes epidemic, retina specialists have to examine a tremendous amount of fundus images for the detection and grading of diabetic retinopathy. In this study, we propose a first automatic grading system for diabetic retinopathy. First, a red lesion detection is performed to generate a lesion probability map. The latter is then represented by 35 features combining location, size and probability information, which are finally used for classification. A leave-one-out cross-validation using a random forest is conducted on a public database of 1200 images, to classify the images into 4 grades. The proposed system achieved a classification accuracy of 74.1% and a weighted kappa value of 0.731 indicating a significant agreement with the reference. These preliminary results prove that automatic DR grading is feasible, with a performance comparable to that of human experts