Automated Evaluation of Computer Programs at Undergraduate Level: Suitability Study for Competitive Events
##plugins.themes.bootstrap3.article.main##
Abstract
Purpose—The paper is aimed towards the problem of automated evaluation of computer programs designed by students during competitive events where the participants have to design an algorithm and to implement it as a working program, which has to be evaluated. A similar evaluation has to be performed at universities by the lecturers teaching basics of programming. The purpose of this paper is to investigate the automated evaluation applied to computer programs designed by the university students, and to analyze the suitability of such methods for evaluation of computer programs designed by high school students in competitive events.
Design/methodology/approach—Comparative analysis is the main approach used in this paper.
Findings—The educational and technical goals that seek evaluation of computer programs at the university level are different from those in informatics contests. Therefore the majority of approaches applied at universities have led to development of automated evaluation systems with functionalities different than the ones required by informatics contests, and in the opinion of the author cannot be easily transferred to informatics contests. We identified one area where such transfer might be possible: automated evaluation of programming style.
Research limitations/implications—The experience of automated evaluation of programming style applied at the universities has a potential to be transferred to informatics contests; however the universities may ask their students to apply specific programming style, while informatics contests should accept a very broad range of reasonable programming styles. Additional investigation is required to answer the question in which way and to which extent the experience gained at the universities can be applied in informatics contests and the maturity exam.
Practical implications—This paper is a step towards developing a fair and motivated evaluation scheme in informatics contests. The paper would be useful for the researchers as it gives guidelines for future research.
Originality/Value—It is very important to apply fair and motivated evaluation in informatics contests as they involve the majority of high-school students interested in computer science in Lithuania and some other countries as well and may motivate them to study computer science at the university. To the knowledge of the author, this is the first paper analyzing the suitability of automated evaluation methods developed at the university level, to be applied for the evaluation at high school level in particular in informatics contests. On the other hand, the evaluation in informatics contests is an issue that attracts the interest of international community of informatics contests.
Design/methodology/approach—Comparative analysis is the main approach used in this paper.
Findings—The educational and technical goals that seek evaluation of computer programs at the university level are different from those in informatics contests. Therefore the majority of approaches applied at universities have led to development of automated evaluation systems with functionalities different than the ones required by informatics contests, and in the opinion of the author cannot be easily transferred to informatics contests. We identified one area where such transfer might be possible: automated evaluation of programming style.
Research limitations/implications—The experience of automated evaluation of programming style applied at the universities has a potential to be transferred to informatics contests; however the universities may ask their students to apply specific programming style, while informatics contests should accept a very broad range of reasonable programming styles. Additional investigation is required to answer the question in which way and to which extent the experience gained at the universities can be applied in informatics contests and the maturity exam.
Practical implications—This paper is a step towards developing a fair and motivated evaluation scheme in informatics contests. The paper would be useful for the researchers as it gives guidelines for future research.
Originality/Value—It is very important to apply fair and motivated evaluation in informatics contests as they involve the majority of high-school students interested in computer science in Lithuania and some other countries as well and may motivate them to study computer science at the university. To the knowledge of the author, this is the first paper analyzing the suitability of automated evaluation methods developed at the university level, to be applied for the evaluation at high school level in particular in informatics contests. On the other hand, the evaluation in informatics contests is an issue that attracts the interest of international community of informatics contests.
##plugins.themes.bootstrap3.article.details##
Section
Articles
- The Author grants to the Publisher the exclusive right and licence to publish this Article without remuneration until the expiry of the economic rights: to reproduce the article in print and digital form, including its publication; to disseminate the original version of the Article or its copies in Lithuania and foreign countries; to translate the Article; to publish the article, including making it publicly available via computer networks; to reproduce and publish the Article in Lithuanian and foreign databases; to licence usage of the Article in ways described in this paragraph.
- The Author warrants that the economic rights of the Author have not been assigned or granted to third parties, that the Article has not been published so far and is not under consideration of being published elsewhere.
- The Author warrants that the Article does not violate intellectual property rights of others.
- After the Article is published in Social Technologies the Author shall have a right to make it public on personal website or on a website of an institution of affiliation, to reproduce it for non-commercial teaching or scholarly research purposes, clearly indicating that the primary source of its publication is Social Technologies.
- This consent shall be considered invalid if the Editorial Board of the Social Technologies decides not to publish the Article.
Authors contributing to Social Technologies agree to publish their articles under a Creative Commons Attribution 3.0 Unported (CC BY 3.0) Licence, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit, and that in the event of reuse or distribution, the terms of this licence are made clear.
