Topalli, DamlaCagiltay, Nergiz ErcilInformation Systems EngineeringSoftware Engineering2024-07-052024-07-05201941553-35061553-351410.1177/15533506198531122-s2.0-85067838477https://doi.org/10.1177/1553350619853112https://hdl.handle.net/20.500.14411/3309Cagiltay, Nergiz/0000-0003-0875-9276Background. Endoscopic surgeries have become an alternative for open procedures whenever possible. For such types of operations, surgeons are required to gain several skills, whose development needs hands-on practice. Accordingly, gaining these skills today is a challenge for surgical education programs. Despite the development of several technology-enhanced training environments, there are still problems to better integrate these technologies into educational programs. For an appropriate integration, it is critical to assess the skill levels and adapt the training content according to the trainees' requirements. In the literature, there exist several methods for assessing these skill levels. However, there are still problems in practice for objective and repetitive assessment. Methods. The present study aims to estimate the skill levels of participants in surgical training programs in an objective manner by collecting experimental data from residents in an endoscopic surgical simulation environment and gathering performance metrics. Results. It is shown that, by comparing the results of a number of classification algorithms for the best accuracy estimation and feature set, the "novice" and "intermediate" skill levels can be estimated with an accuracy of 86%. Conclusions. The outcomes help surgical educators and instructional system designers to better assess the skill levels of the trainees and guide them accordingly. In addition, objective assessments as highlighted in this study can be beneficial when designing technology-enhanced adaptive learning environments.eninfo:eu-repo/semantics/closedAccessvirtual simulation environmentsurgical educationskill-based trainingfeature selectionclassificationArticleQ3Q2265621629WOS:00048618030001231167613