Search Results

Now showing 1 - 4 of 4
  • Article
    Citation - WoS: 8
    Citation - Scopus: 10
    Evaluation of Ten Open-Source Eye-Movement Classification Algorithms in Simulated Surgical Scenarios
    (Ieee-inst Electrical Electronics Engineers inc, 2019) Dalveren, Gonca Gokce Menekse; Cagiltay, Nergiz Ercil
    Despite providing several insights into visual attention and evidence regarding certain brain states and psychological functions, classifying eye movements is a highly demanding process. Currently, there are several algorithms to classify eye movement events which use different approaches. However, to date, only a limited number of studies have assessed these algorithms under specific conditions, such as those required for surgical training programmes. This study presents an investigation of ten open-source eye-movement classification algorithms using the Eye Tribe eye-tracker. The algorithms were tested on the eye-movement records obtained from 23 surgical residents, who performed computer-based surgical simulation tasks under different hand conditions. The aim was to offer data for the improvement of surgical training programmes. According to the results, due to the different classification methods and default threshold values, the ten algorithms produced different results. Considering the fixation duration, the only common event for all of the investigated algorithms, the binocular-individual threshold (BIT) algorithm resulted in a different clustering compared to the other algorithms. Based on the other set of common events, three clusters were determined by eight algorithms (except BIT and event detection (ED)), distinguishing dispersion-based, velocity-based and modified versions of velocity-based algorithms. Accordingly, it was concluded that dispersion-based and velocity-based algorithms provided different results. Additionally, as it individually specifies the threshold values for the eye-movement data, when there is no consensus about the threshold values to be set, the BIT algorithm can be selected. Especially for such cases like simulation-based surgical skill-training, the use of individualised threshold values in the BIT algorithm can be more beneficial in classifying the raw eye data and thus evaluating the individual progress levels of trainees based on their eye movement behaviours. In conclusion, the threshold values had a critical effect on the algorithm results. Since default values may not always be suitable for the unique features of different data sets, guidelines should be developed to indicate how the threshold values are set for each algorithm.
  • Conference Object
    How Assessment System of an Open Source Learning Management System Can Be Integrated To a Remote Laboratory Application? Problems and Solutions
    (2007) Aydin,C.C.; Cagiltay,N.E.
    Most of the education programs need an assessment system for formative and summative evaluation purposes. Similarly, in the ERRL project which is a distance remote radio frequency laboratory application, assessment system is required. However, developing an assessment system cost is very high and requires some extra time for testing and development purposes. Open source systems provide these services in a standard way. Since the source is open, it is possible to make some modifications to better adapt these systems to the requirements of developed systems. Similarly, in the Moodle part of the system we need to integrate the test and the experiment platforms. In order to better guide the learners in the system, they should take some tests about the devices and the theoretical content included in the system. It is important to prevent users who do not have the enough knowledge directed to the experiments platform. These testing requirements should be integrated into the remote laboratory system, so that, the learners should not need to jump between different systems and interfaces. This article presents implementation process of open source Learning Management System software's assessment module to a remote laboratory application and it also discusses the advantages, disadvantages of using an open source Web based assessment system. © 2007 IEEE.
  • Conference Object
    Citation - Scopus: 3
    How Assessment System of an Open Source Learning Management System Can Be Integrated To a Remote Laboratory Application? Problems and Solutions
    (2007) Aydin,C.C.; Cagiltay,N.E.
    Most of the education programs need an assessment system for formative and summative evaluation purposes. Similarly, in the ERRL project which is a distance remote radio frequency laboratory application, assessment system is required. However, developing an assessment system cost is very high and requires some extra time for testing and development purposes. Open source systems provide these services in a standard way. Since the source is open, it is possible to make some modifications to better adapt these systems to the requirements of developed systems. Similarly, in the Moodle part of the system we need to integrate the test and the experiment platforms. In order to better guide the learners in the system, they should take some tests about the devices and the theoretical content included in the system. It is important to prevent users who do not have the enough knowledge directed to the experiments platform. These testing requirements should be integrated into the remote laboratory system, so that, the learners should not need to jump between different systems and interfaces. This article presents implementation process of open source Learning Management System software's assessment module to a remote laboratory application and it also discusses the advantages, disadvantages of using an open source Web based assessment system. © 2007 IEEE.
  • Review
    Citation - WoS: 31
    Citation - Scopus: 43
    A Systematic Literature Review of Open Source Software Quality Assessment Models
    (Springer international Publishing Ag, 2016) Adewumi, Adewole; Misra, Sanjay; Omoregbe, Nicholas; Crawford, Broderick; Soto, Ricardo
    Background: Many open source software (OSS) quality assessment models are proposed and available in the literature. However, there is little or no adoption of these models in practice. In order to guide the formulation of newer models so they can be acceptable by practitioners, there is need for clear discrimination of the existing models based on their specific properties. Based on this, the aim of this study is to perform a systematic literature review to investigate the properties of the existing OSS quality assessment models by classifying them with respect to their quality characteristics, the methodology they use for assessment, and their domain of application so as to guide the formulation and development of newer models. Searches in IEEE Xplore, ACM, Science Direct, Springer and Google Search is performed so as to retrieve all relevant primary studies in this regard. Journal and conference papers between the year 2003 and 2015 were considered since the first known OSS quality model emerged in 2003. Results: A total of 19 OSS quality assessment model papers were selected. To select these models we have developed assessment criteria to evaluate the quality of the existing studies. Quality assessment models are classified into five categories based on the quality characteristics they possess namely: single-attribute, rounded category, community-only attribute, non-community attribute as well as the non-quality in use models. Our study reflects that software selection based on hierarchical structures is found to be the most popular selection method in the existing OSS quality assessment models. Furthermore, we found that majority (47%) of the existing models do not specify any domain of application. Conclusions: In conclusion, our study will be a valuable contribution to the community and helps the quality assessment model developers in formulating newer models and also to the practitioners (software evaluators) in selecting suitable OSS in the midst of alternatives.