Evaluation of the Quality of Learning Management System With Real-Time Supervision Using ISO/IEC 25010 in Aviation Vocational Education

Abstract

Development of a web-based learning management system that is integrated with real-time exam supervision to overcome problems of academic integrity, operational efficiency, and quality of digital learning evaluation in vocational universities. The increasing use of computer-based exam systems poses challenges related to participant supervision, the validity of exam results, and the inefficiency of academic administration processes. In contrast to previous studies that only evaluated LMS or proctoring systems separately, this study integrates LMS modules, real-time monitoring, and software quality evaluation using ISO/IEC 25010. The research method uses (R&D) with four main stages, namely needs analysis, system design, prototype development, and system quality evaluation. There were 75 respondents, including students, supervisors, study program organizers, and CBT laboratory managers. The system evaluation is carried out using the ISO/IEC 25010 standard to comprehensively measure the quality of the software. The results showed that user needs were dominated by the ease of use of the system (96.0%), automatic recapitulation of scores (93.3%), and recording of participant activities (90.7%). The evaluation of system quality obtained an average score of 88.4% with the category of excellent. The results of the evaluation showed functional suitability (91.2%), usability (93.6%), safety (89.6%), reliability (88.0%), performance efficiency (87.5%), compatibility (85.1%), maintenance (86.7%), and portability (85.9%). The results of the efficiency test showed a significant improvement, characterized by a decrease in the recapitulation time of the value from 120 minutes to 15 minutes and a decrease in input error from 8 cases to 1 case. These findings prove that the integration of LMS with a real-time exam proctoring system can improve operational efficiency, data accuracy, and the integrity of the academic evaluation process. The developed system contributes to the development of a more reliable, standardized, and applicable digital evaluation model in vocational higher education environments.