Home > Computer Science > Data Processing > Volume-10 > Issue-5 > Design and Implementation of a Classroom Participation Evaluation System Based on Multimodal Fusion

Design and Implementation of a Classroom Participation Evaluation System Based on Multimodal Fusion

Call for Papers

Volume-10 | Issue-6

Last date : 27-Dec-2026

Best International Journal
Open Access | Peer Reviewed | Best International Journal | Indexing & IF | 24*7 Support | Dedicated Qualified Team | Rapid Publication Process | International Editor, Reviewer Board | Attractive User Interface with Easy Navigation

Journal Type : Open Access

First Update : Within 7 Days after submittion

Submit Paper Online

For Author

Research Area


Design and Implementation of a Classroom Participation Evaluation System Based on Multimodal Fusion


Wenrong Song | Rui Dai | Zaiyuan Dong



Wenrong Song | Rui Dai | Zaiyuan Dong "Design and Implementation of a Classroom Participation Evaluation System Based on Multimodal Fusion" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-10 | Issue-5, October 2026, pp.1878-1886, URL: https://www.ijtsrd.com/papers/ijtsrd150281.pdf

Classroom participation is often treated as a key indicator of teaching quality, yet traditional evaluation relies mainly on teachers' on-site subjective observation, which suffers from limited evaluation dimensions, untimely feedback, and a heavy workload for teachers. Existing studies mostly focus on a single modality and lack deep fusion. Accordingly, this paper designs and implements a classroom participation evaluation system that combines speech recognition with image recognition. The system adopts a dual-path multimodal perception architecture. On the image path, SSD is first used for face detection, then MobileFaceNet outputs eight emotion categories, and MediaPipe Face Landmarker is used to obtain 478 three-dimensional facial landmarks for lightweight real-time tracking. On the speech path, librosa is used to extract multi-dimensional acoustic features such as fundamental frequency, RMS energy, and zero-crossing rate to classify emotional tendencies. At the decision level, a confidence-weighted fusion mechanism is introduced to integrate indicators including head-up rate, number of speaking turns, and expression positivity, producing multi-dimensional participation scores. The system is developed with open-source frameworks such as PyTorch, OpenCV, and uni-app, and all core computations are performed locally. Test results show that the facial expression recognition accuracy is 70.0 percent, the speech emotion classification consistency reaches 86.1 percent, the System Usability Scale score is 74.5, and memory usage remains stable within 120 MB during 60 minutes of continuous operation. This work provides a deployable technical solution for the automated evaluation of classroom participation in smart education environments.

multimodal fusion; classroom participation; speech recognition; image recognition; decision-level fusion.


IJTSRD150281
Volume-10 | Issue-5, October 2026
1878-1886
IJTSRD | www.ijtsrd.com | E-ISSN 2456-6470
Copyright © 2019 by author(s) and International Journal of Trend in Scientific Research and Development Journal. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0) (http://creativecommons.org/licenses/by/4.0)

International Journal of Trend in Scientific Research and Development - IJTSRD having online ISSN 2456-6470. IJTSRD is a leading Open Access, Peer-Reviewed International Journal which provides rapid publication of your research articles and aims to promote the theory and practice along with knowledge sharing between researchers, developers, engineers, students, and practitioners working in and around the world in many areas like Sciences, Technology, Innovation, Engineering, Agriculture, Management and many more and it is recommended by all Universities, review articles and short communications in all subjects. IJTSRD running an International Journal who are proving quality publication of peer reviewed and refereed international journals from diverse fields that emphasizes new research, development and their applications. IJTSRD provides an online access to exchange your research work, technical notes & surveying results among professionals throughout the world in e-journals. IJTSRD is a fastest growing and dynamic professional organization. The aim of this organization is to provide access not only to world class research resources, but through its professionals aim to bring in a significant transformation in the real of open access journals and online publishing.

Thomson Reuters
Google Scholer
Academia.edu

ResearchBib
Scribd.com
archive

PdfSR
issuu
Slideshare

WorldJournalAlerts
Twitter
Linkedin