Crossref DOIMemberCiteFactoropen accessissn
SJIF Impact Factor 8.659 | ISSN: 2582-3930
IJSREM Logo

International Journal of Scientific Research in Engineering and Management

(Gateway to Global Scholars - An International, Scholarly, Multi-Disciplinary, Open Access Journal)

Peer-Reviewed Journal Designed to Meet UGC's Quality Parameters

HomeCurrent IssuePast IssuesPay OnlineConferencesEditorial BoardAbout UsContact Us
IJSREM

Loading article...

Follow Us

  • Google Scholar
  • ResearchGate
  • Academia.edu
  • Mendeley
  • LinkedIn
  • Facebook
  • Instagram

Journal Policies

  • Peer Review Policy
  • Publication Ethics
  • Copyright Infringement
  • Refund & Cancellation Policy
  • Terms and Conditions
  • Privacy Policy

Journal Identifiers & Licenses

  • ISSN Verified: 2582-3930ISSN Verified: 2582-3930
  • Crossref DOI: 10.55041Crossref DOI: 10.55041
  • SJIF Ranking: 08.659SJIF Ranking: 08.659
  • Licensed under CC BY 4.0Licensed under CC BY 4.0
  • ISO Certification: 9001:2015ISO Certification: 9001:2015
  • Indexed & Cited In: Google ScholarIndexed & Cited In: Google Scholar

Contact Us

International Journal of Scientific Research in Engineering and Management (IJSREM)

#62/1, New No 7, 1st Cross, 2nd Main, Ganganagar, R T Nagar, Bangalore North, Bangalore, Karnataka, India – 560032
[email protected]+91 93911 67991
logos
logos
Working Hours

Mon – Sat: 9:00 AM – 6:00 PM

Sunday: 10:00 AM – 4:00 PM

+91 93911 67991

© 2026 IJSREM – International Journal of Scientific Research in Engineering and Management. This is an open-access journal. Articles are published under the Creative Commons Attribution (CC BY 4.0) License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

DisclaimerPrivacy PolicyTerms and Conditions
ArticlePeer ReviewedOpen AccessPlagiarism Passed
Paper ID:IJSREM69012

CogniLearn: An Adaptive AI Learning Assistant with Real-time Multi-Signal Confusion Detection

Stream/Area:

-

Subject:

-

Paper ID:

IJSREM69012

Volume:

10 |

11 |

Nov 2026

Pages:

1-5

Publication Frequency:

Monthly (12 issues per year)

DOI
Digital Object Identifier
10.55041/IJSREM69012

License:International Journal of Scientific Research in Engineering and Management follows the Creative Commons Attribution 4.0 (CC BY 4.0) License, allowing free use and distribution with proper attribution.

Share this article:

Authors

SB

Sandeep B

Computer Science & Engineering

Jawaharlal Nehru New College of Engineering

Download Author Certificate
CVV

C V Vaishnav

Computer Science & Engineering

Jawaharlal Nehru New College of Engineering

Download Co-Author Certificate
DSD

Divya S Dalawai

Computer Science & Engineering

Jawaharlal Nehru New College of Engineering

Download Co-Author Certificate
GRS

G R Shalini

Computer Science & Engineering

Jawaharlal Nehru New College of Engineering

Download Co-Author Certificate
KGK

Karthik G K

Computer Science & Engineering

Jawaharlal Nehru New College of Engineering

Download Co-Author Certificate

Author Services & Downloads

Full ArticlesAcceptance Certificate

Abstract

Learners who watch long educational videos on platforms such as YouTube often hit a concept they do not understand but keep playing the video, because stopping to look for help breaks their flow. This paper describes CogniLearn, a Chrome extension with a local backend that notices likely cognitive overload while a video is playing and explains the concept being taught at that moment. A webcam frame is sampled at 4 fps and processed entirely on the device by MediaPipe Face Landmarker, which yields facial blendshape scores and head pose. A per-user detector calibrates a personal baseline in roughly 30 seconds using an online mean and variance estimate, converts each frame into a weighted z-score of effort-related facial actions (brow lowering, eye squint, inner-brow raise, mouth press), and aggregates frames over a 10-second sliding window. Viewing behaviour (rewinds and pauses) can amplify the facial evidence but can never trigger an intervention alone. A trigger fires only when the score stays above a personal threshold for 3 seconds and a cooldown has expired. The threshold is then adapted from real user labels ("Helpful" and "I wasn't confused") and from manual help requests. On a trigger, the video is paused and a FastAPI server fetches the transcript around the current timestamp and asks Gemini 2.5 Flash for a short explanation in the speaker's language, which is also read aloud with browser speech synthesis. The same transcript and a memory of earlier explanations are used to build a three-question multiple-choice quiz and exportable Markdown study notes. Only numeric features and the video ID leave the browser; camera frames never do. The paper describes the design, the algorithms and the parameters in detail, states the limitations of the current prototype, and proposes an evaluation protocol.

KEYWORDS

Cognitive Overload Detection; Adaptive Learning; Facial Blendshapes; MediaPipe; Personalised Thresholding; Large Language Models; Gemini; Chrome Extension; FastAPI; Educational Video

Cite This Article

Sandeep B, C V Vaishnav, Divya S Dalawai, G R Shalini, Karthik G K, "CogniLearn: An Adaptive AI Learning Assistant with Real-time Multi-Signal Confusion Detection," International Journal of Scientific Research in Engineering and Management, vol. 10, no. 11, pp. 1-5, Nov 2026. https://doi.org/10.55041/IJSREM69012

Full Article/Conclusion

CogniLearn shows that useful, timely help for video learners can be built without uploading camera images. A per-user calibrated facial detector, a conservative hold-and-cooldown trigger, behaviour used only as an amplifier, and a threshold that learns from real user labels together keep interruptions rare and personal. Grounding the LLM in the speaker's own transcript produces explanations that match both the moment and the language of the lesson, and the quiz and notes close the loop with retrieval practice. The prototype is modular and its labelled event log provides a path to data-driven improvement. A formal user study, as outlined in Section V, is the next step.

References

[1]  J. Sweller, "Cognitive load during problem solving: Effects on learning," Cognitive Science, vol. 12, no. 2, pp. 257-285, 1988. [2]  P. Ekman and W. V. Friesen, Facial Action Coding System. Palo Alto, CA, USA: Consulting Psychologists Press, 1978. [3]    S. D'Mello and A. Graesser, "Dynamics of affective states during complex learning," Learning and Instruction, vol. 22, no. 2, pp. 145-157, 2012. [4]  J. Whitehill, Z. Serpell, Y.-C. Lin, A. Foster, and J. R. Movellan, "The faces of engagement: Automatic recognition of student engagement from facial expressions," IEEE Trans. Affective Computing, vol. 5, no. 1, pp. 86-98, 2014. [5]   C. Lugaresi et al., "MediaPipe: A framework for building perception pipelines," arXiv:1906.08172, 2019. [6]  Y. Kartynnik, A. Ablavatski, I. Grishchenko, and M. Grundmann, "Real-time facial surface geometry from monocular video on mobile GPUs," arXiv:1907.06724, 2019. [7]  Gemini Team, Google, "Gemini: A family of highly capable multimodal models," arXiv:2312.11805, 2023. [8]  R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed. Cambridge, MA, USA: MIT Press, 2018. [9]  H. L. Roediger III and J. D. Karpicke, "Test-enhanced learning: Taking memory tests improves long-term retention," Psychological Science, vol. 17, no. 3, pp. 249-255, 2006. [10]   B. P. Welford, "Note on a method for calculating corrected sums of squares and products," Technometrics, vol. 4, no. 3, pp. 419-420, 1962.

Editorial & Review Transparency

Publication Date

11/16/2026

Peer Review Type

Double-Blind Peer Review

Review Rounds: 2

Documents

Review Report (Confidential)
Copyright Form (Office)

Article Metrics & Impact

Article Views

0

Total views since publication

PDF Downloads

1

Total downloads since publication

Geographic Reach

5

Indexing, Archiving & Preservation

Google Scholar
Academia
ResearchGate
Crossref
SSRN
Semantic Scholar
Thomson Reuters
WorldCat
Mendeley
OpenAlex
EBSCO
Zenodo

Digital Preservation: This article is permanently archived on Zenodo and complies with all data preservation standards across major indexing platforms.

Ethics, Compliance & Transparency

Plagiarism Screening

This manuscript has been checked for plagiarism using TurnitinPlagiarismChecker software.

Conflict of Interest

The authors declare no conflict of interest related to this research work.

Funding Information

No funding information available for this research.

Similar & Recommended Articles

Similar Articles by Topic

Related research in the same subject area

Loading similar articles...