JBJS Clinical Classroom is a leading adaptive and online orthopaedic learning system. It uses the NEJM Knowledge+ biological model of adaptive learning technology, observes how residents learn, and then individualizes content with a precise focus on knowledge, skill, and confidence deficits. Unlike “question banks”, JBJS Clinical Classroom tailors questions to the user so that they spend up to 50% less time learning the same material.1
Residents who begin using Clinical Classroom during their residency can continue as they move into fellowships and independent practice – a lifetime of orthopaedic education in one tool! The platform’s adaptive algorithm works the same way for residents as it does for individual clinicians. It can be used independently or incorporated into a program’s curriculum.
What makes JBJS Clinical Classroom different?
When answering questions in Clinical Classroom, learners must choose “I know it,” “Think so,” “Unsure,” or “No idea” to describe their confidence in the answer they are selecting. The adaptive algorithm looks at how the question is answered, the selected confidence level, and time taken to answer each question. It then uses evidence-based algorithms to continually direct them away from subjects in which they are proficient and confident, and toward weaker areas until all content is mastered. It adapts as they learn!
Other online study tools that ask hundreds of questions provide an experience aimed at passing exams as opposed to mastery and reinforcement of information. Once a learner has answered 200 questions, all they have is 200 answered questions. By contrast, Clinical Classroom quickly identifies learners’ strengths and weaknesses during the test-taking process so that they can continually focus on areas they have not yet mastered or about which they are uncertain. This allows them the option of customizing their learning experience in the areas they need it most.
Clinical Classroom allows learners to see not only what questions they missed but also which learning objectives they find most challenging. The platform also contains an automated “recharge” function to help learners retain previously learned content and to relearn topics they may have forgotten over time.
“The Clinical Classroom product questions have a higher level of integrity than questions on similar platforms.”
– Program Director, 2020
What are the advantages for educators and resident directors?
Current, relevant content. The questions in JBJS Clinical Classroom are written to address learning objectives developed by experts in each subspecialty area and are based on information contained in the content outlines for the board certification and maintenance of certification examinations. The content is vetted and reviewed extensively by our subspecialty section heads and their team of experts.
Tracking learner performance. JBJS Clinical Classroom has a robust reporting system that provides program directors and faculty with the ability to track progress through Clinical Classroom. The system generates reports regarding a learner’s performance and progress, metacognition (e.g. awareness of their knowledge), problem areas, and tools to improve one’s learning.
Assessment and remediation. JBJS Clinical Classroom provides residency directors and faculty with the ability to assign random or customized quizzes to any or all residents for assessment and remediation. For example, if a resident doesn’t score as well as desired on the in-training examinations, quizzes can be assigned at different time intervals to assess that resident’s learning – and provide faculty with the quiz results to track that resident’s improvement.
Curriculum enhancement. JBJS Clinical Classroom can be incorporated into the curriculum by adding an assessment component to clinical rotations. This is be done by creating customized quizzes or assigning independent completion of questions within a subspecialty module that coincides with a particular clinical rotation. Assign a trauma quiz, for example, at the beginning of a rotation and assign the same quiz after the rotation to see how the resident improved.
How do I achieve the greatest success with Clinical Classroom at my institution?
NEJM Group interviewed several ACGME-accredited program directors to identify some best practices based on the use of the NEJM Knowledge+ platform:
- Introduce JBJS Clinical Classroom at the beginning of an educational year. It’s harder for residents to incorporate a new learning activity at mid-year when habits are set.
- Recognize that this is a culture change. For residents that are further along in their training (e.g. 3rd year and beyond) offer JBJS Clinical Classroom as an additional learning strategy so they are not asked to give up tools they are comfortable using.
- Promote the idea that usage drives success. Setting reasonable usage goals for residents using Clinical Classroom may increase the success of the tool.
- Avoid treating the use of Clinical Classroom as punitive. Clinical Classroom should be promoted as a benefit to enhance learning and improve scores on the in-training examinations2.