Metacognition & Testing as Learning (MeTAL) Study

Department: Anatomy, Dept of Pathology and Molecular Medicine

Abstract

Anatomical knowledge is critical for scaffolding clinical, and functional information essential to health care professions student achievement and eventual clinical practice. Getting to this point however, is challenging for learners and is made exponentially more difficult by students’ typical use of ineffective study strategies. Over 100 years of research demonstrates that the most effective study strategies employ recall and spaced practice to both enhance initial learning and promote long-term memory. Thus, creating course-integrated opportunities for students to develop content proficiency via evidence-based practices is especially important in our field.

The current proposal is aimed at doing just that — developing and evaluating an evidence-based formative assessment tool for use in anatomy courses across the Allied Health Sciences at McMaster. Critically, this proposal builds upon a well-established line of research within our lab group – the AI OSPE (artificial intelligence objective structured practical exam) to expand and evaluate it’s use in a new context — as a formative practice tool. Through this effort, we aim to discern which features of the application (e.g., provided vs. withheld solutions, required vs. optional judgements of performance) best support learning in the context of anatomy assessments which requires the use of image-based questions that test content learned within a real course and via single-word answer responses.

Results of this study will broadly impact anatomy education at McMaster University and beyond. For context, upwards of 2000 students are enrolled annually in anatomy courses offered by the Education Program in Anatomy, all of whom would directly benefit from the inclusion of an evidence-based formative practice application like the one under development here. Further, with progressively improved functionality of our AI OSPE application, deploying this tool as a resource for programs outside of our institution also becomes possible.

From a professional development standpoint, funding this project will further my ability to mentor and be mentored by other faculty, graduate students and undergraduate research trainees, thus expanding my education and research network at McMaster. My current professional goal is to lead my department in education scholarship and further our collective potential to take on new students, teach new courses or offer new degrees by modelling what successful student-partnerships look like and bring to the field of anatomy education scholarship. In addition, I see this fellowship as an opportunity to take an intentional and evidence-based approach to better understanding and applying leadership and mentorship principles in my career. I already do this in my teaching and am eager to expand my capabilities to effect change at the faculty level and ultimately become more prepared to hold leadership positions within my faculty.

MacSPARK (The McMaster Accelerating Chemistry Success Preparation)

Department: Chemistry and Chemical Biology

Abstract

MacSPARK is a pilot research project that aims to support incoming first-year students who are enrolled in general chemistry (CHEM 1A03) or general chemistry for engineers (CHEM 1E03). It is a chemistry bridging program with the emphasis on early diagnostics of chemistry preparation through self-tests, and early interventions through a combination of targeted feedback via virtual group meetings with peers and upper-year students, and one-on-one office hours with professors, together with self-paced studies using online module videos, capped with an evaluation of personal growth and learning via post-engagement quizzes.

The objectives are two-fold: (1) building a supportive and collaborative community through weekly virtual group meetings with peers, upper-year students, and professors; (2) fundamental review sessions related to selected topics from high school chemistry through a learning cycle that consists of diagnostic self-tests, a review of selected instructor-led videos, attending group meetings led by upper-year students, and finally complete post-engagement quizzes. The main driving force to initiate this project has arisen due to the increasing rate that we have seen in early withdrawal rates for students enrolled in CHEM 1A03 and CHEM 1E03 over the past six years. This trend suggests that our students are “giving up” earlier compared to previous years, which has a negative impact on student success and retention. Therefore, it is more important than ever to provide opportunities for early diagnostics and interventions to enhance preparedness and maximize potential success of our incoming Science students.
A deterioration of learner engagement and motivation contribute to high attrition rates for first year undergraduate student. To better support learner motivation, researchers have recently begun investigating the roles of a learner’ sense of social belonging, which may have an impact on student success and retention. This program fosters community building through weekly, 2 hour long group meetings, which are led by our enthusiastic upper year students. In addition to providing students with opportunities to apply the content covered in the online module videos to more complicated problems, the group meetings also provide a virtual platform for students to connect with their peers, learn about future careers, research and co-op opportunities, and program options/resources available to students. In short, MacSPARK sets our incoming students up for success by building a sense of community, as well as preparing students academically by reviewing selected high school chemistry topics that are relevant for transitioning to a first-year chemistry curriculum.

I am part of a group exploring open educational resources (OER) to potentially replace our current textbook for CHEM 1A03 and CHEM 1E03. The philosophy behind the OER initiative is to support students with similar learning opportunities without the added financial stress that often comes with purchasing a textbook. I am passionate about exploring ways to better support our students and to meet their needs, which is what this proposal on MacSPARK is all about. With the support of the Fellowship, I will develop and implement the program, and also evaluate its effectiveness by analyzing these metrics: course-specific withdrawal rates, test performance, and student perceptions of social belonging. I will share these results with my colleagues within the department and beyond. The results collected from this program will further help to illustrate to the teaching/learning community the need for data driven decision making processes.

Evaluation of the impact of team-based learning and open pedagogy in a level-II course in Economics

Department: Economics

Abstract

Although the three-year pandemic has finally ended, it continues to have a profound effect on teaching and learning. The rapid changes in the current digital age, coupled with the rising cost of education and the increasingly diverse composition of classrooms, are also requiring educators to provide rich learning experiences while fostering deep learning and promoting inclusivity and accessibility. This project aims to implement team-based learning and open pedagogy in Intermediate Microeconomics I (Econ2Z03) to address the new challenges in teaching and learning. Students tend to show more initiative and learn more effectively when studying in small groups, and their knowledge and understanding are strengthened through group interactions. Students can build their communication and cooperation skills through group work, which contributes to their future success in the workplace. Students also tend to make friends and establish study groups that carry over to their other courses, which strengthens their sense of belonging. In the proposed project, in-class team activities, including two-stage tests and group discussions, will be combined with outside the classroom group activities that generate multiple-choice questions. These activities will help students achieve a deeper understanding and further hone their research, writing, and editing skills. Such assignments will not expire at the end of the semester, and the resulting high-quality questions will be validated, revised, edited, and ultimately included in an interactive, open-source question bank for future Econ2Z03 students. Students are not passive learners but active participants in creating educational resources, where they can develop a sense of ownership and belonging in the process. In addition, open-source learning resources can help lower the cost of education and promote accessibility.

Qualitative and quantitative measures will assess the impact of team-based learning and open pedagogy with regards to the students’ collaboration, engagement, learning outcomes, sense of satisfaction, and sense of belonging. This project will implement recommendations from the most recent academic program review (IQAP in 2016-2017) to promote the students’ communication skills and improve their economics-related writing skills.

In addition, the proposed project connects to the following impact areas in McMaster’s Teaching & Learning Strategy, and Digital Learning Strategic Framework:

•     Encouraging Partnered Learning
•     Fostering Inclusive Excellence and Scholarly Teaching
•     Developing Active Learning Spaces
•     Advancing Digital Literacy and Proficiency

The project will develop procedures and resources to help other educators implement similar pedagogical innovations in their teaching practices. This fellowship will help to achieve educational leadership goals that include promoting an active learning environment at McMaster, involving student partners in teaching practices, encouraging the development and adoption of OER and open pedagogy, and promoting equity and inclusion.

Implementing a comprehensive framework for nurturing and promoting critical, creative and collaborative thinking in biology courses

Department: Biology

Abstract

The proposed project addresses significant challenges in higher education, including student disengagement, competency gaps among graduates and the need for equitable learning opportunities. With partners at The Critical Thinking Consortium, we will learn and implement a systematic and comprehensive framework that centers critical thinking, creativity and collaboration in lectures and assessments within the biology department courses at McMaster University Through course surveys and ongoing meetings with student focus groups, we will gather feedback and make adjustments to our strategies. In this way we hope to build student voice and agency in learning. In order to scale the use of this framework into other courses within the biology department, we will create a professional learning community comprised of faculty and teaching staff where we can participate in focused workshops and co-construct practical strategies for implementation of this framework. Through peer observation and feedback, we will aim to work together to refine and invigorate our departmental teaching practices.

Within this project, there is an excellent and exciting opportunity to strengthen and hone educational leadership skills through developing a professional learning community and guiding the activities. Additionally, through engaging in self-reflection, actively seeking feedback from peers and mentors and participating in networking activities and events I aim to strengthen my leadership capacity and advocate for innovate teaching and learning strategies that put students at the center. In the first half of the project, over 700 students across 4 courses in biology will be impacted. Through community-based learning and support with faculty sitting shoulder-to-shoulder, we hope to implement this framework in a broader range of courses where we can impact over 1500 students each year. Finally, through networking and dissemination activities, we hope to continue the work from this project and extend it to other departments within the Faculty of Science. Through the innovative teaching and learning strategy of centering our lectures and assessments around a critical, creative and collaborative thinking model, students will benefit by enhanced engagement, building of essential competencies, and access to equitable learning opportunities related
to personal and professional growth.

Please click here to see our 2023 cohort of Leadership in Teaching & Learning Fellows.

Please click here to see our 2022 cohort of Leadership in Teaching & Learning Fellows.

Please click here to see our 2021 cohort of Leadership in Teaching & Learning Fellows.

Please click here to see our 2019 cohort of Leadership in Teaching & Learning Fellows.

To view the 2019 cohort – click on the Faculty based menu across the top and find the fellows under their respective year.

Please click here to see our 2018 cohort of Leadership in Teaching & Learning Fellows.

To view the 2018 cohort – click on the Faculty based menu across the top and find the fellows under their respective year.