Instructional Design and Distance Learning (IDDL) paired up with the School of Education to pilot the Peer Review Process within the Course Design Review Process using OSCQR prior to the Instructional Designer Review. Faculty peer reviewers completed a Peer Reviewer Orientation that included sessions on utilizing and understanding OSCQR standards, and accessibility in addition to participating in a course design review for their course with a peer and instructional designer.

The Online and Hybrid Faculty Fellows Program is designed to provide faculty with collaborative opportunities to advance Buffalo State's strategic goals in the areas of online and hybrid teaching, learning, and course design. Online and Hybrid Faculty Fellows are ambassadors for online and hybrid learning at Buffalo State, helping to establish a supportive community around online and hybrid education by consulting with their peers to increase the quality of online and hybrid courses. This program seeks to align faculty expertise as teaching practitioners with the work of the Instructional Design and Distance Learning team, who are trained and experienced in applying instructional design principles and using educational technology. Online and Hybrid Faculty fellows are selected to work with their peers and instructional designers to support their development of a variety of pedagogical techniques while addressing OSCQR best practice standards. Peer review has been advocated for as an intentional strategy to support the knowledge, skill, and disposition development of adult learners preparing for professional practice in design disciplines, including those individuals preparing for instructional design practice (Chapman and van Auken 2001; Lai and Law 2006). Woolf and Quinn (2001) have defined peer review as “the structuring of a process to allow peers to review each other’s professional processes and/or products with the goal of improving such processes or products” (p. 22). ( Brill, J.M. 2016)

In December of 2021, the College Senate passed a policy on IV:07:04 Online and Hybrid Course Offering, which included requirements for online teaching credentials and a review of Online and Hybrid Course Design for courses being offered. Each academic school was asked to identify approaches to meet the new policy. With the School of Education's (SOE) expertise in teaching and learning and the overwhelming number of course design reviews that were now being expected to be completed by instructional designers in Instructional Design and Distance Learning (IDDL), the utilization of a peer review process which was already built into the SUNY OSCQR tool seemed appropriate and created greater collaboration between IDDL & SOE, in addition to faculty within the school/department. In addition, this allowed faculty to talk with faculty about their course design, teaching practices and share ideas and resources, creating a deeper bond between faculty with their departments. “An instructor-friendly peer review process can be effective in increasing faculty interest in peers' courses, an inclination to share experiences, and willingness to invest efforts and time improving teaching (Nordstrom, 1995)”. (Lewis, Emily 2021)

By adding a peer review step to the course design review process, it encourages the pedagogical content area faculty to maintain ownership and responsibility for all courses they offer. This is intended to support a policy of consistent high-quality course design and mirrors the peer review process that faculty engage in for research and publication. Faculty working together as peer reviewers using OSCQR creates a deeper understanding of instructional design, effective online teaching, and learning from their peers. We are hoping that by piloting this process, we can set a course for the faculty in SOE where ownership of course design is as important as evaluation of teaching by one’s peers. We started with two faculty from the Elementary Education, Literacy, and Educational Leadership (EELEL) department and will expand out to one faculty member from the Career, Technical, and Science Education (CTSE) department and two faculty from the Exceptional Education department. Peer-reviewers have shared that this process has inspired them to rethink their own course design and how they can improve their courses by reviewing another colleague's courses. Wanner and Palmer’s study on formative self and peer assessment for improvement of students learning “has shown that students value formative self and peer-assessment as they can see the benefits of being involved in the assessment and feedback process. They learn both from giving and receiving feedback, gain a better understanding of assessment requirements and use the formative self and peer-assessment to improve the quality of their work. Thomas Wanner & Edward Palmer (2018)

Brill, J.M. Investigating peer review as a systemic pedagogy for developing the design knowledge, skills, and dispositions of novice instructional design students. Education Tech Research Dev 64, 681–705 (2016). https://doi.org/10.1007/s11423-015-9421-6

Peer Review in Practice - https://ucldigitalpress.co.uk/BOOC/Article/1/57/#_Toc460921308 Dorothy Butchard, Simon Rowberry, Claire Squires, & Gill Tasker

Buffalo State Reference Links:
Course Design Review (OSCQR) Process - https://instructionaldesign.buffalostate.edu/course-design-review-oscqr#about
Online and Hybrid Course Offering Policy (DOPS IV:07:04) - https://bscintra.buffalostate.edu/dops/policysect4/040704.pdf
Course Design Review Ticket https://buffalostate.teamdynamix.com/TDClient/2003/Portal/Requests/ServiceDet?ID=33613
Buffalo State OSCQR https://buffalostate.teamdynamix.com/TDClient/2003/Portal/Shared/FileOpen?AttachmentID=4b444839-6807-4caf-a821-6130e72ada3b&ItemID=33613&ItemComponent=47&IsInline=0

Thomas Wanner & Edward Palmer (2018) Formative self-and peer assessment for improved student learning: the crucial factors of design, teacher participation and feedback, Assessment & Evaluation in Higher Education, 43:7, 1032-1047, DOI: 10.1080/02602938.2018.1427698

Emily Lewis (2021) Best Practices for Improving the Quality of the Online Course Design and Learners Experience, The Journal of Continuing Higher Education, 69:1, 61-70, DOI: 10.1080/07377363.2020.1776558

Ross, K. R., Batzer, L., & Bennington, E. (2002). Quality Assurance for Distance Education: A Faculty Peer Review Process. TechTrends, 46(5), 48–52. https://doi.org/10.1007/BF02818309

Roehrs, C., Wang, L., & Kendrick, D. (2013). Preparing Faculty to Use the Quality Matters Model for Course Improvement. Journal of Online Learning and Teaching, 9(1), 52-.

Connecting the Dots: Improving Student Outcomes and Experiences with Exceptional Instructional Design https://opentextbooks.uregina.ca/instructionaldesign2improvelearning/

A history and development of peer-review process Jana, Siladitya A history and development of peer-review process. Annals of Library and Information Studies, 2019, vol. 66, n. 4, pp. 152-162

Evaluating Online Course Quality: A Study on Implementation of Course Quality Standards. Online Learning Journal (OLJ)(Vol. 24, Issue 4) December 2020

Buffalo State began utilizing OSCQR in 2015. The School of Education did not begin collaborating with IDDL on the course design review process until January 2023. Implementing the peer review process introduced OSCQR and the course design review process initiating seven Course Design Review requests, four of which have been completed.

Microsoft Office (Excel & Word) are needed to track review progress and completion of self, peer and ID Review. Faculty stipend was provided from the Deans budget for early reviewers during the pilot phase.

Buffalo State OSCQR https://buffalostate.teamdynamix.com/TDClient/2003/Portal/Shared/FileOpen?AttachmentID=4b444839-6807-4caf-a821-6130e72ada3b&ItemID=33613&ItemComponent=47&IsInline=0