First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons
Have you been struggling at your school with finding a way to encourage faculty to give flipped classroom techniques a try? At The College of Westchester, we found an approach that worked, and the results so far have been very encouraging.
With the growing body of data supporting the effectiveness of the technique, I was eager to see faculty at my institution consider a structured approach to trying flipped teaching and learning techniques. Various instructors had been experimenting with the idea, but there was still a tentative nature to what had been done thus far. Working with CW Provost Warren Rosenberg, a small Competitive Grant was endowed, to enhance interest. Two grants of $1,000 each for two applicants were budgeted for. Applicants were selected through a formal proposal process.
Several CW Instructors submitted proposals for the “Flipped Class Competitive Grantâ€, which was a targeted to those who would be teaching courses in the Winter Day 2014 Term. Proposals from Dr. Christopher Nwosisi and instructor Alexa Ferreira were accepted based on their merit and various criteria including:
- Average grades in all offerings of these courses during the 2012 and 2013 (i.e. lower average grades = more room for improvement in outcomes and better opportunity for greater return on the college investment).
- Completion rates of the respective courses (again, using 2012 and 2013 completion rates as the ‘baseline’).
The Academic Approach
Instructors were required to define and document their approach, and to flip at least 30% of their lessons. Each chose to flip roughly every other week’s content, providing a variety of digital learning materials (videos, podcasts, docs, web-based tools) to be consumed outside of class, coupled with in-class exercises, projects, collaborative group work and work on assigned labs, individually and in groups.
This was a purposeful change to how class time was being used. A key goal and benefit of using flipped teaching methodologies is using class time to provide a more student-focused, personalized learning experience, incorporating increased used of active learning methods (University of Washington).
The Assessment Approach
Quantitative and qualitative assessment techniques were designed and incorporated in the study.
Qualitative Assessment: Qualitative assessments are based on a survey of student perceptions, and instructor perceptions of the course and the flipped class delivery method. This document addresses student perceptions.
Quantitative Assessment: Quantitative assessment techniques include a comparison of final grades in the piloted partially flipped course to average grades and completion rates in prior offerings of the same courses. Results are to be compared to prior offerings of the course by all instructors over the preceding two year period (2012 – 2013), as well as offerings of the course taught only by the same instructor who taught the partially flipped pilot (over the same two year period).
The focus of these assessments is to compare outcomes using two metrics, as follows:
- Average Non-DFW grades: The Average of grades above D will be used as a comparative assessment element for the purposes of this study. F Grades and Withdrawals are clearly failures as Learning Outcomes. Similarly, D grades can also be counted as such, as they are below the 2.0 threshold required for degree completion, and they would not transfer to other institutions. Other academic assessments have used this ‘DFW’ construct (Fusch).
- DFW Rates: The rates of students achieving D’s or F’s, or Withdrawing, with be constitute another vital metric in the assessment of the effectiveness of flipped instruction techniques as a tool to improve learning outcomes.
Summarizing Findings
Both Quantitative and Qualitative results from the Partial Flipped Classed Pilot have been very encouraging. Average grades increased, and even better, DFW rates significantly decreased. From a qualitative perspective, 94% of students responded that they liked this approach to learning and 72% indicated that this approach “Helped [them] learn the material betterâ€.
Below I share a brief look at the Quantitative Results from this initial phase of this pilot study. Note that a second phase will follow this Fall, as we use a similar approach to assess the use of flipped techniques in 3 or 4 additional course offerings.
Quantitative Results Summary
Quantitative Assessment #1 – Average Non-DFW Grades
The graphic below shows how the average non-DFW grade in each of the pilot courses compared to the average non-DFW grade in all offering of the course over 2012 and 2013. As indicated, grades improved in both of the pilot offerings.
A similar analysis was conducted comparing the pilot course outcomes to the outcomes in prior offerings of the course taught specifically by the same instructor who taught the pilot course. Results were similar for the GEN300 course taught by A. Ferreira. For the NET125 course taught by C. Nwosisi, the grades in the pilot course were slightly lower than the average grade in the same course when Dr. Nwosisi taught it over the course of 2012 – 2013 (Dr. Nwosisi noted that the average grades in the evening course offerings were consistently lower than those in our day course offerings and that this contributed to these results).
Quantitative Assessment #2 – Average DFW Rates
The most startling and beneficial result of the Partial Flipped Class pilot was the drastic reduction of DFW rates.
As the graphic below indicates, DFW grades were eliminated in the pilot of GEN300, and radically reduced in NET125. Similar results occurred in comparing prior offerings of the course taught specifically by the same instructor who taught the pilot course.
This last result was surely the most encouraging Quantitative feedback, and we hope to see a continuation of this in the second phase of the pilot this Fall.
Please keep an eye out for Tuesday's post, in which I will share Qualitative Results and a formal write up on this work with further details.
Related Posts (if the above topic is of interest, you might want to check these out):
My Flipped Classroom – I Will Never Teach Another Way Again
2014 EDUCAUSE Horizon Report: Flipped Classroom Will See Widespread Adoption in Next 2 Years
Flipping the Online Classroom – One Professor’s Unique Approach
[…] “Un estudio piloto sobre Flipped reduce radicalmente los suspensos y abandonos en dos cursos del Grado  de” 24 de agosto de 2014, en EmergingEdTech.com […]
[…] yields impressive results, whether the metric in question is satisfied teachers and students, fewer failing students, or more successful integration of technical […]
[…] Technical Subjects Where Application is the Most Challenging Part of Learning: At The College of Westchester, Dr. Christopher Nowsisi has flipped his Cisco Networking Basic course. There is a great of material to cover in this course, and students often struggle with applying this knowledge to labs that they must complete. This is a key reason Dr. Nwosisi has found flipped instruction to be quite beneficial. Students often need help completing the labs, in which they turn concepts into applied knowledge. Prior to flipping the course, students would often struggle at home to do the labs, but since implementing flipped learning, the labs are done in class and fewer students are ending up with D’s, F’s or Withdrawals. […]
[…] “Flipped Learning Pilot Radically Reduces DFW Grade Rates in Two Courses“, August 24, 2014, EmergingEdTech.com […]
[…] To further illustrate the power of the flip as a teaching technique that can produce excellent results without having to put in a huge effort or flip an entire course, consider the first phase of a flipped classroom pilot we’re running at The College of Westchester this year. Two courses were only partly flipped, with a bit under half of the lessons delivered in a flipped style. The two instructors in the pilot produced some exciting results in these courses, significantly reducing the instance of grades of D, F, or W (Withdrawal). As the graphic below indicates, ‘DFW’ grades were eliminated in the pilot of GEN300, and radically reduced in NET125. Check out the full story here: Flipped Learning Pilot Radically Reduces DFW Grade Rates in Two Courses. […]
[…] Traducimos una colaboración de  Kelly Walsh, del 24 de agosto de 2014, fuente original aquÃ. […]
[…] #FlippedLearning Pilot Radically Reduces DFW Grade Rates https://www.emergingedtech.com/2014/08/flipped-learning-pilot-reduces-dfw-grade-rates/ […]
[…] First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons Have you been struggling at your school with finding (RT @EmergingEdTech: Flipped Learning Pilot Significantly Reduces Ds, Fs, Withdrawals […]
[…] Have you been struggling at your school with finding a way to encourage faculty to give flipped classroom techniques a try? At The College of Westchester, we found an approach that worked, and the results so far have been very encouraging. […]
[…] video and I hope it helps to change a few minds about the topic. I came across this twitter post “Flipped Learning Pilot Radically Reduces DFW Grade Rates in Two Courses†which looks at how video not only helps students get better grades but aids retention in the […]
[…] Sunday I shared some exciting Quantitative Results from a pilot of flipped learning that we tried this year at The College of Westchester. Today we continue this look at our […]
[…] Have you been struggling at your school with finding a way to encourage faculty to give flipped classroom techniques a try? At The College of Westchester, we found an approach that worked, and the results so far have been very encouraging.First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons Have you been struggling at your school with finding […]
[…] First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons Have you been struggling at your school with finding […]
[…] First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons Have you been struggling at your school with finding a way to encourage faculty to give… […]
[…] First Phase of a Flipped Classroom Pilot Produces Encouraging Results With Flip of Limited set of Lessons Have you been struggling at your school with finding […]
[…] Flipped Learning Pilot Radically Reduces DFW Grade Rates in Two Courses. Have you been struggling at your school with finding a way to encourage faculty to give flipped classroom techniques a try? […]