Learning by Watching Part Three: Real Learning Index

Using a Flip camera can help us uncover data we might not otherwise see in our classrooms. In fact, data can focus our attention so intensely that we see patterns that might not otherwise be possible and, therefore, help us in effective decision-making.  However, when we focus our attention in one area, we may miss what is happening in others. For this reason, while we can use data to get a snapshot of what it going on in our classroom, it is important that we do so knowing data’s limitations.

Such is the case for the Real Learning Index, one way of gauging the learning that is taking place in your classroom.

The Real Learning Index (RLI) combines two forms of data: (a) learning time and (b) student engagement. By combining these two data sets, we can get insight into what is happening in the classroom. However, the RLI is a gross measure, and does not account for either the quality of what is being learned or the depth of engagement. The RLI is a very powerful tool for identifying simple ways to increase student learning, but it is only one tool and, it does not measure the relevance or impact of the learning occurring. As a result, it is important to use it along with other ways of reviewing what is happening in our class.

To gather the Real Learning Index, you will need to set up your Flip camera to record your students’ reactions as you teach. You should set up the camera to see all of the students if possible. After you have recorded the class, you can review the recording to develop the RLI. The first data set in the RLI refers to the percentage of time that is dedicated to actual learning during a class period. To calculate learning time, record the class you’d like to study, and then review the class with your trusty cell phone timer or other timer in hand. Then, time every second when there is downtime (any time students are not learning), such as taking roll, transitions, off-task conversations, student preparation to leave class, and record how long it takes. Once you have reviewed the entire class and you know how much downtime there is, calculate the percentage of learning time by (a) subtracting the downtime from the total class time, which gives you the total learning time, and (b) divide the total learning time by the total time to give you a percentage. For example, if 15 minutes of a 50-minute class were downtime and 35 minutes were spent on learning time, then the percentage of learning time would be 70%.

The second data set to be gathered for the Real Learning Index is student engagement, or time on task. That is, how many students look like they are engaged. To gather these data, set your cell phone on vibrate and set your timer to go off every 10 minutes during your class. Then when feel your phone vibrate, make a quick glance around the room to note how many students are not engaged and record that number. Continue throughout the class period. At the end of the class, average all of the numbers signifying students off task and subtract the average number from the total number of students in class. Divide the average number of engaged students by the total number of students in the class. That will give you a percentage of time on task. If, on average, 21 out of 30 students are on task, the average time on task is 70%.

The RLI is the combination of both of these numbers. In the ideal situation, 100% of students are engaged and 100% of the class time is learning time. If that were the case, the RLI would be 1.00. To calculate the Real Learning Index for your class, write both percentages as fractions. Thus, 70% learning time becomes .70 and 70% time on task becomes .70. Then multiply the two numbers: .70 x .70 = .49.  In other words, if 70% of students are engaged and 70% of the time is learning time, 49% of the potential for learning is being realized, or less than half of the total potential real learning time.

Teachers who want to increase their RLI can work on one of two things: student engagement or learning time. If you increase either of these or both, you increase the authentic learning that is taking place in your classroom.

What the RLI does, in my experience, is make you more aware of student engagement and instructional time.

The Real Learning Index is only one way of seeing the class, but like other forms of data gathering, it sometimes helps us see patterns that otherwise would remain invisible.