A Way to Ungrade, Floop

Speaker 1 Hello, and welcome to episode 78 of our podcast at Human Restoration Project. My name is Chris McNutt, and I'm a high school digital media instructor from Ohio. Before we get started, I want to let you know that this podcast is brought to you by our Patreon supporters, three of whom are Andrea Barrera, Mary Becker, and Michael Hyde. Thank you for your ongoing support. You can learn more about the human restoration project on our website, humanrestorationproject.org or find us on Twitter, Instagram, or Facebook. Today, we're talking about ungrading with the EdTech tool Floop, short for feedback loop, found over at floopedu.com. Now we don't normally talk about specific tools or strategies at HRP. We try to get into the theory and pedagogy of progressive systems. But the most common question we're asked is, well, is it even possible to do any of these things that we're talking about? It just seems like a ton of work. It's overwhelming. Everyone's against me. It just seems really hard to do. Well, one potential solution is Floop. In summary, Floop allows you to easily provide feedback to your students. You can create drop boxes on the platform, students then upload their assignments, and then you are given audio and text based tools to comment on what they've done. You can assign feedback visually through comment banks, see growth over past revisions, and you can see if students have read what you said. I personally love that Floop is committed to ungrading, and you don't have to enter in any grade whatsoever. It's a way to structure your class and do ungrading. The company actively promotes practices to distance ourselves from grades altogether. I myself started using Floop this year, and I'm excited to share it. I think it's a great example of an ed tech company using their tools for actual education as opposed to maintaining the status quo, and it's affordable and ethical as you'll soon find out. In the show notes, I've attached Flute's resources for feedback driven learning, and you can learn more about Flute's pedagogy on our website. Finally, this episode is not sponsored in any way. I'm just excited to talk about it. Christine offered our listeners 20% off for their first year, which puts the platform at roughly $67. Just use the code restore 20 before 10/31/2020.

Speaker 2 It's been quite a journey of many educators and passionate developers kind of finding each other at the right times. I teamed up with a teacher at my school, Elizabeth Matlick, who was an ELA teacher. I'm science and math, and we were both dealing with problems related to, like, getting students to actually read and use feedback. We were really lucky to be at an independent school with fairly small class sizes. We were sort of in teacher dreamland when it comes to having time to give feedback, and then we were like, wait. We're giving the feedback. Like, why is this not causing transformative learning? Right? And I met up at an EdTech meetup with Melanie Kong who teaches high school engineering. She's now Floop's CEO, but she was working on a very similar problem related to, I think, what more classically happens in big US schools, which is that she just didn't have time to get through her paper stack. She knew feedback was important and just couldn't make it happen. And so when we sort of put our heads together, we realized that these are one and the same problem. Like, some teachers don't have time to give feedback. When they do have time to give feedback, they're not seeing it making this big impact. We knew there had to be something going on. We knew there was probably a tech solution out there just for making feedback faster, making it more efficient so it could get to students on time. But we knew that just another tech tool wasn't gonna solve the world's problems. And so we ended up doing a lot of research, consulting both our own practice and sort of the experts doing research out there, and we realized that there there was a lot more to it, that there's this concept of feedback literacy. There's elements of students needing to have agency over their learning for feedback to be impactful. And so we were also able in our work not just to create a tech tool, but also to be able to create sort of a philosophy of giving feedback that that goes really well, I think, with the app. And we're hoping to sort of spread that word, that curriculum, that professional development alongside the tool, and hopefully, one day embedded in the tool is a sneak peek into our hopeful future. That was, I think, 2017 we officially started the company. And, now with the hit of COVID, like, things have really been ramping up. We're hearing from teachers all over the world really that they need solutions for connecting with their students when they're not face to face anymore, and that makes feedback so much harder. So we're kind of scrambling to try to keep up with everybody right now. Yeah. I I love how centered it is. As in,

Speaker 1 a lot of tech tools, they have a tendency to do a little bit of everything, but not necessarily one thing very well. Whereas Floop is very much it's for feedback driven classrooms.

Speaker 2 And it would probably be useful for those that aren't familiar at all to just explain a little bit about how Floop works. Like, what literally is it? Yeah. Absolutely. So Floop is a web based mobile friendly app. So you you sign up as a teacher. You sign your students up with their either Google accounts or just email and password accounts. You create a class. The kids enroll in the class all through their browser, whether it's on their phone or a laptop or an iPad or whatever, and you create an assignment. And it's not a full LMS, so you're not putting all of your curriculum there. It's really sort of a digital Dropbox with feedback superpowers. So students can submit digital work, whether that's a photo that they take on their phone or they print something from OneNote to PDF or they have Google Slides and they pick it straight from Google Drive, it submits the work, and then the teacher has some options. So the teacher can do spot annotated feedback. They can click anywhere on the work, type a comment. They can now do an audio comment. We just added that in the last couple weeks. And sneak preview, we have a very exciting new way of giving feedback coming in the next couple weeks. Every time a teacher leaves feedback, it opens up a conversation thread. So it really encourages students to engage with their feedback, to ask follow-up questions, or to answer teachers' questions if the teacher asked one, and then students can resubmit their work to the same assignment. So you really can create, as a teacher, sort of a digital portfolio of revision and progress either on one assignment or multiple assignments. And then you also have the option of running an anonymous and scaffolded peer review session. So we found and I found in my own classroom that just doing peer review sessions like paper trading really didn't work super well for kids. And so we built a peer review tool that focuses around a single criteria that the teacher sets and then scaffolds the questions that it asks the student to answer so that even really novice learners can produce really high quality feedback for their peers. Yeah. The the peer feedback tool is really cool, and it works really well. And I think some people listening might be wondering, I'm I'm not sure if we've ever actually had an ag tech tool on this podcast because this isn't really our thing. We usually talk about systems and pedagogy.

Speaker 1 A lot of people say, you know, I I wanna incorporate gradeless learning. I wanna do PBL. But as you were saying before, it's just too much work. It feels like it's overwhelming, and the the reward for it isn't always what you expect it to be. And sadly, a lot of LMSs, they don't have the capability. It's something really simple, but Fluke lets you write in the grade. Like, I don't have to put in a number. And that that seems hyper simple, but I've had to, like, design, like, algorithms to convert a quote, unquote letter grade, to make that happen. So it's great for, a portfolio building tool. When it comes to this this feedback driven philosophy, I'm curious why you think this works. I'm sure most people listening probably understand the pedagogy, but what makes Floop particularly good at addressing that pedagogy?

Speaker 2 Yeah. So I think that we as an education system, we as teachers have known for a really long time, and I I mean a really long time, like hundreds of years that feedback is important. But it's really hit or miss whether giving feedback works. Right? And the thing that I think makes a big difference between other tools out there that let you give feedback to students is that Floop also lets kids respond. Like, it's turning feedback from a one directional transmission where the teacher's in the driver's seat telling the student what to do or telling them what's wrong or whatever to a dialogue, to a two directional conversation. So that when I give information to a student, that student has the opportunity to engage with that feedback. And it's really the engagement with feedback that produces learning. It's not the receiving of feedback. So we are really intentional when we're deciding what features we wanna add to Floop or how we even wanna present information in the web interface to students that we think about, like, how does this promote engagement for the student? How does this coach the student in developing good skills around feedback literacy that will carry them forward maybe when they're not using Floop? So that's things like the the way we scaffold peer review and the questions that we choose to ask students during that are both research based, but they're also like, we know that if students ask those questions of each other just in conversation on the side, that it's gonna produce good feedback in that scenario too.

Speaker 1 So, we're we've really been thinking about, like, how can we foster that active engagement with feedback, that feedback literacy just through the using of the tool. Right. Right. And it it seems like you're you're being very, I guess, concise about which elements you add in because it again, I I don't mean this as an insult. It's very simple. That to me is the appealing part of it is that it's it doesn't try to do everything at once and therefore it's easy to understand what's going on. So as we are adapting all these different tech tools, there are a lot of concerns especially in virtual learning when it comes to, well, what is the the EdTech company's gambit? What are the are they trying to get at? Is it a huge moneymaker? Is it a data privacy thing? Even something as simple as, like, Flipgrid, which I use. I like Flipgrid, but it's also owned by Microsoft and sells student data. And it's I mean, explicitly in the terms of use says that we will sell student data. And it's like, oh, great. And when students don't have the option Oh, I didn't wanna know that. I didn't know that. Now I do. Oh, man. I know. Exactly.

Speaker 2 Like, there's all these great tech tools, but there are data privacy concerns. There's there's concerns about if students can opt in and if they can't opt in. Like, what does that mean? So could you talk a little bit about your company's ethics surrounding student data and its use? Yeah. Absolutely. So we, like I've said, are a company of teachers. And I I don't just mean like we used to be teachers. Like, I am in the the digital classroom right now full time. And so we are creating both our company and our tool with teachers and students in mind. I will elaborate on that, but without further ado, we take student data privacy very seriously. We do not sell student data. We do not loan it or rent it or any of the other crafty ways that that companies are getting around saying that they sell data. We have a what we consider a pretty robust consent system, which requires that any students under 13 are getting consent not just from a teacher, but from the school or district before they use the service. We ask students over 18 to review our terms of use and consent to them themselves, which has not really been a very easy system for us to build in, but it was one that we knew was really important. And we try to stay up on all of the changing things happening with GDPR and with COPPA and all the other regulations that sort of tell us what best practice is. We are also engaging right now in some research related to feedback, and that looks like analyzing data from the app to see what people's practices are. That is something that we think is really important. That's something that we can do as a company with the data that we have that will benefit education directly. And it's also something we have taken our time with because we wanted to make sure that we were doing it in an ethical way. So we've been working in partnership with a researcher who will pass his research plan through an ethics board to make sure that we're, you know, getting appropriate consent using the data in a in a responsible and ethical way. But so, essentially, like, every step along the way, we have said, like, what are teachers and students gonna expect of us as a company with the way that we

Speaker 1 inform them about the way their data is being used and also use their data, not just, like, what does the law require of us? I I'm trying to brainstorm now from the practical side of things. If I were a teacher and I didn't already use Floop, the the common, like, q and a type questions that would take it from me to adopting this now that I understand the the pedagogy, I understand the the practice. What in your view would be the major limitations for someone that was seeking an app for grade less learning or for feedback driven learning? They see Floop.

Speaker 2 Would there be anything preventing them outside of, like, a cost? That's a great question. So I would say that the the number one thing that we are hearing from users right now that is a block or a potential block for them is LMS integration and authentication systems. So we are hearing, and I am also very much dealing with in my own classroom, an issue of just, like, login overload. Like, our kids just have way too many passwords to keep track of, way too many different platforms to learn and to troubleshoot when they're not working well. And we know that asking teachers to pick up one more sort of, you might call it, a la carte system is really hard. And so we are actively right now working on LMS integration, rostering SSO through a variety of different platforms. We know that that's important. It's also really hard from a technical standpoint to do it and do it well, and you can tell that a lot of the companies out there are are still sort of figuring it out. In fact, like, my school just switched to Canvas this year, so I am not only learning remote learning, but also learning Canvas and finding that, like, half of the LTI integrations aren't working correctly. So we wanna make sure that if we're gonna launch something, it's gonna be ready when we do it, but we know that that's important. I think some of the other blocks are really around, like, figuring out how to use it well or, like, integrate it into your system in a way that's effective. So if you're gonna use Floop as just a digital Dropbox and not a feedback platform, it might not meet all your needs. Like, if your goal is just to have a place for students to turn in work, we can do that. Like, you can turn in work on Floop. You can't turn videos in. Like, you can't turn, you know, full Excel spreadsheets that are interactive in, but you can turn photos in, and you can turn PDFs in, and you can give feedback on those things. So I think really asking yourself, like, what is the need that I have and what's the potential of this tool before deciding that you wanna onboard. But we find that teachers who really dig in and use it both to collect work and also give feedback and do peer feedback on it are finding pretty impactful outcomes from from switching over to Floop from, you know, maybe a system like just using their LMS. Right. Right. I mean, in my experience, using the LMS for grading is you I mean, obviously, you have the number there, which automatically is going to disassociate any comment that's there. But, also, the way that comments work in almost every LMS is very much an afterthought, and it's very difficult to navigate to. I like the fact that Floop has the like, you could not only is it easy to see what's going on, but you can tell if they've seen it.

Speaker 1 Like, it it pops up and tells you. That's highly beneficial,

Speaker 2 especially in virtual learning where I'm not sitting down with them and explaining to them what's going on. Absolutely. And I am I've sort of been crafting this sort of philosophy of ed tech over the last couple weeks as I've been onboarding to Canvas, and not to pick on Canvas. I mean, it really has a lot of great potential for us as a school, but it very clearly started as a grade book. Right? It started as a place for assignments to be posted and stuff to get collected and grades to be put up. And I think the same is true for most LMSs, and Floop started as a feedback tool. And, yes, we are considering adding on some sort of whole class or whole student metrics that you might be able to call a grade book. Although we have some fun plans for making it what we're gonna call a growth book instead of a grade book. So it's not gonna be numbers focused. It's gonna be engagement focused. But I think, like, really at the core, the fact that we're feedback focused means that anything we develop is going to foster that feedback forward, that sort of like, feedback should be the first thing that you engage with. So there's a very interesting study that just came out this summer from researchers in The UK, Winston et al, looked at sort of the classic finding that I think researchers had since the mid eighties of that grades don't really produce meaningful outcomes, but feedback does, and that grades override feedback when you give them together. But they're finding that LMS systems actually make that worse. And the reason is that an LMS system generally creates a physical spatial separation between comments and scores. So traditionally, you might pass back a test and it would have the grade at the top and then all the markings on the test, and the kid would kind of flip through to understand, well, where did I lose all these points? Right? Which is not ideal, but at least they're looking at both things. And they're finding that now with LMS systems, the kid gets the grade first and has to click multiple times to see any comments or feedback. And so, like, a huge percentage of students are never even seeing the feedback that comes with the grade. So I think that that's something that we need to just be really mindful as we're moving into a more tech heavy remote learning or hybrid learning world is, like, what information is being presented to kids first? What's the candy? Like, what's the easiest thing for them to get to?

Speaker 1 And even if you can't use a system like Floop, how can you hack the system you have to make it feedback forward? Yeah. Yeah. Yeah. I I'm totally with you. That study sounds really interesting. I I'm gonna get a hold of that. I'll, like, put in the show notes Because the I'm completely with you that the way that we run LMSs, in virtual classrooms, gets very much in, that rank and file. Like, we have a 120 kids. Let's get them through and get everybody a one out of zero, whatever it might be. It's not only dehumanizing to the student, but it's dehumanizing to the teacher. It no longer feels like school. It just feels like I mean, the assembly line thing is overused, but this is a true example of, just kinda get through the queue and then end it. Whereas grading should be, if it has to be given something that's at least conversational, and the feedback driven, as you're saying. Where do you see the end game? So I know you're bringing up, like, a few things that are along the way. What is your end product? What do you really wanna see at the end of Floop's life cycle or as it continues to grow? Yeah. That's such a great question. And don't hold me to this because, you know, things change as as companies evolve. But I think our dream right now is that we are serving

Speaker 2 teachers and students in their feedback journey. So we are very much hoping to do embedded just in time professional development for teachers. That's something that we're gonna be working on long term. It's not coming right away, but thinking about either incorporating machine learning, AI type technology that can say, like, hey. I see you're giving this type of feedback. It seems to have these sorts of outcomes for your kids. Why don't you try this type of feedback instead? And similarly with students, like, I see that you're giving these sorts of responses. Why don't you try this instead? Also, being involved in the research that supports doing that in an effective way. So not just sort of shotgun approach, like, maybe we try this thing and see what happens, but really building research into that. We are also hoping that maybe we can become the type of platform that handles feedback. And I don't wanna say grading or LMS because that's not what we wanna be, but I think becoming a slightly bigger platform that encompasses portfolios, actual tracking of growth, not just tracking of scores, and, like, revealing of patterns across courses, across years in a way that helps teachers, I think, target in their time and energy to the students that need it in those moments and help students recognize earlier when they need intervention, those sorts of things.

Speaker 1 Hope this conversation leaves you inspired and ready to push the progressive envelope of education. You can learn more about progressive education, support our cause, and stay tuned to this podcast and other updates on our website at humanrestorationproject.org.