7 ms·
As a teacher, my answer to publicly available AI, regarding grading, has been to only let work by students I have seen been done myself (or staff, trusted impli
by oerdier 2y ago
As a teacher, my answer to publicly available AI, regarding grading, has been to only let work by students I have seen been done myself (or staff, trusted implicitly) count towards passing/failing/diplomas.
This means graded longer tasks such as writing or programming, which in the past were done outside of class and then handed in, are instead done in person (like most exams are, traditionally). To acknowledge the longer process, the time alotted for such a test is much longer (up to 3 hours instead of 1) and I can expect less of work created in 3 hours than work created over 6 weeks.
Students still have the opportunity to hand in work that was done outside of such an in-person test, which I will grade, but that grade isn't on the record is serves only as an indication.
I wish I could trust students, but plagiarism has become so easy now (added to a zeitgeist of personal gain above all) that a critical mass fails to resist.
I think diploma's are very useful. They get their usefulness from the trustworthiness of the party handing out the diploma. Only recording grades for work that has been done in an environment controlled by that party has downsides, but in the current and foreseeable situation I don't see a better way of maintaining a base level of trustworthiness.
I love teaching without grades or diplomas involved so much more. Then it's all about doing what's best for the students.
- candiddevmike 2y agoAre you seeing a shift in class duration to accomplish this? For my kids, I don't see how their classes can squeeze both instruction time + work time in the allocated slots. Is instruction time being sacrificed or "replacing" homework (watching videos/reading text at home)?
- oerdier 2y agoIn principle nothing about the structure of the course has to change. You can keep an existing course with instruction during class and and working on a project outside of class. Even handing in the project and grading could stay the same, although the grade for the project wouldn't be recorded and would serve only as an indication. You then add a longer test at the very end, for a grade. How I set up my course is different from traditional education. Most instruction happens from self study (including videos and software). Face to face time is for questions. All elements, material, staff, and students, have to be tuned for this setup to work though and is hard to pivot to in existing setups because education (in the Netherlands at least) is very entrenched. This self-study centered learning approach, like the in-person tests instead of projects, comes from necessity. Great (and I expect ever increasing) teacher shortages.
- orwin 2y agoA friend of mine seems to have switched to a "exercise/exam in school, learn at home" methodology, where the next lesson is given in sheet format at the end of the hour, and "school" is mostly exercises he uses to see how much each student understand. It seems to be quite happy with this, and told me good students are quite happy with this (lessons are learned at their own pace), and poor ones now have more time with him helping them during the exercises. Only issue is that he now have troubles not talking to/helping students during exams and now really hate those (always disliked them as well as grading, but now it seems worse). He also heavily encourage student to learn with each other during "perm" hours (basically in highschool, hours where student have to stay in school but have nothing to do and can work on their own, go to the library or play/chill/whatever), but that was before and because he fondly remember the days where all 26 of us, the full class, all teamed together against homework (yeah, i had great classmates)
- JohnFen 2y ago> my answer to publicly available AI, regarding grading, has been to only let work by students I have seen been done myself (or staff, trusted implicitly) count Of all of the tactics I've heard teachers taking, this is the one that seems both the most effective and most fair. It's a terrible thing that it's necessary because it's a less effective use of classroom time, but it's hard to think of a better approach.
- nomel 2y agoMy prediction has always been that schools will shift to proctored exams, and job placement rates will eventually be the only metric that matters for students. I think it's an advantage for the schools to ignore AI for as long as they can though, since higher pass rates means more students paying the full cost of tuition, and better graduation statistics.
- hobs 2y agoI think the problem is we think using another KPI will obviously solve the problem. Using job placement as a rate just encourages nepotism and self dealing though - uni's have been caught giving say, an average salary of an outgoing degree by including an NBA player who got it before making millions shooting hoops.
- klyrs 2y agoYou're basically describing the saga of code bootcamps before they all tanked in a blaze of VC
- madrox 2y agoI think you're absolutely correct. I worry that the uncomfortable truth AI is revealing is that essay writing is a less essential skill than we'd like to believe. We can say things like "personal gain above all" and the pursuit of a diploma being our downfall, but I can't help but wonder if it would be better if we just got rid of essay writing altogether or wait until the student knows what kind of writing they want to do. Of course you prefer teaching without grades; the only people in the room are people who want to be there.
- ryandrake 2y agoI kind of agree with this and am willing to take it even further: Why should I even study a subject that I can just ask a computer to explain to me when I need it? AI isn't quite there yet in terms of reliability, but there may be a point where it's as reliable as the calculator app, at which point, does it even make sense for me to study a subject just to get to the mastery level that is already matched by an AI system? If I need to know when Abraham Lincoln was born or when the Berlin Wall fell, I could either 1. memorize it in high school history class to demonstrate some kind of "knowledge" of history, or 2. just look these things up or ask an AI when I need them. If the bar for "mastery" is at the level of what an AI can output, is it really mastery?
- JohnFen 2y ago> Why should I even study a subject that I can just ask a computer to explain to me when I need it? Because studying a thing is a world apart from having it explained. When you study a thing to gain understanding, your understanding is not only deeper but you are also learning and practicing essential skills that aren't directly related to the topic at hand. If you just have a thing explained to you, you miss out on most of the learning benefit, and the understanding you end up with is shallow.
- drdaeman 2y ago> If you just have a thing explained to you, you miss out on most of the learning benefit, and the understanding you end up with is shallow. Sorry, but I don't get this. Isn't this exactly what the teachers/lecturers and books do - explain things? Sure, you have to practice similar things to test yourself if you got everything right. And, of course, it's different for manual skills (e.g. knowing how to make food is kind of different from actually making food). But a language model trained on a education materials is no different from a book with a very fancy index (save for LLM-specific issues, such as hallucinations), so I fail to see the issue in ability to get answers for specific questions. As long as the answers are accurate, of course. And - yeah - figuring out if the answer is accurate requires knowledge.
- nerdjon 2y agoI can see the value in this approach, but I also know for myself this would have been horrible in school. I was always a horrible test taker (the pressure being a large part of that, but not all) and I often needed the time outside of class for any papers I need to write. No matter how much I tried, it just wasn’t happening in class. I acknowledge the problem but I would be worried how this could negatively impact a lot of people.
- oerdier 2y agoYou're right that some students fail only because of the way they are graded. Although with the right preparation this number can be quite low, it's never zero. It's heartbreaking to see some fall between the cracks, but I don't think it's feasible to get to a system that works for every single person.
- JieJie 2y agoRight. At my school, the accessibility option for tests is to give us more time. A three hour test would be made "accessible" by extending it to six hours or even more. I was really hoping AI would make our world more accessible, not less. (eta) Additionally, it would take more instructor or docent time, because no one can't be trusted to actually learn the material we're paying tens or even hundreds of thousands of dollars for. It ain't the future dystopia I'm afraid of, it's the one we're creating this week.
- rimunroe 2y agoThanks for bringing this up. I nearly failed out of college before getting accommodations for anxiety. I was a physics major and was solid with math, but sitting down to take a test I’d forget how the most basic properties of multiplication and exponentiation worked. Once I started being able to do untimed take home tests (due to accommodations) I started doing well. With the pressure off I was also able to finish the tests much more quickly than before.
- jolmg 2y ago> As a teacher ... tasks such as writing or programming I hadn't realized programming was being taught pre-university. From a quick look online it seems high-schoolers may be learning Python. That's pretty cool. Wonder how widespread this is, and how early children are taught.
- quasse 2y agoMy high school had several years worth of programming courses available, and that was in the 2000s. Now days American high schools are becoming much more focused on teaching technical skills again (thankfully). There's a renewed focus on teaching things like CNC machine programming and robotics alongside traditional computer science courses.
- ericmcer 2y agoMy kid is in a programming class, so far it has been... kind of a joke. Extremely controlled environments and dragging "code" around in the form of colored blocks. I wish they taught JS/HTML web dev stuff. Even if someone only gets a year in the knowledge will stay relevant because they are using the internet daily. Just basic understanding of cookies, http, IP addresses, etc. is something kids should know.
- andybak 2y agoSo you've just completely dismissed Scratch/Blockly which has an illustrious and fairly respectable history. I'm not saying it's the be all and end all, but the way you tossed it aside with scare quotes felt a little... flippant?
- owlninja 2y agoNot sure your location or grade of your kid, but mine started on Scratch in school as well and in 6th grade they had started using Python.
- viraptor 2y agoScratch is great. I used it when teaching and it allows kids to focus on the goal rather than deal with concepts like syntax errors and compilers. Sure, they can learn more later, but at the level of "computers follow instructions, you know?" it's a very appropriate tool.
- Terr_ 2y agoIt's also worth pointing out that this approach is valuable in protecting against some very traditional risks too: Content that was ghostwritten or plagiarized from another human. LLMs simply made it easier and cheaper to cheat in the same sets of circumstances. > but that grade isn't on the record is serves only as an indication. I think that kind of output is often under-appreciated, especially by students. Even as pure advisory feedback, a grade on a subject or section helps people recognize where to allocate their limited time and effort.
- FloorEgg 2y agoHey there is a company examind.io that has a product that lets you assign writing assignments for students to do on their own time in their UI that runs in the browser, and it tracks every keystroke and interaction by the student and analyzes it to determine whether it's the student writing or if they are copy/pasting or transcribing it from AI. Also it has option to give student access to AI research assistant right in the software so you can inspect how the student is using AI to help with their work. I think it might give you the assurance you need while giving the best experience and opportunity for your students to do honest / hight integrity work with the latest (AI) tools. The benefit of forcing students to write their grades work in person is you know it's coming from them, but the downside is it's a very artificial test not representative or what real world work will be like. I think examind can give you the best of both.
- joatmon-snoo 2y agoAssuming you're the founder, this is the type of BS comment that makes the rest of us hate AI founders. It's vacuous, makes vague claims that don't leave room for proof/disproof, and doesn't offer any reason that it's any better than a prompt that asks GPT4o "was this generated by AI y/n"
- FloorEgg 2y agoI am not the founder. Also I pointed out they track user actions and keystrokes and analyze them, which is clearly distinct from just pasting the students work into an LLM and asking if it was generated by AI. I'll go further to say that they can tell if the student left the browser window and for how long. Also natural essay writing patterns are different than transcribing something from another source. I'm pretty sure they have more methods but I don't remember them all. Your comment is full of unnecessary animosity and resentment and I think it is inappropriate. I know the founders and I also know they have very happy customers. Just because you have experienced some vapor ware startups or whatever doesn't mean every company is one... I shared it with the OP because it sounds like they care about the problem the product solves. Lastly, I want you remind you that the very first line in the community guidelines is "Be kind. Don't be snarky". I find your comment both unkind and snarky. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- iambateman 2y agoThe question that came to my mind was "how do we give children the opportunity to think through problems which cannot be processed in two hours?" I don't know the answer.
- JohnMakin 2y agoTeach critical thinking before the college level - ideally well before. Much of the issues with overly relying on these tools boils down to a lack of critical thought - analyzing the output of these things critically, once you reach a certain competence of writing, will lead you to quickly realize you shouldn't overly rely on it, or maybe even use it at all.
- downut 2y agoI have no idea what it is like now but a significant part of the testing environment at Georgia Tech in the early '80s in the highly competitive engineering fields was "impossible" exams. These involved a timed in-class exam of an hour (sometimes two) where it was not possible to solve the major points problems analytically within the time limit, but a variety of approximation techniques were available. The highest scores came from understanding how to deploy the fastest approximation techniques. Unlike many of my classmates I was really good at the mathematical part of the exam questions and could straightforwardly solve them analytically. However, this took too much time! I bombed several important exams learning that "good enough" is an important attitude to have when solving engineering problems. I hated this intensely at the time. (Never give that Stalinist institution a dime till I die.) BUT. There's a reason I went into numerical analysis in graduate school. Which I loved then, turned into a transient career that I enjoyed immensely, and remember fondly. I doubt this approach is feasible for non-engineering disciplines. [edit: redundancy removal]
- more_corn 2y agoGive yourself a few more hours to think about it. These things can’t be rushed.
- oerdier 2y agoIt's hard, but you can create tests that you can only pass if before you've processed a problem for weeks.
- dianeb 2y agoIt's really difficult to plagiarize if you write the paper or take the exam in class using paper and pen-or-pencil. It's also difficult to plagiarize if the teacher/professor/TA actually wanders around the room during the test (without stopping behind a student and raising the student's blood pressure in the process.) Of course, that involves more on your part as teacher/professor -- you actually have to teach and test and act as editor -- on an ongoing basis. At university, that's part of what TA's are (or should be) expected to do. As a teacher, it's your responsibility. So, if you happen to be a CS 101 instructor ask for the evolutionary copies of a program. If you happen to teach poetry and cover Herrick, ask for an original poem in the style of "Upon Julia's Dress" and see what the students happen to see from the same poem. Teaching without ensuring that learning happens is a waste of time and a disservice to your profession.
- pants2 2y agoIt seems to me that AI detection is best done in the editor itself. If you track a student's mouse and keyboard there should be a clear distinction between someone plagiarizing (even if they're re-typing word for word) vs writing genuine work - which would involve lots of backtracking and editing.