6 ms·

The thing that has always frustrated me about anti-cheating/anti-plagiarism software is that it almost always only hurts people that did something by accident o

The thing that has always frustrated me about anti-cheating/anti-plagiarism software is that it almost always only hurts people that did something by accident or unintentionally. When I took the one kubernetes certification exam as part of an old job, you used software like this and at one point I leaned too close to the screen and the proctor couldn't see my face and that got me flagged. People that want to cheat or game the system will find ways, it isn't hard to do. In undergrad we setup a copy of the code checking software that our department used so that we could share code without it getting flagged as copies. I'm sure there are ways to game these systems too if you are motivated enough. One of the issues is also just academia being so hyper-focused on thinking everyone is there to become an academic which is not the case for the vast majority of people. So these exams and the guidelines for student evaluation is grounded in that expectation instead of the reality.

RegnisGnaw 6y ago
>> People that want to cheat or game the system will find ways, it isn't hard to do. As someone who taught a college, that's a flawed statement. Let me propose this to you. You teach Calculus 1000 and there is an end of term exam. Your normal end of term exam is one where everyone sits in the same room, proctors are looking for cheats, things checked, etc. Instead this year you tell your students that this year it will be a take home exam with the following rules: 1) they have 2 hours to do it during the team home peroid; 2) no cheating by the honor system. Do you think the rate of cheating will be the same? I mean by your logic, it should be.
- pwinnski 6y ago
  The idea that an honor code is enough is belied by the fact that software like this catches cheaters, no? I mean, we're obviously upset about false positives, and we should be. But I'm presuming that some people are caught who were cheating, and without the software they would have cheated and not been caught. We can suggest that with an honor code in place, maybe some of those cheating students would have not cheated, because... I mean, if they were willing to cheat with software in place, I'm not sure why would have been deterred by an honor code. I think in about 98-99% of cases, people who claim an honor code prevents cheating are deluding themselves. Yeah, if you don't have any way of catching cheaters, then you can pretend you have a 0% cheating rate. But it's pretend. P.S. I'm not speaking for my employer at all.
  - analog31 6y ago
    It's not certain that the software catches cheaters. It could be security theater. Even the false positives could just be to make people nervous. Where would they get reliable training data? There's a pile of money to be spent on this stuff, and virtually zero accountability. What's that a recipe for?
  - blahedo 6y ago
    I have taught at multiple honor-code institutions (and still do). It does not prevent cheating. However, it shifts focus: I can go about my teaching life starting from an assumption that students are not cheaters—and I'm personally convinced that most aren't. The flipside is that when you do catch a cheating case, you completely throw the book at them. It's legitimately easier to cheat under an honor system, if that's what you're wanting to do... so my assumption is that if we catch you at it, it's likely part of a pattern, and if we catch you multiple times the pattern is irreformable. It is not uncommon at honor-code institutions to expel students on the second offence (sometimes even on the first). I do think that cheating is less prevalent at my institution (and my previous institution) than it is in the larger university population.
- parzivalm 6y ago
  I perhaps wasn't clear enough but I meant solely when it comes to these type of anti-cheat systems being used. Obviously it would be different for in-person vs remote/take home.
  - lolc 6y ago
    I don't see why we should allow for the possibility that the ratio of cheaters would stay the same with or without the surveillance. That could only be true if the ratio of potential cheaters were so low that the threat of detection introduced by the spyware can't reduce the ratio further. We may hate the software on ethical grounds, or because it degrades the exam-experience on many levels, or because its use can be considered abusive, but obviously it has an effect in the intended direction.
- rescbr 6y ago
  I had my fair share of uncheatable open book exams, calculators allowed back in college. One I had on Calculus (or was it Linear Algebra?) was way harder than a comparable closed book exam. You really needed to know the subject to pass vs just memorizing a couple of formulas and plugging them in the right place. Another professor devised an exam that used your student ID as a variable of the first question, and subsequent questions used the previous answers as inputs. Impossible to cheat.
  - RegnisGnaw 6y ago
    > I had my fair share of uncheatable open book exams, calculators allowed back in college. One I had on Calculus (or was it Linear Algebra?) was way harder than a comparable closed book exam. You really needed to know the subject to pass vs just memorizing a couple of formulas and plugging them in the right place. We're discussing this in relation in relation to COVID, so no large gathering. This means no open book in person exams, I'm specifically talking about take home exams. > Another professor devised an exam that used your student ID as a variable of the first question, and subsequent questions used the previous answers as inputs. Impossible to cheat. Really easy to do so in a take home exam.
    - dghlsakjg 6y ago
      If someone can figure out how to cheat on an exam where each answer depends on the previous, and the original seed is unique to each student, wouldn't it show a pretty thorough mastery of the subject matter? I think the larger point is that it is fairly easy in any subject to design a test that is very hard to cheat on. It is much harder to find the resources in modern education to grade that test since each submission is likely unique. Tests that are easy to grade (like multiple choice), tend to be tests that are easy to cheat....
      - RegnisGnaw 6y ago
        The problem is COVID. You can’t have a large gathering. So everyone is doing their exam at home. Please tell me how you would structure such an exam without a proctoring system as described.
jbob2000 6y ago
My partner recently finished her PhD and has started working as a medical writer. During her academic career, it was beat into her head don’t plagiarize, everything must be yours. In her first review after a few weeks on the job, her manager says that she takes too long to do her work; they just need her to take what the client says verbatim, fact check it, and then slap it in a document. She was treating her work like an academic assignment and putting in the effort to craft something unique, when they really just need a fact checking typist. 8 years in higher ed, published study on cancer drugs, thousands of mice died, millions of dollars spent on the lab... all so she can transcribe some text and then validate it against the studies. Academia is the worst job training program ever.
- 0xffff2 6y ago
  Why would she take a job as a glorified typist after completing a Phd? Why is the company hiring a Phd to be a glorified typist? Academia was never meant to be a jobs training program. The fact that many students treat it as such is not really the fault of the institutions.
  - njarboe 6y ago
    Unfortunately each faculty member produces about 30 PhD students in their career (one per year). The number of faculty positions has been close to flat since the 1970's. So one in 30 PhD's will get to be faculty member. She probably took the job because she wants/needs a job and the company likes to have the status of PhDs doing the work.
    - 0xffff2 6y ago
      Sure, so what? Anyone smart and dedicated enough to complete a Phd is smart enough to realize this going in. Surely the vast majority of people getting Phds don't expect to ever become academics and have some other plan.
      - thaumasiotes 6y ago
        > Anyone smart and dedicated enough to complete a Phd is smart enough to realize this going in. No, this isn't true at all. People don't complete PhD's because they looked at their options and thought that one was the best. They do it because other people told them they should, and they just never thought about it.
querez 6y ago
> One of the issues is also just academia being so hyper-focused on thinking everyone is there to become an academic which is not the case for the vast majority of people I'm not sure I follow why this is bad. I think academic rigor and being a decent scholar, as well as being able to parse and produce research are good things (and in my mind, those are the corner stones of being an academic). Did misunderstand you? FWIW, in germany (and likely other european countries) we have a two tier system for higher education, consisting of universities and "applied universities", with the latter focusing on applied skills and the former focusing on research, which in think is sensible.
- parzivalm 6y ago
  I don't think the problem is that academic rigor isn't good. I also should have stated I was talking more about US universities in this particular case. The problem I see is that what you talk about as academic rigor isn't what is taught and evaluated in many of the programs and classes that I've seen or been a part of. A lot of these exams and assessments don't particularly evaluate you on your ability to research and understand knowledge. If I know for example that my physics professor uses a bank of questions then it is much more incentivized for me to memorize that bank of questions vs. understanding the content and working the problems myself. Whereas in say a Discrete Math or Algorithm based class, the final exam/grade is based on a proof you have to write yourself, that encourages (or rather at times forces) you to learn and research like you said. I also think the issue, and this may just be me looking at from my own experience, a lot of people don't want to be scholars, as you put it. They went to a University based on the unfortunate expectation for some jobs that say you need that diploma as your entry ticket.
- alistairSH 6y ago
  in germany (and likely other european countries) we have a two tier system for higher education, consisting of universities and "applied universities", with the latter focusing on applied skills and the former focusing on research While it isn't codified, we effectively have this in the US as well. Most of the "brand name" universities, plus the flagship state universities, conduct research and grant various doctoral degrees. Then we have the middle-tier colleges (state and private) that grant masters (often only professional degrees like nursing, MBAs, etc). And thousands of Baccalaureate-only and 2-year community colleges. Also, in the US, "university" generally indicates a post-graduate degree granting institution. And "college" usually refers to a 2-year and Baccalaureate-only school. But, also not codified and there are notable exceptions (ex: The College of William & Mary is a top-notch full university who's name pre-dates the convention).

RegnisGnaw 6y ago

>> People that want to cheat or game the system will find ways, it isn't hard to do. As someone who taught a college, that's a flawed statement. Let me propose this to you. You teach Calculus 1000 and there is an end of term exam. Your normal end of term exam is one where everyone sits in the same room, proctors are looking for cheats, things checked, etc. Instead this year you tell your students that this year it will be a take home exam with the following rules: 1) they have 2 hours to do it during the team home peroid; 2) no cheating by the honor system. Do you think the rate of cheating will be the same? I mean by your logic, it should be.

pwinnski 6y ago
The idea that an honor code is enough is belied by the fact that software like this catches cheaters, no? I mean, we're obviously upset about false positives, and we should be. But I'm presuming that some people are caught who were cheating, and without the software they would have cheated and not been caught. We can suggest that with an honor code in place, maybe some of those cheating students would have not cheated, because... I mean, if they were willing to cheat with software in place, I'm not sure why would have been deterred by an honor code. I think in about 98-99% of cases, people who claim an honor code prevents cheating are deluding themselves. Yeah, if you don't have any way of catching cheaters, then you can pretend you have a 0% cheating rate. But it's pretend. P.S. I'm not speaking for my employer at all.
- analog31 6y ago
  It's not certain that the software catches cheaters. It could be security theater. Even the false positives could just be to make people nervous. Where would they get reliable training data? There's a pile of money to be spent on this stuff, and virtually zero accountability. What's that a recipe for?
- blahedo 6y ago
  I have taught at multiple honor-code institutions (and still do). It does not prevent cheating. However, it shifts focus: I can go about my teaching life starting from an assumption that students are not cheaters—and I'm personally convinced that most aren't. The flipside is that when you do catch a cheating case, you completely throw the book at them. It's legitimately easier to cheat under an honor system, if that's what you're wanting to do... so my assumption is that if we catch you at it, it's likely part of a pattern, and if we catch you multiple times the pattern is irreformable. It is not uncommon at honor-code institutions to expel students on the second offence (sometimes even on the first). I do think that cheating is less prevalent at my institution (and my previous institution) than it is in the larger university population.
parzivalm 6y ago
I perhaps wasn't clear enough but I meant solely when it comes to these type of anti-cheat systems being used. Obviously it would be different for in-person vs remote/take home.
- lolc 6y ago
  I don't see why we should allow for the possibility that the ratio of cheaters would stay the same with or without the surveillance. That could only be true if the ratio of potential cheaters were so low that the threat of detection introduced by the spyware can't reduce the ratio further. We may hate the software on ethical grounds, or because it degrades the exam-experience on many levels, or because its use can be considered abusive, but obviously it has an effect in the intended direction.
rescbr 6y ago
I had my fair share of uncheatable open book exams, calculators allowed back in college. One I had on Calculus (or was it Linear Algebra?) was way harder than a comparable closed book exam. You really needed to know the subject to pass vs just memorizing a couple of formulas and plugging them in the right place. Another professor devised an exam that used your student ID as a variable of the first question, and subsequent questions used the previous answers as inputs. Impossible to cheat.
- RegnisGnaw 6y ago
  > I had my fair share of uncheatable open book exams, calculators allowed back in college. One I had on Calculus (or was it Linear Algebra?) was way harder than a comparable closed book exam. You really needed to know the subject to pass vs just memorizing a couple of formulas and plugging them in the right place. We're discussing this in relation in relation to COVID, so no large gathering. This means no open book in person exams, I'm specifically talking about take home exams. > Another professor devised an exam that used your student ID as a variable of the first question, and subsequent questions used the previous answers as inputs. Impossible to cheat. Really easy to do so in a take home exam.
  - dghlsakjg 6y ago
    If someone can figure out how to cheat on an exam where each answer depends on the previous, and the original seed is unique to each student, wouldn't it show a pretty thorough mastery of the subject matter? I think the larger point is that it is fairly easy in any subject to design a test that is very hard to cheat on. It is much harder to find the resources in modern education to grade that test since each submission is likely unique. Tests that are easy to grade (like multiple choice), tend to be tests that are easy to cheat....
    - RegnisGnaw 6y ago
      The problem is COVID. You can’t have a large gathering. So everyone is doing their exam at home. Please tell me how you would structure such an exam without a proctoring system as described.

jbob2000 6y ago

My partner recently finished her PhD and has started working as a medical writer. During her academic career, it was beat into her head don’t plagiarize, everything must be yours. In her first review after a few weeks on the job, her manager says that she takes too long to do her work; they just need her to take what the client says verbatim, fact check it, and then slap it in a document. She was treating her work like an academic assignment and putting in the effort to craft something unique, when they really just need a fact checking typist. 8 years in higher ed, published study on cancer drugs, thousands of mice died, millions of dollars spent on the lab... all so she can transcribe some text and then validate it against the studies. Academia is the worst job training program ever.

0xffff2 6y ago
Why would she take a job as a glorified typist after completing a Phd? Why is the company hiring a Phd to be a glorified typist? Academia was never meant to be a jobs training program. The fact that many students treat it as such is not really the fault of the institutions.
- njarboe 6y ago
  Unfortunately each faculty member produces about 30 PhD students in their career (one per year). The number of faculty positions has been close to flat since the 1970's. So one in 30 PhD's will get to be faculty member. She probably took the job because she wants/needs a job and the company likes to have the status of PhDs doing the work.
  - 0xffff2 6y ago
    Sure, so what? Anyone smart and dedicated enough to complete a Phd is smart enough to realize this going in. Surely the vast majority of people getting Phds don't expect to ever become academics and have some other plan.
    - thaumasiotes 6y ago
      > Anyone smart and dedicated enough to complete a Phd is smart enough to realize this going in. No, this isn't true at all. People don't complete PhD's because they looked at their options and thought that one was the best. They do it because other people told them they should, and they just never thought about it.

querez 6y ago

> One of the issues is also just academia being so hyper-focused on thinking everyone is there to become an academic which is not the case for the vast majority of people I'm not sure I follow why this is bad. I think academic rigor and being a decent scholar, as well as being able to parse and produce research are good things (and in my mind, those are the corner stones of being an academic). Did misunderstand you? FWIW, in germany (and likely other european countries) we have a two tier system for higher education, consisting of universities and "applied universities", with the latter focusing on applied skills and the former focusing on research, which in think is sensible.

parzivalm 6y ago
I don't think the problem is that academic rigor isn't good. I also should have stated I was talking more about US universities in this particular case. The problem I see is that what you talk about as academic rigor isn't what is taught and evaluated in many of the programs and classes that I've seen or been a part of. A lot of these exams and assessments don't particularly evaluate you on your ability to research and understand knowledge. If I know for example that my physics professor uses a bank of questions then it is much more incentivized for me to memorize that bank of questions vs. understanding the content and working the problems myself. Whereas in say a Discrete Math or Algorithm based class, the final exam/grade is based on a proof you have to write yourself, that encourages (or rather at times forces) you to learn and research like you said. I also think the issue, and this may just be me looking at from my own experience, a lot of people don't want to be scholars, as you put it. They went to a University based on the unfortunate expectation for some jobs that say you need that diploma as your entry ticket.
alistairSH 6y ago
in germany (and likely other european countries) we have a two tier system for higher education, consisting of universities and "applied universities", with the latter focusing on applied skills and the former focusing on research While it isn't codified, we effectively have this in the US as well. Most of the "brand name" universities, plus the flagship state universities, conduct research and grant various doctoral degrees. Then we have the middle-tier colleges (state and private) that grant masters (often only professional degrees like nursing, MBAs, etc). And thousands of Baccalaureate-only and 2-year community colleges. Also, in the US, "university" generally indicates a post-graduate degree granting institution. And "college" usually refers to a 2-year and Baccalaureate-only school. But, also not codified and there are notable exceptions (ex: The College of William & Mary is a top-notch full university who's name pre-dates the convention).