the professor has all the power in the classroom. If you don't want cheating, define better conditions for the exam. You allowed a take-home exam which means students are able to use any and all resources.
They're going to have change everything so use of an AI assistant doesn't matter because once they graduate they're just going to continue using it anyway.
If it's a math for finance course then some kind of model building for the midterm and being marked on the quality of the model or something. If AI becomes so good that it always chooses the best fitting model and requires no numerical optimization then they will have to change the courses to be more like UChicago where it's primarily undergrad directed research but AI assisted.
Because for many a college degree is a pure formality to land a job.
My first job out of college, I worked with veterans at the company who all got in with a HS diploma. Now you realistically need a masters degree to be competitive, for no other reason than that where I live (Norway) most applicants have a 5-year masters degree. It is basically academic inflation.
Here we have a tongue-in-cheek word "Mastersyken" which translates to "Master's illness/disease", a word for the phenomena that too many people are pursuing a master's degree for the sake of the diploma alone, trying to become more attractive in the search for a job, but with the side effect that suddenly "everyone" has a master's degree, and in the end everyone is stuck at the same place as before, but with extra student loans.
The worst part is when you start working, and indeed discover that this is a job you could have done just fine straight out of HS.
Apparently some students aren't actually interested in learning and view the diploma as a meal ticket rather than a meaningful credential. Or perhaps the university is just seen as a networking opportunity.
If students don't want to be there in the first place and/or don't see any value in learning, it is unsurprising that they'd take the easy way out. Or maybe they cheated their way into Brown and are just continuing.
But I was always interested in learning, and understood that cheating was a method of learning avoidance. Why waste the amazing learning resources - faculty, teaching assistants, courses, labs, libraries, studios, rehearsal spaces, interesting speakers, arts and culture events, computing facilities, maker spaces, etc. - that are available at a place like Brown?
When it costs a lot of money, the failure itself costs a lot of money. And you cant afford it. Because failure means you paid a lot of money for nothing.
An expensive education comes with higher temptation to cheat.
> then you just skip the education part? Why bother?
You've never put anything off in your life or taken the easy short term route? Come on this is not difficult to understand. You aren't different either.
i mean, even if you are truly there for learning, doesn't it make sense in a low risk setting to try and boost your grade? it's different if you're cheating on your homework or other learning, but there isn't much learning left to do on the exam, that's for the grade
Take home tests were always rife with cheating, although it's probably worse now.
Teachers really need to stop doing it, it's so destructive to create a metric that tracks how well you can cheat and lie, and basically forces you to cheat and lie (because everyone else is) if you want to get a job.
When you're a student in a competitive program at a top university, graded on a curve, and you know your fellow classmates are cheating with AI, you have little choice but to do the same. Especially when jobs for new grads are harder to come by and there's more pressure to also go above and beyond with internships and side projects during your time in school. There's no way to compete without cheating.
> graded on a curve, and you know your fellow classmates are cheating with AI, you have little choice but to do the same
You always have a choice. The right move, in this case, is to raise a stink to administration, donors and politicians. Hell, use AI to do it. Schools refusing to punish teaching is a problem that’s leaking into business and politics.
This is bullshit and basically this kind of justification is part of the moral and ethical rot of most institutions in the US now. You do have a choice, you just want to pretend you don't to get away with it. Besides, no one outside of a few stuffy finance/quant shops ever even asked what my GPA was in college, they don't care.
I wonder if for certain fields, like finance, that itself would be a positive signal for the corporation that actually would prefer workers with quite flexible ethics and mores who are focused on "the bottom line"..
Administration needs to eschew "technology" and demand analog solutions: hand written exams in proctored rooms, no devices out in the classroom, no take home work, etc.
Ensuring integrity definitely requires in person proctored exam centers. It does not require hand written exams.
Hand written exams are either very labor intensive to grade or are confined to multiple choice, so either inflationary to cost of education or inauthentic / inaccurate representation of most knowledge and skills.
The best answer, which enables authentic meaningful high integrity assessment that is also unit cost efficient is to have testing center facilities with institution supplied devices and well trained proctors.
This way instructors can assess students in ways that are relevant and authentic to the subject matter while ensuring the assessments are accurate, consistent, fair and actually reflect the students abilities.
The whole discussion consistently fails to acknowledge that, in a day where we have a Supreme Court Justice who cannot define "woman", education devolves into anarchy.
I would argue the barrier to cheating has become lower just by virtue of how easy it is to do it now. You open an app and type your question. Rue if different from Brit where you had to basically have either a skill in cheating to find and adapt the right resources or you would have to have money to pay someone to do it for you. AI as the great equaliser I suppose.
> This year, the economist decided that both the midterm and the final exams for his course would be of the take-home, closed-book type (there is a certain tradition of this at Ivy League schools).
These news articles are just tiresome at this point. Obviously folks cheated previously, obviously it's easier now, obviously the answer has been to not have take homes all along.
As of now chatgpt subsidies its consumer subscription-I wonder if cheating on exams will be still promiment once students are forced to pay $30 a month
His research is in Game Theory. He should have realized that, in a situation where all competitors are (possibly) using LLMs, the game theoretic optimal choice is to use LLMs.
Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
I graduated from the University of Washington about 8 years ago. Even then we had to write our code on paper for exams. Every missed semi colon was marked. This isn’t a new practice and I’m surprised more colleges haven’t already been doing this regardless of AI.
> He has conclusive evidence that at least 50 students cheated on the March midterm exam, making it the biggest known scandal at Brown and in the entire Ivy League
I'd like a citation for this being the "biggest known scandal" in the "entire Ivy League". Frequently such situations are kept somewhat quiet, for a variety of reasons. But fifty students is not a large number in courses that can enroll hundreds or up to a thousand students.
It's the old game that he's trying to preserve. It's time to move on to the new game. When the landscape shifts beneath you, its very low probability that the existing structures on the landscape are a good fit for the new landscape, and the structures on the new landscape must be rethought from first principles.
"This year, the economist decided that both the midterm and the final exams for his course would be of the take-home, closed-book type (there is a certain tradition of this at Ivy League schools). “It’s a very nice kind of exam, because as you’re giving students practically unlimited time to complete it, it lets you make it harder than normal, to see how far they can go.”
...
"But it also hurts him that the one time in 34 years that he decided to offer a take-home exam, for highly justified reasons, the response was wide-scale fraud."
-----------------
Not to in any way defend or condone academic misconduct, the fact that this was his teaching-career-first take-home exam is probably relevant. Take home exams can be fiendish. I remember having one in grad school where we were given a very insufficient 36 hours to complete it, and many people just didn't sleep. That was from a prof who knew what he was doing. This guy may have accidentally made his exam absolutely sadistic.
Couple this with the fact that students often have other exams they need to be studying for in the same time window. The pressure can be immense. The temptation to use AI to help is going to be hard for many to resist unless the penalties are severe and strictly enforced.
AI cheating is probably going to be a problem going forward in all situations, but open-book, take-home tests are going to bring it out more strongly than other test formats.
The problem is that kids, even (or especially?) in the elite schools, are treating college as a box to tick. At the Ivies, for many students, it's nothing more than the requisite means to get their ticket punched so they can become/remain part of the elite class. This has been the conventional wisdom for half a century.
Now, this paragraph doesn't apply to an economics class like his, which is actually a useful degree, but many students will never use what they learn in college in a professional capacity, so it barely even matters if some (maybe even most?) students cheat because outside of the useful degrees, it's mainly a sorting hat to determine who works at Starbucks to pay back student loans, while rolling their eyes because of their 'valuable degree,' and who works there unironically, to pay their bills.
What needs to happen though is that students at all levels need to either believe that they need to learn what they're choosing to take courses in, or even better, actually innately want to learn it to satisfy their own interest. Either will do. If you have neither intention toward the material, of course you'll cheat your way through it. No student who actually wants to learn would waste their time and money taking a class only to not learn, and cheat their way through it.
Back in my day, you could also just Google the problems and find the solutions. What mitigated cheating at UVA was the honor code and each professor's faith and trust in our integrity. That culture was enough to not cheat.
Imo, the fix should be to work on culture. Cheating should always be a tempting choice, so that the student may challenge their integrity, which is a muscle that can atrophy.
I have seen it firsthand in the CS department here at Dartmouth. It is bad.
We're currently designing a new intro systems curriculum, and we're thinking of it as an adversarial problem. That is, we're designing the course to ensure that a student optimizing for the best grade per unit work still meets our learning objectives. That means, as everyone else is saying, paper exams, but also 1-on-1 interviews to check that students understand each assignment they turn in. These interviews feature both factual questions ("You're using this macro from that library. What does it do?", "Please describe what this function does and how it works.") and conceptual questions ("Why is this code structured this way instead of $whatever?", "How else did you try solving this?", etc.) This doesn't stop students from generating code, but at least they have to understand that code in detail.
This is not as good as writing the code yourself, but how much worse is it? For math classes, this gap is gigantic. Obviously, understanding someone else's proof is much easier than writing your own. For programming classes, I think (without evidence) that the gap is somewhat smaller.
My experience from the past is that when this kind of evaluation is made clear up front, the students know what to expect and either do fine or drop the class in the first week. If you start with take-home exams and then spring paper exams on them halfway through the course, then half the class is cheating and won't be able to recover, as we read in the article.
In general, our students are somewhat motivated by an abstract desire to learn, but are much more motivated by grades. If there exists a straightforward path through your course that leads to a good grade without doing much work, most students will take it. (Our undergrads' course review website is literally called "Layup List." They are actually this shameless.) It's our job as instructors to ensure that all paths leading to a good grade either require learning the material or are more difficult to pull off than just learning the material.
It's best not to blame the students. They are good at optimizing metrics; that's how they ended up here in the first place. We just need to better align the evaluation metrics with the outcomes that we're looking for.
When I visited Yale recently, a professor who taught comp sci complained to me that most of his students were using AI to do the work. I asked him if he knew which students wanted to learn. He said yes. I suggested he teach to them, and to heck with the cheaters.
I'm from Hungary and the majority of the exams here are oral one-on-one interviews (depends on the course of course but still). I've never ever had take home exams and or even quiz like tests were very uncommon.
105 comments
[ 3.1 ms ] story [ 83.6 ms ] threadIf it's a math for finance course then some kind of model building for the midterm and being marked on the quality of the model or something. If AI becomes so good that it always chooses the best fitting model and requires no numerical optimization then they will have to change the courses to be more like UChicago where it's primarily undergrad directed research but AI assisted.
I never understood this behavior from undergrads though, you're paying so much for an education and then you just skip the education part? Why bother?
My first job out of college, I worked with veterans at the company who all got in with a HS diploma. Now you realistically need a masters degree to be competitive, for no other reason than that where I live (Norway) most applicants have a 5-year masters degree. It is basically academic inflation.
Here we have a tongue-in-cheek word "Mastersyken" which translates to "Master's illness/disease", a word for the phenomena that too many people are pursuing a master's degree for the sake of the diploma alone, trying to become more attractive in the search for a job, but with the side effect that suddenly "everyone" has a master's degree, and in the end everyone is stuck at the same place as before, but with extra student loans.
The worst part is when you start working, and indeed discover that this is a job you could have done just fine straight out of HS.
If students don't want to be there in the first place and/or don't see any value in learning, it is unsurprising that they'd take the easy way out. Or maybe they cheated their way into Brown and are just continuing.
But I was always interested in learning, and understood that cheating was a method of learning avoidance. Why waste the amazing learning resources - faculty, teaching assistants, courses, labs, libraries, studios, rehearsal spaces, interesting speakers, arts and culture events, computing facilities, maker spaces, etc. - that are available at a place like Brown?
An expensive education comes with higher temptation to cheat.
You've never put anything off in your life or taken the easy short term route? Come on this is not difficult to understand. You aren't different either.
* This is brought to my attention by an exam question
* I have an oracle in the form of a textbook, an LLM, the internet, or all of the above
Which action is skipping the education: looking up the answer, or not looking up the answer?
Teachers really need to stop doing it, it's so destructive to create a metric that tracks how well you can cheat and lie, and basically forces you to cheat and lie (because everyone else is) if you want to get a job.
You always have a choice. The right move, in this case, is to raise a stink to administration, donors and politicians. Hell, use AI to do it. Schools refusing to punish teaching is a problem that’s leaking into business and politics.
Hand written exams are either very labor intensive to grade or are confined to multiple choice, so either inflationary to cost of education or inauthentic / inaccurate representation of most knowledge and skills.
The best answer, which enables authentic meaningful high integrity assessment that is also unit cost efficient is to have testing center facilities with institution supplied devices and well trained proctors.
This way instructors can assess students in ways that are relevant and authentic to the subject matter while ensuring the assessments are accurate, consistent, fair and actually reflect the students abilities.
It was certainly not difficult to cheat at a "closed book" take home exam before.
Surf the chaos, bro.
These news articles are just tiresome at this point. Obviously folks cheated previously, obviously it's easier now, obviously the answer has been to not have take homes all along.
Since students are notorious for being cheap
What an oxymoron. I agree with the others here that AI isn't the problem.
I have written an article on how I have adjusted my classes to the situation:
https://htmx.org/essays/universities-and-ai/
Ironically, I think the AI era may make university degrees a better signal of the intellectual abilities of students due to the presence of pre-computer infrastructure like large lecture halls, industrial-scale copiers, etc.
I'd like a citation for this being the "biggest known scandal" in the "entire Ivy League". Frequently such situations are kept somewhat quiet, for a variety of reasons. But fifty students is not a large number in courses that can enroll hundreds or up to a thousand students.
This is a trap. I understand they've done this in the past, but profs are paranoid now.
I don't believe he's 100% correct on each incident of fraud and he's going to ruin students [academic] lives because of it.
He understands the stakes here. If a university degree becomes useless, then what?
I was very fortunate to attend Brown University for grad school, and consider it a great place.
Why would many people who were also fortunate to attend there not honor that opportunity?
...
"But it also hurts him that the one time in 34 years that he decided to offer a take-home exam, for highly justified reasons, the response was wide-scale fraud."
-----------------
Not to in any way defend or condone academic misconduct, the fact that this was his teaching-career-first take-home exam is probably relevant. Take home exams can be fiendish. I remember having one in grad school where we were given a very insufficient 36 hours to complete it, and many people just didn't sleep. That was from a prof who knew what he was doing. This guy may have accidentally made his exam absolutely sadistic.
Couple this with the fact that students often have other exams they need to be studying for in the same time window. The pressure can be immense. The temptation to use AI to help is going to be hard for many to resist unless the penalties are severe and strictly enforced.
AI cheating is probably going to be a problem going forward in all situations, but open-book, take-home tests are going to bring it out more strongly than other test formats.
The problem is that kids, even (or especially?) in the elite schools, are treating college as a box to tick. At the Ivies, for many students, it's nothing more than the requisite means to get their ticket punched so they can become/remain part of the elite class. This has been the conventional wisdom for half a century.
Now, this paragraph doesn't apply to an economics class like his, which is actually a useful degree, but many students will never use what they learn in college in a professional capacity, so it barely even matters if some (maybe even most?) students cheat because outside of the useful degrees, it's mainly a sorting hat to determine who works at Starbucks to pay back student loans, while rolling their eyes because of their 'valuable degree,' and who works there unironically, to pay their bills.
What needs to happen though is that students at all levels need to either believe that they need to learn what they're choosing to take courses in, or even better, actually innately want to learn it to satisfy their own interest. Either will do. If you have neither intention toward the material, of course you'll cheat your way through it. No student who actually wants to learn would waste their time and money taking a class only to not learn, and cheat their way through it.
Back in my day, you could also just Google the problems and find the solutions. What mitigated cheating at UVA was the honor code and each professor's faith and trust in our integrity. That culture was enough to not cheat.
Imo, the fix should be to work on culture. Cheating should always be a tempting choice, so that the student may challenge their integrity, which is a muscle that can atrophy.
We're currently designing a new intro systems curriculum, and we're thinking of it as an adversarial problem. That is, we're designing the course to ensure that a student optimizing for the best grade per unit work still meets our learning objectives. That means, as everyone else is saying, paper exams, but also 1-on-1 interviews to check that students understand each assignment they turn in. These interviews feature both factual questions ("You're using this macro from that library. What does it do?", "Please describe what this function does and how it works.") and conceptual questions ("Why is this code structured this way instead of $whatever?", "How else did you try solving this?", etc.) This doesn't stop students from generating code, but at least they have to understand that code in detail.
This is not as good as writing the code yourself, but how much worse is it? For math classes, this gap is gigantic. Obviously, understanding someone else's proof is much easier than writing your own. For programming classes, I think (without evidence) that the gap is somewhat smaller.
My experience from the past is that when this kind of evaluation is made clear up front, the students know what to expect and either do fine or drop the class in the first week. If you start with take-home exams and then spring paper exams on them halfway through the course, then half the class is cheating and won't be able to recover, as we read in the article.
In general, our students are somewhat motivated by an abstract desire to learn, but are much more motivated by grades. If there exists a straightforward path through your course that leads to a good grade without doing much work, most students will take it. (Our undergrads' course review website is literally called "Layup List." They are actually this shameless.) It's our job as instructors to ensure that all paths leading to a good grade either require learning the material or are more difficult to pull off than just learning the material.
It's best not to blame the students. They are good at optimizing metrics; that's how they ended up here in the first place. We just need to better align the evaluation metrics with the outcomes that we're looking for.