Show HN: Generate quiz questions using AI (quizgecko.com)

161 points by jwblackwell ↗ HN
One of the coolest things I've been able to get GPT-3 to do is generate questions based on a piece of text.

So, I built a simple site to help others do the same. Hopefully, this can be useful to teachers, trainers, or just anyone who wants to create a fun and unique quiz.

48 comments

[ 2.7 ms ] story [ 112 ms ] thread
Great work! I copy-pasted an article from Wikipedia and it generated one wrong question (all the answers were correct), but the quality of the questions was pretty good.
Thanks! It’s very much a first pass but surprisingly effective.

I have a few ideas to improve quality. Fine tuning for example

This is pretty neat. Is it open source?
This is amazing. You going to monetize this? Another idea would be to accept a Wikipedia URL and have it generate questions
Thanks. You can enter a Wikipedia URL in already! Just hit the URL tab at the top.

I will keep it free for occasional users. The GPT3 bill will need to be paid, though, so if there's demand, I'll add a paid tier.

You could also allow people to enter their own key right? Great work though on this. I tested it out on some technical topics on Wikipedia and it did a very good job. Love the UI also and enjoyed using it.
Very cool, I created essentially the same product but hadn't launched due to all the boilerplate I wanted. It's lovely isn't it watching how cleanly the questions and answers come out?
Would you mind discussing a bit the process in building something like this?
Tommorow:

Show HN: answer quiz questions using AI (answerowl.com)

Quizgecko gives you the answers as well ;)
Great idea! Will you make the model or source code available? I would love to play with this locally.
This looks really useful. I run pub quizzes in the UK and often have to go through this process manually.

The manual text entry worked well. But the “from URL” option returned 10 questions of “what is the answer to this question?”.

Yeah, sometimes the site can't be scraped. Best to copy and paste for now if that happens. I'll try make the scraping more reliable soon
Make sure to rate limit so noone can drain your credits
Just showed this to a middle school science and math teacher I'm friends with and wanted to share that she thinks this is awesome and will probably save her a ton of time. Great idea and great work. :)
Can you talk a little bit about how you built this?

What kind of prompt etc?

I'd like to do something similar but with a much, much higher word count.

Thank you.

this is actually amazing! no sign up, just an awesome, powerful, useful, application of AI.
This is a really awesome application of GPT-3. You should definitely consider turning this into a service and adding the ability to generate Anki decks or flash cards from summary notes.

That coupled with the quizzing capability could be huge for students in medical school for example.

as a med student, i'd 100% pay for this service if it can take my in house lecture ppts as input
I agree file upload would be great. I almost added before launch, but figured it would take a while to do properly. I'll try and monetize it a bit this week as the bills are getting high quickly, this can probably be a paid feature.
This could be used on any any commenting system or even Reddit to check if the user has read the article and or have knowledge of something before commenting. Sort of a captcha.
I've been looking for something like this for a while. Really nice and clean UI. there's so much potential for question generation, but one of them is helping people understand whether they got through a page or section with good comprehension before they move on to the next section
Awesome idea, and I really like the implementation! It'd be great to see an integration with something like Moodle -- so that educators could generate quiz questions based on course content automatically, eliminating the "blank page" when they start putting together a quiz.
Yeah some integrations with learning management systems are on the cards.
Blown away by this. I copy text from a CNN article and the questions were spot on. So good that it seemed human generated.
This is a threat to English learning book publishers. It literally generates a reading comprehension test.
Very cool! Though I did put in the physics example and got this:

  2. What is a physicist?

  Choices

  [ ] A scientist who studies the natural world
  [x] A scientist who studies the field of physics
  [ ] A scientist who specializes in the field of physics
  [ ] A scientist who intersects with many interdisciplinary areas of research

  Whoops! Try again
Please no. Writing good quizzes is really hard and the last thing we need is to throw ai into the mix
Not sure what the problem is? If the AI outputs bad quizzes, you have nothing to worry about, no one would use it. If the output is good, then it seems like it's a win-win?
true, but don't forget there's a lot of lazy teachers out there
Very nice! I entered this text: “Whereas most of his preceding lectures simply come to an end, Feynman ends this one more philosophically, speculating that the order in the universe we see today is not a statistical fluctuation but a memory of initial conditions.”

These are the questions:

Which of the following is true?

A) Most of Feynman's lectures simply come to an end)

B) This lecture ends more philosophically)

C) Feynman speculates that the order in the universe is a statistical fluctuation)

Answer: B

What does Feynman speculate about the order in the universe?

A) That it is a statistical fluctuation)

B) That it is a memory of initial conditions)

C) That it is something else entirely)

Answer: B

What is the order in the universe?

A) Random

B) Organized

C) Unknown

Answer: B

How does Feynman end this lecture?

A) With a question)

B) With a thought)

C) With an answer)

Answer: B

What does Feynman speculate about the order in the universe we see today?

A) That it is a statistical fluctuation)

B) That it is a memory of initial conditions)

C) That it is something else entirely)

Answer: B

It seems to spit out nonsense questions with little relevance to the text. Given a text about grass, it might ask: "what is green?" followed by 3 actually green things, one of them being grass.

It's a fancy cloze generator. It has no understanding of which constituent parts of a sentence are related to the subject and does not generate alternative answers that are reliably wrong.

This is not working anymore, getting 500's on every attempt.
Hit a rate limit, should be working again but I will have to limit access to non logged in accounts as this has blown up