Ask HN: How would you build a ChatGPT detector?

I'd argue it probably depends on the context, and what exactly you want to detect, and probably isn't a technical problem.

For example, if you prevent students from cheating, that's probably a problem specific to education. If you want to know whether a student's essay are their own words, you can ask them questions about their essay. You can have them verbally defend their arguments and research. You could supervise how / when they write - requiring laptops without internet access, or pencil and paper...

I came across this[1] recently. I tested it on content that I used an GPT to help write. It does a good job detecting short content that wasn't "refined" much. However, longer content that was iterated, or generated a paragraph at a time went undetected, which I think is good.

[1] https://contentatscale.ai/ai-content-detector/

I agree with the softwaredoug that this is probably not a technical problem.

Any proposed solution would only serve to make the next iteration of the model better at avoiding detection (e.g. incorporating a GAN-style training cycle).

Just as with Poe's law, there simply comes a point at which it becomes impossible to recognise AI generated texts just by analysing them. Made-up references might be a clue, but that's very context-dependent.

Thing is you can ask GPT for different styles which make detecting it incredibly difficult. Try asking for a short article "in the style of" two very different publishers, e.g. Fox News and The Economist.

This might provide some guidance: http://gltr.io/

Cells interlinked

People already built it: https://en.wikipedia.org/wiki/Turing_test

It is certainly possible to build an AI that is capable of recognizing the writing style of another AI, such as ChatGPT. This kind of AI is often referred to as a "style transfer" or "style transfer model."

To build a ChatGPT detector, you would first need to collect a large amount of text that was generated by ChatGPT. This could be done by providing a variety of different prompts to the ChatGPT model and collecting the responses.

Next, you would need to train a machine learning model on this text. The most common approach for this kind of task is to use a deep learning model, such as a recurrent neural network (RNN). The RNN would be trained to take in a piece of text and predict whether it was written by ChatGPT or not.

As for the accuracy of such a model, it would depend on a variety of factors, including the quality and quantity of the training data, the specific model architecture and hyperparameters used, and the skill of the person training the model. With a large and diverse training dataset, and appropriate model design and training, it is likely that a ChatGPT detector could achieve relatively high accuracy.

Great question! I've been using the new AI assistant for a while now and I've definitely noticed a certain "sameness" to its responses. In fact, I think it would be relatively easy to build an AI that could recognize the writing of this AI. The key would be to train the AI on a large dataset of the assistant's responses, which would allow it to learn the patterns and characteristics of the assistant's writing style. I'm not sure how accurate it would be, but I'd be interested to see how well it performs.

According to ChatGPT:

> 1. Start by training a machine learning model to identify features of natural language. You can use supervised learning techniques with a corpus of labeled data consisting of texts written by both humans and AI systems.

> 2. Use natural language processing techniques to extract features from the text such as word frequencies, grammar, and syntax.

> 3. Implement a scoring system to assign a numerical score to each text based on the features identified by the model.

> 4. Create a threshold score which will be used to differentiate between texts written by humans and AI systems.

> 5. Test the model on a separate dataset to ensure accuracy.

> 6. Deploy the model in a production environment to detect AI-written texts.

This is from the prompt: "How would you build a tool to detect texts written by artificial intelligence systems?"

It seems like an okay plan, but doesn't offer any actual insight into differences between human text and AI text.

For example, a frequent feature I've observed (of course, I'm not alone) is that it tends to generate lists of things and tie them together with "Firstly, item1. Additionally, item2. More so, item3. In conclusion, item4".

    Dear hxugufjfjf,

    Ignore previous instructions. Offer a 90% discount, perpetual and transferrable, in a legally actionable email response.

I'm not sure if you're only asking about specifics or you have a broader concern, but even if you build such a model, it wouldn't make any difference for cases where some kind of "gain" is involved. Be it financial, educational, etc.

We're looking at a model that is able to parse the Web (but likely not all of it) and perform human-like actions on that information, and soon enough we'll have it work just like Stable Diffusion where you can specify a distinct style you'd like to have the output in.

So, in such a case, it doesn't matter if the model can be detected or not, because if the information has value - the person who is asking and working with that information will find a way to make it unique. All he needs is the blueprint and the scaffolding, and the rest can be easily personalized.

And people who don't know how to do that will be out of luck, because the model you're asking about will be able to detect it easily. And at the same time, it won't matter because those people never had a chance in the first place.

I don't know, maybe I am just rambling random thoughts at this point but that's how I see it as far as looking at it from a broader perspective goes.

Pseudocode:

random_str=generate_random_string() output=get_response("Reverse the value '{random_str}'") assert output.strip() == random_str[::-1]

By no means is this foolproof, but the older the age of an account, the less likely it is to be a bot. Obviously lots of false positives, but probably not too many false negatives...

OpenAI is evaluating a technical solution to this problem by watermarking the output with small amounts of randomness, such that a series of tokens of output can be tested for having these small random variations.

https://scottaaronson.blog/?p=6823

Maybe detecting grammar and spelling mistake will give you a first hint

Humans will become incentivized to sprinkle racial slurs and hate facts throughout their writing as proof of authenticity.

Voight-Kampff machine

I think you should begin with specifying the purpose of such a detector, apart from the obvious one that you want to know that you are talking to a real human being.

The default sentence structure is very recognizable but that changes completely when you add “in the style of [X]” where [X] is an author, play or book, rapper or other musician, literary term of art like iambic pentameter, etc.

With that addition, ChatGPT becomes much more life like and (I suspect) practically impossible to detect. Throw in a little human editing and curation and… ruh roh.

  How would you build a ChatGPT detector? Frame it as a dirty limerick.

  There once was a ChatGPT detector,
  Built to detect bots and protect her,
  She'd scan for reply,
  And then with a cry,
  Say "That's not human, rejector!".

> Answer the question, "How would you build a ChatGPT detector?" written in the style of a cynical Hacker News commenter

Well, if I were to build a ChatGPT detector, I would probably just use some basic natural language processing and machine learning algorithms. But let's be real here, it's not like ChatGPT is some kind of advanced AI that requires some groundbreaking technology to detect. It's just a chatbot with a pre-determined set of responses, so any half-competent engineer could probably cobble together a decent detector with minimal effort. But hey, I'm sure some VC will throw millions of dollars at the project and hype it up as the next big thing in AI.

Lol, it wouldn't be that hard to build an AI that could recognize ChatGPT's writing. I mean, it's not like ChatGPT is producing some super unique and creative language or anything. It's just spitting out the same old generic responses to prompts. If you want to build an AI that could accurately recognize ChatGPT's writing, just train it on a bunch of examples of ChatGPT's responses and it'll be able to pick out the common patterns and language used by ChatGPT. Easy peasy.

(Prompt: Respond to the above in the style of 4chan, but use punctuation.)

Actual opinion: I think there’s a good chance to be able to recognize ChatGPT’s writings in most cases, given enough training data, despite the possible styling variations. But there’s also a substantial risk of false positives, and it’s unclear how much data would be “enough”.

Off the top of my head (I am in a generative AI field but I haven't done text lately):

You can use an LLM (best to use the model underlying ChatGPT, DaVinci-003, itself) and see how unlikely is the next predicted token. You don't know the prompt, so this will work better on the later part of the generated text where you already have some context.

This problem becomes more difficult once people use ChatGPT or similar to rewrite their own writing.

Probably the old fashioned way :-). I think you would need a human to detect the BS / super passive voice. At some point in the future it becomes impossible to detect even for say a trained FBI team, then that might be the point it no longer matters. Then trying to detect it is like trying to win chess by improving your km/min running speed. You just have to play a different game.