358 comments

[ 5.6 ms ] story [ 221 ms ] thread
This is awesome! What kind of bias would we expect to see in the training set?
For example if it consumes lots of data that uses the pronoun "he" for doctor, it's much more likely to spit out "he" in a medical context.

Since the model lacks world knowledge for new words, sometimes it also ascribes words to a specific cultural origin / group that is completely wrong.

This is pretty cool but I am getting some strange results sometimes:

https://imgur.com/a/rv0wHN1

That's not ideal and probably picking up some of the original training set from GPT-2 (this model is bolted on top of it)! How about DUOLINGOLOGY instead https://bit.ly/3fPGP8q

I'm using a blacklist to reject "real" words but it's surprisingly hard to build for rare words. I'm up to ~600K items after parsing Wikipedia tokens and it still doesn't capture everything.

That's understandable! Another one I got was "whitepaper".

In any case, it's all pretty impressive! Defintely something one can use for creative writing or fantasy world building.

It seems to make compound words just like humans do

gigafactory

nonplayable

waterboy

pepperjack

unreimbursed

interop

nonalloyed

backdoored

  airpods
  air·pods
  a large pair of wings and wings of a bird or other flying 
  animal, typically used as a guide for a figure skater and 
  paraglider
  "a pair of airpods"
(comment deleted)

  nailblast (n.)
  1. a wound on the external surface of the nail
     "her throat was swelling with nailblasts"
Holy crap, is she okay?!?
perfect for generating passwords
Or deciding company/domain names.
This project is one huge yak shave starting from that idea! I was trying to pick a company name in the AI space and thought it would be appropriate if it was generated by ML. I tried a few datasets for training, and using the Oxford English Dictionary led me here
This is the most cromulent tool I can think of for nameogenesis.
Your noble spirit embiggens the smallest man
Yeah, tie it in with a Whois lookup and you're golden.
Some of them are pretty clever and could have easily become slang given enough time.

My first result was "upboard" which describes all the wood on a sailboat that is above the water.

For slang, I'm training another modelusing urban dictionary as the datasource. I hope to release it someday but there is a lot of work to be done to clean the data. The articles are huge, user-generated and full of racism.
noun [usually as modifier] deflategate de·flate·gate a situation in which one side is unable to extricate itself from a dangerous dilemma, especially one involving civil disobedience or military attack "a nuclear deflategate could doom the North Korea situation" a word that does not exist; it was invented, defined and used by a machine learning algorithm.

This word was used for the Patriots scandal a few years ago.

https://en.m.wikipedia.org/wiki/Deflategate

These are great.

I wish there were one for 70s/80s album art, but last time I looked at these projects they are still out of reach for hobbyists. I could stare at those all day.

    manpool 
    a large pool, typically as part of a carnival or carnival 
    *"a few old dead men may be playing in the manpool"*
So close, yet still so far.
relender

re·len·der

a unit of weight that is equal to the weight of a pound of food

Wow, even with definitions! That looks like a better version of a game I made years ago where you have to pick out the real word from four options. The three "non-words" are generated by Markov chains:

https://www.michaelfogleman.com/wug/

This game is great; I've been trying to think through ways of using these NLP models in a competitive game but the mechanics aren't obvious. It would be awesome to do something like an AI rap battle
Your website is amazing and full of very interesting projects, looks like a lot of fun.
??? The very first word I got was a real word (Shmoo).
palumpolism

(in Hinduism) a state of complete consciousness and mind

"she had reached a mystical state of palumpolism"

%

shakura

a traditional Western-style ceremony performed by traditional Japanese people in which offerings, including candles, were offered to the dead before burial

"the shakuras return next year"

%

empaired em·paired

(of a person) having; displaying irrationally

"he seemed to live vicariously through his empaired friends"

%

mousselike mous·se·like

manifesting as lovable or strange, especially for unpleasant or stupid reasons

"a mousselike ghost"

%

poone

the nearest possible neighbor

"we must not be dupes, fellow poone"

%

delack

the sound of a fish drowning in water

"cures of delack and mauling"

Was there a lot of video game dialogue in the training text?

Palumpolum is a locale in Final Fantasy XIII, itself named after the characters Palum and Porom from Final Fantasy IV.

Shakuras is a locale in StarCraft, the planet to which the Protoss Dark Templar retreated after their schism with the Khalai of Aiur.

My model is bolted onto GPT-2 which is trained on internet text; I think some of these examples are coming from there.
I appreciate the fortune formatting
flirtion

flir·tion

a stroke of incised or oval lettering on a shield or medal belonging to a householder

"a flirtion shield in the back"

Can you take the words as input and generate the definitions?
Yup, press the "Generate your own button" on the site. If you want to go the other direction (definition to made-up word) you can hit up my twitter bot @robo_define: https://twitter.com/robo_define

  strillation
  stril·la·tion
  the action or process of boiling (a subject, typically an 
  animal) at room temperature
I have to say this is pretty hilarious
Depends on the liquid you're using!! You can definitely boil a squirrel in liquid nitrogen!
Liquid nitrogen boils below room temperature though. I once strillated a squirrel on top of Mount Everest because the pressure was so low...
While this is technically true, it would more commonly be described as freezing.
No one said anything about pressure :)
Strikes me as very Douglas Adams in its absurdity
This is perfect to name startups / products. Very well done.
Came here to comment this.
I'll give it a go! Seems pretty easy to replace the blacklist test with a WHOIS lookup.
Don't bother, WHOIS is pretty much useless 9/10 times nowadays.
Yes, I am here to launch my new cure-all "metasodium" its like sodium, but meta.

metasodium meta·sodium any of a group of silica compounds thought to act by the interaction of sodium with sodium, the latter of which has many physiological roles and is essential in the modulation of many physiological processes "a polymeric metasodium oxide from which such compounds in the cell cycle are derived"

This sounds like the method Star Trek: Voyager writers used to come up with their technobabble

    quora
    a set of questions
    "a rhetorical quora"

!
Bug report: I hit “Microtissue”, a word that does exist, and its definition is incorrect ;-)

(https://www.thisworddoesnotexist.com/w/microtissue/eyJ3IjogI...)

Oh no, it must have missed my blacklist. It's supposed to give a little "this word probably exists" when that happens. It's surprisingly hard to determine if a word already exists: https://www.thisworddoesnotexist.com/w/tissue/eyJ3IjogInRpc3...
Is it comparing to a list of common bigrams? It seems to come up with those a lot.
I also got "adverb. quaterly", "noun. geotagging", "adjective. mispriced", "noun. wholy" (google says it's an obsolete spelling of wholly).

I didn't see any note saying "this word probably exists".

Yeah I got comicbook, nonreferential, barleywine, geophile, which could all be compound words, maybe hyphenated today but perhaps not tomorrow.
Just pushed a change to update the blacklist (collapsing hyphens / spaces to single words); it'll never be perfect but hopefully slightly better!

  noun.
  tartou
  tar·tou
  
  a Chinese pastry
  "each piece of beef tendon tartou serves four and a half hours ago"

Time-traveling pastries, wonderful.
Every time I go to my friend's house for tartou he apologizes and tells me they ran out hours ago. :(
It's like that reverse wine that gives you the hangover first.
Ha!

    neuterization
    neu·ter·i·za·tion
    the denial of a person's sexual identity and gender 
    identity to someone else
    "she had undergone neuterization of her facial hair"