Show HN: Learn a language quickly by practising speaking with AI (prettypolly.app)

325 points by cwbuilds ↗ HN
Hi guys,

Hope everyone is well. This app was borne out of my own frustration. I thought that I was terrible at learning languages at school, since I didn't become conversational in French after 5 years of study. However, I later traveled with some French friends and, in just under 3 weeks, I was able to hold a reasonable conversation. I realized that there's no substitute for speaking to native speakers.

I tried to adopt this approach for other languages, but it's much harder to find people to practise with when you aren't travelling. I started using iTalki to meet people from different countries and chat to them. It quickly became very expensive and time-consuming to schedule the calls, so I gave up.

I made PrettyPolly so that anyone can easily practice speaking 26 languages orally. The app uses ChatGPT (amongst other tools) to allow you to practice speaking whenever you want. It also generates a fluency score for each conversation so that you have an objective way of tracking progress.

It's free to use (up to 15 conversations per month). I've found that using it once or twice per day is plenty, and you'll be amazed at how much you will pick up in a week. I've added some FAQs here in case useful - https://www.prettypolly.app/learn

Would really appreciate any feedback. Let me know if you have any questions, issues or suggestions.

Thanks, Chris

257 comments

[ 2.3 ms ] story [ 384 ms ] thread
Will you make this open source please?
I can definitely look into it. Do you have any suggestions for how to do it well?
Upload the source code? :")
When open sourcing your work, look first into licensing and make sure to understand what each license offers and what implications it has.

Then you can chose to push it to github or similar, but please prepare a good readme.md file.

Just tried a few languages and there seems to be a problem with German speech to text. When I say "Hallo" it just thinks I said "Untertitel der Amara.org-Community" :-)

English and Spanish seemed to be functioning OK though, but I really wanted to test my German.

Thanks for the comment. Sometimes if you toggle the microphone quickly without saying anything, it will halucinate something. If you could, is there any chance you could try again in German and let me know if it's still not working?
No, still not working. Also tried a bunch of other languages and they all seemed to work except Turkish, which also spits out something related to subtitles...
Ah darn - okay, thanks for the feedback. I'll find a way to stop it from doing this.
Curious about this, why do you think it hallucinates? Isn't that supposed to be the direct output from speech recognition?

PS: Just happened with Spanish now as well, which was working fine. (You: Subtítulos realizados por la comunidad de Amara.org)

It would be amazing if the microphone detected say 15 second silence and responded automatically for a fully hands free experience
Seems cool! I know basic Spanish from Duolingo but not enough to understand what it says to after a few rounds so my suggestion is that there is a side-by-side translated version of the conversation.
That makes a lot of sense! I've been awkwardly having a Google Translate window open with it, but agree that it would be much less onerous to have it built in. Thanks for the feedback.
I've been meaning to brush up on Spanish and the app worked great to just hop in! The best part about using GPT is being able to talk about whatever is on your mind.

I noticed the transcription APIs clean up my mistakes (which is good for the transcript) but I wonder if there is a way to show the raw and corrected transcript to help guide corrections? Either way, it's already useful as is, looking forward to using it more.

Thanks for the comment and glad it's useful! Agreed - I love the flexibility to talk to it like it's almost just another human, but with vast knowledge. Okay - that makes sense - I can look into adding some more of the raw transcript. Thanks for the feedback.
Happy to help! To give some context: there was a GPT prompt which was something like "Act as a language tutor. I'll have a conversation with you, and you reply back. If I make a grammar mistake, keep the conversation going, but put the correction in a parenthetical statement."

I was using that for a bit, but typing in another language was enough friction (vs. speaking) that I didn't use it that much.

For this, audio is perfect -- all I need is the gentle reminders about what to fix, and why. GPT could probably have a parenthetical part in the official transcript too.

Anyway, hope that helps give context.

Agreed. There's a huge chasm between being able to read/write and being able to speak. Speaking is just more fun as well imo. I'll have a think about ways that it could provide some qualitative feedback. Thanks again
You could do something two pass and collect forced alignment confidence scores similar to what is fine with whisperx. The OP would need to incorporate that into the app but it’s a pretty standard approach.
Thanks - I'll look into this
I'll second wishing I could see the raw transcript vs the cleaned up version (perhaps vertically over one another in different colors?), and also how fantastically magical it is at allowing me to come right in and converse naturally.

Great job!

It needs a "Processing..." notification, I clicked "Start conversation" and it takes a while before it says anything. Same with "Start speaking" -> I said something, then clicked "Stop speaking" but the page seemed unresponsive. I repeated it, and when the transcript appeared I ended up answering the question, getting another question, and repeating the first answer.

Also after 3-4 sentences the questions got a bit "dull-person-at-a-party" small-talk... "What are you doing today?" / "I'm programming." / "What programming language are you learning?" / [I didn't say I was learning...] "Java." / "Oh, interesting. Java is a popular programming language. What do you like about Java?".

Thanks for the feedback. I'll add in a processing-style spinner. Sorry that it was a bit slow when you first used it. Do you mind if I ask what device you're using?
This my experience on an iphone 12. The UX doesn't really work for me yet but I absolutely love the concept, will keep an eye on it (would sign up for a mailist if you have one).
Thanks for giving me the device. I did have some trouble getting it working on iOS so maybe I didn't iron out all the bugs. I'll get working on a fix. I think we're already emailing so I can add that email to the mailing list if you'd like?
I love the idea, and just had a successful conversation with it for a few minutes in Portuguese. Nice work!

For me in that language I need to work on understanding native speakers, so currently it speaks too slowly for what I personally need (it's too "easy"). I did ask it twice to speed up but it didn't seem able to - I guess it's hardcoded in your text-to-speech code? Is that something you can add an option for?

Awesome! Yes, it's hard-coded to basically be in 'beginner' mode at the moment, but I was considering allowing the user to select intermediate or advanced, which it sounds like would be more useful for you. Thanks for the feedback!
I would love to try it on advanced if you get time to do that. I honestly think I'd use it a lot. If adding it to the UI takes time I'd be absolutely happy with a URL query parameter prettypolly.app?level=advanced if that's easier.
It probs wouldn't take much longer to just add a slider or something too. If you don't mind me asking, what are you planning to use it for? Interested to hear some advanced use cases
Great. Oh, I'm just aiming to get much better fluency and ability to understand native speakers in real-life contexts. I've had basic bad foreigner level for a while now.
(comment deleted)
I like the Anki shoutout.

I personally would be cautious learning an extra language through a tool like this though, especially for a huge list of supposedly supported languages like this. Chat-GPT gets basic concepts like verb suffixes wrong, that is, explaining those concepts and generating example sentences, when I was trying it out a few months ago. I wouldn't mind conversations feeling a bit awkward or unrealistic, (EDIT: as they do here), but I wouldn't trust AI tools atm to get sentence structure, spelling and pronunciation (!) all completely right which is imperative for such a tool to function (and this one didn't for the two languages I tested).

If we assume the AI is already at that level, it would be trivial to have it show translations to user's native languages instead of only to English and excluding a number of potential revenue-generators for the capitalist machine ("learners").

Your prompt leaked in the text box when I pressed the Start Conversation button multiple times, and the site seems to be getting HN-hugged-of-death right now.

Also, adding to the person who mentioned this being close sourced, if a "deep-rooted desire not to look foolish in front of others" was among my reasons not to talk to a stranger in an extra language, I don't think I'd be any more likely speaking into a microphone, alone, in a room, like I'm conducting my biannual mandatory TOEFL© test every two years.[1]

[1]: This one is actually worse because you're in a room with 10+ others simultaneously talking into a computer screen, not talking to a person but just having your voice recorded, and it's outrageous ETS is getting away with charging people like 200 bucks (getting to see feedback for your grade is extra)

Anki is such a great product.

That makes sense. I do understand the worries about learning from AI. It's worth saying that different software is used for transcribing what you say (rather than ChatGPT), and that's been trained on lots of data (including YouTube videos) of people speaking that language, not to say that it could never get it wrong. But I definitely hear what you're saying about ChatGPT sentence structure on the less popular languages.

Good point about open sourcing. I definitely agree.

I actually think I disagree with this. Yes it'd be incorrect some of the time, but that is also true of humans. Provided it gets it right most of the time and is reasonably fluent, I don't think that minor errors would matter much.

This seems much more a tool for practicing the stuff you learn in another context to me, rather than a way of learning in itself. You can use it without the social pressure of stumbling slowly through sentences with another person.

> Chat-GPT gets basic concepts like verb suffixes wrong, that is, explaining those concepts and generating example sentences

This matters if you ask it for grammar. But you can get to a pretty advanced level before this starts to affect you when trying to have a conversation which is usually far more forgiving. And while ChatGPT certainly makes errors, even for a minor language like Norwegian it gets it close enough that I can get it to have a perfectly fine conversation in minor regional dialects.

I think the best thing to do is to pair something like this with a more traditional course for learning the specific rules, because starting to speak as early as possible is a great way of building a level of fluency that takes ages otherwise. Not least because ChatGPT will still understand you pretty well if you mix two languages within a sentence, so you can start talking almost right away and tell it to translate as needed.

You can already ask this app to translate things to your own language - I had it both translate French to Norwegian, and asked it a question in French which it translated to French before responding.

Not in agglutinative languages where verb endings considerably change the meaning of a sentence.
Even then you'll find a conversational environment far more forgiving, because of a combination of context and a feedback loop. There's a reason childhood acquisition of language works just fine without an explicit practice of grammar rules.

The point isn't that you wouldn't benefit from it doing better, but that it doesn't need to be anywhere near perfect to help a typical language student improve.

This looks great thanks for sharing. I've been using a similar app on iOS and it's definitely been helping with my German. https://apps.apple.com/us/app/langs-ai-language-learning/id1...
Thanks for the comment and for sharing that app - I'll check it out.
I’ve tried a couple that I found on the app store.. langs is good, I like how simple and to the point it is. Doesn’t have a web interface though
This is really slick!

I really appreciate you having Japanese as a language choice. I've been dying to hone my japanese skills with AI in lieu of reading grammar/vocab books etc.

I definitely intend to use your product more, because it is definitely scratching that itch!

A couple of things that might help me personally would be the ability to cancel my current response and redo it, as frequently I will stutter or pause on a thought and wish I could restart over.

In that same vein I would love to see the output of what I'm saying in real-time. If only to gauge and understand what the application "thinks" I'm saying and to potentially correct and miscommunications from spoken input.

I would also love the chance to role play or have the tool help me learn contextual role playing. For example in Japanese keigo is a skill I just haven't mastered. I would love a tool to help put me in positions where I need to use keigo, and then be corrected where I'm failing.

Regardless, this is absolutely fantastic! Thank you so much for sharing! You're awesome :)

Thanks - glad it's useful for your Japanese. Do you like it being in the Japanese writing system or would you prefer phoenetical English? Wasn't sure which to do on that one.

Thanks for the feedback. The processing point has come up a couple of times so I'll definitely be adding that, and I'll look into doing some contextual scenarios. If your language is good enough, you could try prompting it to act as, eg a waiter in a restauraunt, but that's far from ideal for beginners!

Sure - realtime transcription makes a lot of sense. I'll look into it.

Oh! I didn't know that. I'm really new to how to interact with AI. I'll try that out.

Please please please keep it in Japanese. Phonetic english for Japanese is awful. Hiragana only for Japanese is really not ideal.

The current output is absolutely perfect.

Also, I think it's really cool I don't need an account to try that out. Very cash money of you.

Ahah hear you loud and clear - no phoenetical words. Of course - hope it continues to help you learn!
Absolutely, please keep Japanese output the way it is - it's the only approach that makes sense. Romanization loses a lot of information and makes things harder (except possibly for the absolute beginners), not easier.

However, it'd be extra cool if there'd be an option to display furigana - in case user had forgotten or doesn't know some particular kanji. Or maybe just throw an option to replay the audio.

Got it. Will learn about those and see what I can do.
>Do you like it being in the Japanese writing system or would you prefer phoenetical English? Wasn't sure which to do on that one.

Please do NOT use romaji. I honestly hate it when language-learning apps try to force romaji on me; it's not useful for learning the language. The written language in Japan is Japanese (hiragana/katakana/kanji), not romaji, so I just find it a distraction. Part of learning the language is learning to read it, not just to talk in it, and being forced to read it in its native script is far more useful than latin transliteration. That said, having furigana for unfamiliar kanji is really helpful too.

Got it. Thanks for the feedback.
> Do you like it being in the Japanese writing system or would you prefer phoenetical English?

Definitely Japanese writing system. Thanks.

Amazing tool.

Fwiw, if you’re looking to monetize, you may want to try to get a contract with the DoD. I would start with special operations (lots of money and urgent mission/training needs), and then move on to the Defense Language Institute.

Oral proficiency interviews (OPIs) are part of the qualifying standard, and everyone wants more practice.

Thanks for the kind words. That sounds like an interesting idea. Any chance you have a contact? Am UK-based so imagine it would be hard to get a meeting with the DoD from here. If so, I'd obviously be incredibly grateful, and here's my email: chris@prettypolly.app

Thanks again, Chris

nthing the consensus here - it's very good as-is, even though I maxed out my conversational ability fairly quickly.

The only changes I would make are to the UI, clicking the start and stop listening button feels awkward. Perhaps make it so you can click, talk, and release the button. And perhaps the option to select a few different voices.

Also intrigued to see where you go with Anki integration. Excellent work, you should feel very proud of what you've built so far.

Yes - Anki integration is one of the things I'm keen to do next. I'm convinced that any good language learning app needs spaced repitition.

Got it. Thinking of making it possible to control the mic by holding the space bar, although that wouldn't work for mobile obviously. What devices were you testing it on if you don't mind me asking?

I've just tried it on my desktop. I probably wouldn't use this mobile.
Cool, thanks for getting back
Both. But perhaps also hiragana/katakana option too, like children’s book do when there is a kanji. Full on kanji is beyond me and I don’t expect to be able to pick it up just by seeing it in these conversations
> For example in Japanese keigo is a skill I just haven't mastered.

Other than very common scenarios like introductions, spare yourself the headache.

If you are a diplomat or something similar, understanding it might be useful, but using it can be a minefield (e.g., you better know the hierarchy of everyone around you so that you use the appropriate language).

> I would love a tool to help put me in positions where I need to use keigo

In most if not all cases, if you find yourself in a situation that keigo is both standard and expected, one of two things will likely be true:

1. You will have been selected based on your ability to use keigo (e.g., customer facing roles that use keigo like banks).

2. There will be one or more people in your organization who will make sure you know what you need to know.

Most non-native speakers I have known who try to learn keigo use it in really unnatural and sometimes awkward ways.

I have known three people who “got it right”, and maybe a fourth. All are super fluent in “normal” Japanese and are lifelong students of the language.

1. Currently a professor of Japanese. PhD in Japanese from U Hawaii.

2. Polymath Cambridge grad who worked for Cambridge University Press. It was not uncommon for Japanese people to whisper to me about how freakishly good his Japanese was, especially when speaking about formal or technical topics.

3. Power nerd who went deep into the Japanese sword drawing martial art (iaidou). Also a professor.

4. Just a guess, but HN’s patio11 is probably good at keigo. I would listen to anything he has to say about the topic over anything I say.

Somebody wants to learn a language properly and you're saying "don't bother". I don't get it.
It's a matter of priority - you can get by fine without using keigo, and instead of learning all the weird intricacies of keigo you could go learn something more practical for day-to-day use first (even native Japanese speakers complain about keigo, e.g. use of manual keigo). Teineigo is perfectly sufficient in everyday use.

To put it another way, it's a bit like trying to to learn about how to write in the style of a judicial opinion when you're still learning how to talk to someone at the bar.

Well, OP didn't specify what their level was. Maybe they're already fluent? In which case learning more advanced things does make sense. Although I would never trust ChatGPT to use advanced Keigo properly (especially with the lack of context dictated by social settings), let alone to correct it and explain its usage
> Somebody wants to learn a language properly and you're saying "don't bother". I don't get it.

Yeah. I can see that. Let me see if I can expand.

1. Keigo falls into the category of “specific purpose” (SP) language. SP language can be relatively simple things like tourism language, or it can be very deep and technical like scientific, medical, engineering, etc. SP language is typically taught and learned on a need to know basis, and it’s totally possible to be highly fluent (usually measured in terms of general proficiency) and not know anything about SP language.

2. Keigo (and this is way more than basic formal and honorific language) is used in very specific situations. As a foreigner, in almost all cases that matter, there will be an interpreter or the foreigner will be trained in keigo.

3. For reference, I think that most of the keigo that I would recommend a non-native speaker learn can be found at this link (it’s a small and easy to learn list):

https://www.fluentu.com/blog/japanese/japanese-keigo/

Furthermore, I think that most of this language is more useful receptively (listening and reading) and will almost never need to be produced (spoken or written).

4. As far as proficiency goes, most keigo would be ILR 5 / CEFR C2, with the basics linked above being ILR 4 / CEFR C1 (used dynamically… much lower as memorized set phrases). When you’re at that level and needing keigo, you know you are lacking in keigo and make an effort to learn it. Before that would probably be a learning sequencing error (other than nerdy curiosity).

Beyond learning the content in the link above, most foreigners will not find themselves in the context of needing to know or use keigo. As special purpose language, it should really only be pursued if necessary. Otherwise, the knowledge learned will most likely be forgotten due to lack of use, or it will be used awkwardly and possibly inappropriately (as I mentioned before).

If it’s just a nerd itch to scratch, then go for it. For most people, I think there are more compelling aspects of Japanese to spend time on.

> Beyond learning the content in the link above

If you put it like that - OK. I was under the impression that you were implying "learn no Keigo at all beyond introductions (except Teineigo)", which would seem rather odd to me, as I've definitely heard 行ってまいります, Xでございます, etc. in Anime and movies.

If you're talking about the advanced uses that even many native speakers struggle with (unless properly trained), then yeah, maybe it's specialised vocab that you won't necessarily need.

> If you're talking about the advanced uses that even many native speakers struggle with (unless properly trained)

To me, this is the part that is keigo. The other stuff is relatively simple and early in terms of language acquisition.

Assuming that others share my definition of keigo may be assuming to much on my part.

IIRC, for Japanese people, even Teineigo is part of Keigo.

In learners' resources (where Teineigo is introduced usually right at the start), my impression is that Teineigo is not included, and that Keigo starts with Sonkeigo and Kenjougo. That's still introduced comparatively early, but much later than Teineigo (I think, it's in Genki 2, for example).

I'm mystified by this comment. Keigo isn't some high-level PhD topic, it's used constantly in everyday usage. Even an intermediate speaker needs to understand some, or they'll be unable to follow many basic conversations. And sure, nobody is likely to yell at a foreigner for not using it perfectly, but given how common it is it's a very reasonable thing for even an intermediate speaker to want to practice.
See my reply here for more info:

https://news.ycombinator.com/item?id=36982980

> Keigo isn't some high-level PhD topic

It gets multiple book level treatment in Japanese (if you’re in Japan, please ask about the keigo section at a decent bookstore), and I am familiar with at least a few post-graduate papers on the topic.

Some additional comments:

1. Something like this link (http://keigo.livedoor.biz/archives/cat_14420.html) might be a good intermediate level of keigo. A lot of the less common keigo on those pages get butchered by non-native speakers when they try to use it (mainly because they shouldn’t be using it).

> given how common it is it's a very reasonable thing for even an intermediate speaker to want to practice

2. Unless someone is a diplomat, a 会社員 or in some sort of traditional arts, I would humbly suggest that they could go their entire lives without producing any keigo outside of memorized words and phrases (e.g., おはようございます) and could be seen as a highly fluent, high-functioning speaker by Japanese people. The basic link I provided in my first reply and the intermediate link in this reply are plenty to have receptive knowledge of, but one could argue that the important keigo in these lists simply falls under slightly more difficult memorized words and phrases (something acquired relatively early at lower proficiency) rather than advanced generative rules (something acquired much later at higher levels of proficiency).

3. Referring back to your “not a high level PhD topic” comment , I sure as hell would love to read some detailed breakdowns of top tier keigo use and keigo faux pas (especially in high level negotiations). I’ve never seen anything first-hand, but have I heard some stories. I’m pretty sure the best stories never leave the room they were uttered in.

To close, I’m not sure what your experience is with Japan and Japanese language, but I get the sense they you and I see keigo very, very differently.

Fwiw, I have been part of a training team that trained folks who were in “protocol positions” in Japan, and I can tell you that keigo was a constant sphincter-clinching aspect of that training (usually bypassed with an interpreter in high stakes Japanese-language situations, using English-English most of the other time in less formal situations, and using memorized words and phrases the rest of the time).

> I get the sense they you and I see keigo very, very differently.

I'm using the term the same way wikipedia does, and all the links you posted - it's a broad category of usages including 尊敬語, 謙譲語, etc. It's not some rare thing - if you walk into a 7-11 or restaurant, literally every sentence spoken to you will include some kind of keigo. It sounds like you're using the term solely to mean the highest heights of formalism, but I don't know where you're getting that usage.

>It sounds like you're using the term solely to mean the highest heights of formalism, but I don't know where you're getting that usage.

The keigo you refer to is the easiest keigo to learn, and much of it is learned as a beginning learner as memorized words and phrases.

In the context of the person I originally replied to, this type of content is either trivially easy to study/learn or not worth learning (e.g., most learners don’t really need to know that おはようございます is a highly stylized form of はやい — the memorized phrase and others like it are more than adequate until one is an advanced learner).

The keigo that would warrant using an AI speaking partner would, imho, lean towards the much more complicated aspects of keigo.

Note that I have actually referred this tool to folks who do training in keigo (and other language things). I’m not sure how the tool will do or what type of prompts need to be used to get the right type of engagement, but I think that there is potential on this front for advanced learners. For lower level learners, this tool is massive overkill.

Edit:

Note that most English-language web pages about keigo cover the simplest (and least interesting, imho) parts of keigo. Part of this is due to SEO, but part of it is probably due to ignorance about the topic.

For anyone interested, and if their Japanese is good enough, just search Amazon Japan for books on keigo. The topic is quite deep and can be incredibly fascinating. The content covered on English web pages just scratches the surface of the scope of keigo.

As a linguistic category it includes teineigo and set phrases, but when a JP learner says keigo they probably mean the stuff introduced the "keigo" chapters of JP textbooks, which starts with おっしゃる, 下さる, いただく, お~になる and so on. And again, those are everyday usages that are perfectly reasonable for even an intermediate learner to want to practice (and the person you replied to may be beyond intermediate). Sure there's also lots of other keigo that most learners would rarely encounter, but that's no reason to jump all over someone who says they want to practice it - you wouldn't tell someone not to bother with kanji just because there are characters they'll never need.
> … which starts with おっしゃる, 下さる, いただく, お~になる and so on. And again, those are everyday usages that are perfectly reasonable for even an intermediate learner to want to practice

Serious question…

Unless this “intermediate learner” works in a Japanese-language position (like a 会社員), is a diplomat, or is involved in a traditional art (or these types of relatively rare categories), in what context would they ever produce utterances using any of these words appropriately and naturally?

This is just not the type of language that intermediate learners need to produce very often. When they do, their organization will most likely train them beforehand, use an interpreter, or just not care.

I lived in Japan 8 years, and I worked in a Japanese-language environment. I’m pretty sure the times I had the opportunity to use any of the words you listed appropriately could probably be counted on my fingers and maybe extending to my toes.

Granted, I was not in a position of power (those folks used keigo all the time), and I was not directly involved in any highish stakes negotiations or business transactions (e.g., didn’t buy a house) but still…

> in what context would they ever produce utterances using any of these words appropriately and naturally?

Part-time job? Friends or in-laws they'd like to impress? Studying for JLPT? Just wanting to be able to speak everyday Japanese as it's spoken?

Respectfully, I really think you have a distorted sense of this due to whatever your background is. Per a quick google, some of the terms I listed earlier show up in JLPT from level 3. I'm no expert but I don't think N3 is considered high-level diplomacy territory. If you got by here without using such terms that's fine, but it's no argument against studying them - lots of people get by without learning kanji, etc.

> It gets multiple book level treatment in Japanese (if you’re in Japan, please ask about the keigo section at a decent bookstore), and I am familiar with at least a few post-graduate papers on the topic.

There are entire PhD theses on aspects of English (or Spanish, German, Italian, French, Russian, ...) grammar too. That doesn't mean that people can not learn to use the aspect in question intuitively. It just means that it's difficult to provide an explanation for this behaviour.

What is the fluency score based on?
Good question. I looked through literature to see whether anyone had come up with any good ways of measuring fluency, and there are a couple out there.

The key indicators that kept coming up were the number of unique words used and the speed at which you speak, so they're involved. I'm hesitant to give the full equation, because I thought it might be better to leave some mystery so we aren't consciously trying to game it while we learn.

It is by no means perfect, but I think it's useful to have some objective metric to track progress.

Cool, thanks for the response! I'm enjoying using the site.

One followup: does it take into account grammatical errors, incorrect conjugations and that kind of thing?

Glad to hear it!

Sort of. It will try to understand you even if you get the grammar wrong (a bit like a human would), but if it really has no clue what you're trying to say, it will ask you to repeat. I think it's best that way as it mimics learning in real life. If you keep getting your point across, over time, your grammar will slowly improve. The only evidence I have for this is anecdotal from learning Romanian with it myself.

Thanks for sharing! I'm a bit confused with the fluency score, what does it mean exactly? It would be good to have some feedback and pointers for improvement, otherwise I don't see myself using it for long.
Thanks for the feedback. The number of unique words you use and the rate at which you speak contribute to the fluency score. I'm a little reluctant to give the full equation, because it prevents us from trying to game it.

That's useful feedback on pointers for improvement - I'll see what can be done.

Amazing app. I am trying to learn dutch with this. It pushes you to converse in the language of choice. I also tried to get translation in english. Could be a good feature to understand new words and form better sentences.
Thanks man! Yes, definitely - will look at adding translation
Marvelous! One of the best applications of a ChatGPT backend that I've seen yet. It's even remarkable to talk in your own native language to ChatGPT, but there is just so much room to build out the next great language learning app here.
Awesome project! I had fun talking to it. Thanks for sharing. Can you give some hints as to what technologies you used?
(comment deleted)
Very cool!

I could see this tool to be very useful in my Japanese studies. I only have two problems with it:

- AI feedback can sometimes be pretty overwhelming. Maybe you could implement a level selector (beginner, intermediate and expert?) so that the AI would switch to using shorter/simpler or longer/harder sentences accordingly?

- The speech to text works fine most of the time, but sometimes it gets a few words wrong. Could there be a way to correct the last sentence input?

Thanks for the feedback. Yes, the beginner, intermediate, advanced point has come up so I'll look at adding something like that.

Just to check that I understand, do you mean changing the text manually when it gets it wrong? If so, sure - I can look into it.

I think manually editing your last sentence would be cheating in the context of a speaking app. Entirely erasing the last sentence of the user (as well as the AI's reply, if any) and having him repeat the sentence he had in mind would be better because it would force him to speak more clearly.

(Also an undo button would be easier to implement than a whole system to edit previous sentences, right?)

Yeah, agreed that makes much more sense!
The Hebrew one is so wrong... both grammar and pronunciation.
Darn, okay - I'll work out how to improve this. Thanks for the feedback.
Do Cantonese please! It's such an underrepresented but widely used Chinese language...
Sure - will do. I had to create a shortlist for the MVP, but Cantonese will definitely be coming soon.
Yes I have a question, when is your next round!
Aha none planned! Let me get through the MVP launch first!
Very good app, how so you sign up for premium service?
Thanks! Once you hit the conversation limit (15 per month) it will automatically take you to the upgrade page. If you really fancy paying, feel free to mash the start conversation button aha. Otherwise, you can just enjoy the free convos for a while :)
Wow, this is so cool! xD I think this is the strongest usecase for AI I've seen so far. I'd love some more details on how you made it - how are you handling the speech to text? It's so clean, I was amazed it could understand my stuttering mess lol.
Thanks! Speech-to-text is Whisper API, although that seems to have caused a couple of errors tonight so am considering moving away from it. Will have to have a think and do a lot of testing.

I feel your pain, I've also been a stuttering mess in Romanian.

maybe add a VAD in front of it? faster-whisper uses silero VAD.
Yeah this is great, shocking how reliable the speech-to-text is even for my unconventional accent.

Imho UX would be improved by a larger text box, more clear demarcation between "stuff I've said" and "stuff the bot said," similar to how iMessage or Whatsapp have two-column message layouts or blue-vs-grey or both.

Also maybe some "hold spacebar to activate mic" keybindings would not go amiss, similar to how Zoom or Gmeet makes the mic hot if you're muted but hold spacebar. That would save a lot of choppy/distracting clicking. (Or possibly just make the mic hot all the time when the bot isn't talking?)

Thanks - The larger text box has come up a few times so I'll fix that.

Good point on not being able to discern between what you said and what the AI said. Will change that when I get a chance.

Sure - I'll look into 'hold spacebar' type functionality. Thanks for the useful feedback.

I kept speaking Croatian while I was practicing Spanish and it underatood me. What kind of magic is this? Really cool project!
Ahah the witches of the internet are pulling the strings
This is really super cool. I wonder if you could use elevenlabs or something similar to make the voice more legit because it feels at the moment like I’m speaking to a satnav (in French).

I also got fluency score None which, let’s be real, is pretty accurate. But I feel like I need a bit more to help me learn.

The microphone interaction is really nice.

Aha thanks man. Yeah - agreed that there's lots of work to be done on the speech.

Makes sense - getting from 0 to 1 can be a bit of a struggle with this method, so could be good to find some ways to make that easier.

I agree but 11labs can be too expensive something transient like a conversation. Maybe give users a choice, those who pay for it will get it. But personally it's not really a deal breaker because 11lab doesn't have Japanese and Mandarin which I'm learning, haha!
Hmm, just had a weird speech-to-text hiccup.

I've asked to teach me how to construct past tense in Spanish. It gave me a few examples (Spanish and English translation right next to it, text-to-speech engine hadn't realized that some words were in English, though, and pronounced them in Spanish manner), then suggested I try to form my own sentences. So I've replied "Yo entendí sus ejemplos!" (uh, I hope I've got it right) but somehow it transcribed it as "You: Suscríbete para no perderte nuestros próximos videos." While I think I've stuttered and may be mispronounced something, it surely didn't sound anywhere close to that.

Being an LLM, it didn't bat an eye and asked me about the name of my channel :)

But I'm wondering if there was some request-response mismatch with the Speech-to-text API you're using and I've somehow got a phrase intended for someone else.

Thanks for the feedback. Yeah - it does seem to have hallucinated a little tonight. It normally happens when I time the microphone wrong and send some blank audio, then it seems to want to magic up some sort of phrase from nowhere. Am working on a fix for this. Any chance you could try again and let me know if it happens again? Ofc, no worries if busy. Thanks again
Thank you for this! I’m enjoying the Chinese so far.

I’m unable to sign up, though. On mobile, I’m trying to hit the sign up button after filling out the form, but it’s not doing anything or giving me an error.

Glad to hear it! Do you have any preference on traditional Mandarin vs. simplified? It's simplified at the moment.

That's weird. Any chance you could ping me an email with the email you're using to sign up and I'll work out what's going wrong? chris@prettypolly.app. Thanks again.

I'd say you should offer both simplified and traditional in the language dropdown as there are many learners of both.