Show HN: Duolingo-style exercises but with real-world content like the news (app.fluentsubs.com)

472 points by ph4evers ↗ HN
I've been working on a little side project that combines Duolingo-like listening comprehension exercises with real content .

Every video is transcribed to get much better transcripts than the closed captions. I filter on high quality transcripts, and afterwards a LLM selects only plausible segments for the exercises. This seems to work well for quality control and seems to be reliable enough for these short exercises.

Would love your thoughts!

188 comments

[ 3.2 ms ] story [ 243 ms ] thread
I placed one word wrong and it didn't tell me what was the correct word, so I learned nothing, I only failed.

Also I'm maybe jlpt4 and the text was too hard, you should let me choose difficulty.

Thanks for trying! Sorry about that. I've changed the daily exercise to an easier one for Japanese. Right now it takes random videos from all levels for the exercises, but I'm working on creating one simple one and a more challenging one.
This is great - I've actually started building something similar myself a few months ago.

Requests:

- Split Spanish between Spain and Latin America

- Add difficulty levels (consider speaking speed and vocabulary used)

- Ability to select which topics I want the videos to be about (e.g. science, celebrity gossip, AI)

+1 to splitting Spanish. Even better is picking a Spanish speaking country and listening to news from that specific country.
Thanks!

> Split Spanish between Spain and Latin America Will do!

> Add difficulty levels (consider speaking speed and vocabulary used)

I'm working on splitting it up in easy/normal videos. That should be do-able to assess.

> Ability to select which topics I want the videos to be about (e.g. science, celebrity gossip, AI)

I'm thinking about creating a browser plugin where you can tick a box to automatically import it into Fluentsubs. Or create an exercise from an existing video. It will take minutes before it is fully transcribed but it can be a nice way to prep your own content without people blaming me that I serve biased content.

I'm not sure though if people are willing to install browser plugins. I'm always a bit weiry with plugins that are invasive on websites like YouTube.

As a resident Duolingo apologist this is certainly awesome! I appreciate how little landing-page fluff there was before I could give it a shot. I tried Japanese and felt it was only reasonable in tandem with my in-built translation extension, since Kanji-reading knowledge itself is a major hurdle of learning. Furigana would really help this, but personally, being able to translate the words I pick helps a lot during the challenge of hearing new vocabulary in native Japanese.

As well, I am learning multiple languages, and noticed that the settings panel seems to be the way to switch between them. I think it's a little unnatural to force a user to do this, but if there's an intention for bookmarking languages of interest for separate collections of videos & transcription exercises I can say I'd be happy to pay, honestly. The pricing itself seems reasonable and I appreciate that I can feel the app out for free.

Interesting project!

Thank you! And great suggestions!

I focussed first on European languages as I'm learning French. But I'll put some more effort in improving the Japanese experience since it seems to be very popular.

> but if there's an intention for bookmarking languages of interest for separate collections of videos & transcription exercises I can say I'd be happy to pay, honestly.

Would a language selection box at the top be enough? Or do you mean a more elaborate way to switch between languages?

For me, the main interest would be to switch the interface for one language to another in ideally 1-2 clicks; so if there was an interface element that captured the languages I was 'working on' that would be neat. Then I'd be happy to peruse the full list whenever curiosity spikes.

Otherwise, great work on a good use of existing technologies to provide meaningful educational benefit for yourself and others!

first screen is 'Select a language' - maybe good to make clear if that's your own language, or your target learning language
True, I selected my own language at first
Nice, tried it. Looks cool. On the phone the drag and drop is a bit tricky. Dropped a wrong word and it got score emediatly as wrong, even though I was going to fix it. I expected scoring to happen after I click "submit". But maybe that's the same in Duolingo, no idea.
Thanks for trying. Yes this is on the roadmap. I think it is more intuitive for phones to click, and then hit submit instead of dragging (especially with large fingers hah)
Did you hand-pick the videos? My first one was some Elon Musk conspiracy dumpster and the second one some church “morality” thing… I think it’s a good example of what not to do with LLMs.

Also, your page needs to disclose any content filtered by or generated by a model.

No I let the LLM filter on "non-war and non-politics" but I don't have a ton of content available (yet) so it might picked something that was not great. Which language did you try?
Apparently I need to sign in to protect the community or s/t

So there was no way to play the video.

Also that blinding flash of white when it starts is unnecessary cruelty

Aj, sorry about that. I think it is YouTube blocking you. I didn't think of that edge case yet so I think my app will keep trying to play the video. Thanks for the report.
You fixed the videos!

This is awesome :)

I had to (was able to) slow the videos to 1/2 speed (no tengo muchas parablas dontcha know) but this is much better training than Duolingo

That’s cool. I managed to guess several sentences without even watching videos.
It looks great - nice work. I tried the french example and found it challenging and useful - a great addition to my duo lingo practice. So much so that I signed up. But in doing so I lost the credits that Id apparently acquired by completing the example which was a little disappointing. I hadnt seen the Easy French videos before - they look nice too.
Really cool idea! I tried a few Spanish ones (I speak Spanish) and unfortunately it was marking things as incorrectly wrong on 2/5 videos I did!
That's a bit unfortunate, sorry about that!

I only checked English, French, Dutch and German and assumed that Spanish would be OK. Was this for drag & drop. And do you maybe have the video? Maybe I need to tune the quality threshold specifically for Spanish videos.

I actually did the same video on desktop and the same answers worked fine! Screenshots of it failing in an android webview, but passing on desktop firefox: https://imgur.com/a/vALlFdH.
Oh wow, I think this is a cross platform bug where I dumbly assumed that strings were equal without normalizing it. I'll fix it! Thanks!
Awesome idea! Do you plan to add Portuguese soon? I found it surprising that Dutch is in there before it given there are far fewer speakers. Was this related to the amount of content available?
Thanks! And yes I'll add it soon. I'm Dutch so I could validate the videos.

> Was this related to the amount of content available?

Yes, Portuguese is available in the app, but I only transcribe the Easy Portuguese videos for now so I don't have a lot of content available at the moment.

I checked the Portuguese content available and you should clarify it's Brazilian (and change the flag to the Brazilian one so it doesn't induce in error).
Yes, will do that. Thanks for the suggestion!
Hey, this looks really nice and worked like a breeze for French!

Question: out of the processing steps you mention - transcription, quality filtering, segment selection, and (I guess) wrong-word selection) are there any truly manual steps? Those would be the ones that prevent you from building this for just about any language that has good transcription available, right?

There are no manual steps. But it is hard to gatekeep quality. The transcription models work well for the large languages but not so much for the smaller ones.
I just tried the Dutch (my native language) version, and it looks neat, but at some point it asked me to type Emmeloord, which is a small town in the Netherlands. That would be very challenging for someone learning the language without being relatively familiar with the Netherlands, so maybe you can tell the LLM to avoid names?
Hah thanks for the suggestion. I'll make it more strict!
Pretty cool honestly, very nice job. The UX is well made, no distractions, you can consider doing several small sessions during the day to learn during breaks. I love it! I would personally be quite interested in Chinese (in that case, I would strongly recommend putting the accents on latin characters, otherwise users cannot know how to pronounce).

I tried Spanish and Japanese. A tiny recommendation for Japanese: it would be nice to have both kanjis and hiraganas in the same block for the word choices. That way, you can decouple the learning of kanjis from the pure listening.

Great work, really!

This looks great! A humble request: a more button that I can press to sign up for an email when a language I seek gets added.
Thank you! I'm trying to push new updates to a sub-reddit here: https://www.reddit.com/r/fluentsubs/ . Simply adding support for manually transcribing videos should be quick to add. However, it also greatly depends on how quick these transcription models get better.
For some reason, probably my corporate firewall, this is blocked by certificate errors for me.
Probably YouTube is blocked by the corporate firewall. Or my whole domain?
Mines' the same. My local firewall blocked the site when the YouTube embbed tried to play, and when I switched to my work VPN it blocked the domain altogether.
Youtube itself is fine. It's not a domain block but "certificate issuer unrecognized". Palo Alto Networks?
I tried the japanese version. I like that you are using real Japanese language YouTube videos. You can see the kanji on the videos though so it kind of defeated the point. Hide the video? Great idea though and very fun too.
Thanks for trying! You can hide the video by clicking the video button.
Looks real nice. I'll be using it. If you could map spacebar to pause/unpause the video by default (without focusing on the YouTube window first) that would be great.
The English icon has the Union Jack flag rather than the US flag, so it automatically elevates the service above Duolingo for me.
(comment deleted)
That’s the problem with conflating nations and language.

For example, the very first English video I got was a South African English accent.

It works to a first approximation.

Of the five languages I have configured in KDE, three of them are country-specific. So I use the flag indicator, which is far quicker for me to locate and identify out of the corner of my eye than would be a text label (which would require using the retina and thus more time and attention).

Sure, fine for personal uses. I mean broadly and generally.

As for English, the United States has far and away the largest number of native English speakers.

Not that I think the stars and stripes has any more right to represent “English” as a concept any more than the Union Jack. If you’re going on origin, why not the flag of England instead?

  > If you’re going on origin, why not the flag of England instead?
I actually really like that idea. The US and UK flags seem to represent more culture than language.
I mostly meant that facetiously as now we're entering the linguistic quagmire of trying to pin down an exact origin for a language, and furthermore (depending on your chosen definition of "English") the language itself predates the current flag of England, so even that is open to debate regarding its appropriateness.

The moral is: don't try to draw boxes around languages.

All that said, I do understand why someone would want to use flags as shorthand for language. It's wrong, but it's useful.

English (Traditional) vs English (Simplified)
That meme is such a load of hogwash. In many ways, US English is closer to "traditional" than UK English. They've both diverged somewhat from what they were in the 17th century. Neither form has been "simplified" in any way.

As for the Union Jack: the UK has at least 3 rather different languages (English, Gaelic, Welsh), possibly a few more depending on how you count the different kinds of Gaelic.

Using a country flag to represent a language has always struck me as being silly. Only rarely do they map 1-to-1.

It's entirely a joke based on the two different versions of "Chinese" offered on most websites, it's not really meant to be taken seriously. But I've heard that there's an island in New England somewhere whose local accent is closest to Elizabethan English.
Tangier Island off of Virginia, in the Chesapeake:

https://www.bbc.com/travel/article/20180206-the-tiny-us-isla...

Also, for what it's worth:

> Some people have characterised Tangier’s way of speaking as ‘Elizabethan’ or ‘Restoration’ English, but that’s nonsense. Languages aren’t static and the Tangier dialect has changed a lot because of its isolation. It’s a distinct creation of its own," Shores said.

Yeah, but there is a real difference between simplified and traditional Chinese characters. Traditional are more ornamental/complicated while simplified are ... simplified/minimalist .
Honest question, what's the meaning behind this joke? Is it just referencing the fact that American English drops "u" in the spelling of e.g. "color"?
It's primarily a reference to various language selection dropdowns offering "Chinese (Traditional)" (which is used in Taiwan) and "Chinese (Simplified)" (which is used on the Chinese mainland). That difference arises from Mao-era simplification of many of the most common hanzi characters to make them easier to write or distinguish.

Mixed with, yes, the variant spellings and word choices (e.g. chips/crisps/biscuits) that make it apparent to British English readers when something is American.

I think my confusion is more from the implication that variant spellings imply "simplification"—even at a glance, simplified and traditional hanzi differ greatly in complexity, whereas I don't see how "chips" is any simpler than "crisps", even as a joke....

EDIT: Of course, it doesn’t matter one bit in the grand scheme of things—feel free to ignore my pedantry over a silly joke :-)

Rather ironic, considering that it’s a flag to indicate personal union of ownership of subjects and lands by the Scottish king who inherited the subjects and lands of England, but you prefer it to be the icon for the language of the state of England, a country in which its own language is more or less indecipherable in many places due to accents, dialects, and degeneration and creolization.

You would be far more likely to understand any given English speaking person in the USA than in England. It should really be called American at this point.

> accents, dialects, and degeneration and creolization. There are just as many accents and dialects of English in the Americas as there are in Britain. Even your term "creolization" comes from Louisiana. It's a matter of perspective and something that all language learners will have the face, the difference between 'standard' English/Spanish/German and regional variations both within it's originating country and from abroad.
This really isn’t a positive point. Flags represent nations, not languages, and it can be quite offensive to equate the two.

To use your example, there are plenty of Irish people who speak English but would resent being forced to identify with the Union Flag.

For another example that is very relevant today, there are plenty of Russian-speaking Ukrainians who hate Russia. Using the Russian flag to represent them would at best be distasteful.

(comment deleted)
Will give it a shot if you add Mandarin/simplified or swahili.
Great idea. However, the clip I got was spoken so fast that if I was able to actually understand any of it I think I wouldn't be learning Spanish as I'd have already mastered it.

Is there a beginner mode?

you could change the video speed, would be cool if he added a button to do it
Looks cool! Unfortunately, the buttons are unresponsive on Firefox :/
Any timeline for other languages? Would very much like to see Greek. Alvast bedankt ;)
I think one other point to consider in the content filtering: One of the first examples that was shown to me had in-video subtitles, which made the exercise too trivial, as the answers were essentially given away.
I love having real sentences -- so much more engaging than the random things made up by Duolingo!

What are your long-term plans with this? I'd love at some point to be able to combine something like this with an algorithm I'm working on called Guided Immersion.

Basically, the system tracks what words you know and don't know, and so could tell you how hard a given sentence is for you. And it also tracks what words it would be useful to review and/or learn (spaced repetition and frequency analysis), to tell you how valuable a sentence would be for you.

The algorithm is generic and can be adapted to any language; right now it's been adapted to Mandarin Chinese, Korean, and New Testament Greek. (Which unfortunately so far doesn't seem to overlap with any of your available languages.) I'm working on an API to allow any content providers to use the algorithm.

Adding this to your system could help focus the content you're showing people to things that they're likely to be able to understand without having to look up most words, and helping them incrementally grow and solidify their vocabulary using the built-in spaced repetition.

Drop me a line if you want to chat at some point -- my email is in my about.