Show HN: Duolingo-style exercises but with real-world content like the news
451 points
1 day ago
| 85 comments
| app.fluentsubs.com
| HN
I've been working on a little side project that combines Duolingo-like listening comprehension exercises with real content .

Every video is transcribed to get much better transcripts than the closed captions. I filter on high quality transcripts, and afterwards a LLM selects only plausible segments for the exercises. This seems to work well for quality control and seems to be reliable enough for these short exercises.

Would love your thoughts!

gwd
1 day ago
[-]
One more thing, just in general: Some people are complaining that some languages work better than others. This seems to be a common issue now with the availability of AI (both voice recognition and LLMs): there's a temptation to expand into as many languages as possible, simply because you can.

My advice would be to have languages default to an "alpha" state, and only progress them to "beta" and "1.0" state when they reach certain milestones, as defined by community feedback.

reply
ph4evers
1 day ago
[-]
Agreed. That's why the exercises are only there for a couple of selected languages. But even there it can be tricky. The model is less confident in Dutch than in English, so I have to experiment a bit with what is best for having a variety of content and quality.
reply
dicytea
1 day ago
[-]
I've checked out the Japanese one, but I'd say that it's definitely no where near "real-world content" IMO. Just the usual tortuously slow-paced, artificially dumbed-down dialogue you'd expect out of classroom recordings.

Most of the videos also contain subtitles, which defeats the purpose of the exercises (you can disable the video manually though). Another issue is that some of the words are segmented very unnaturally (e.g. [み][ません]), so it's unclear how you're expected to fill them in.

In the end if what you really want is "real-world content", then you just need to go out there and find them yourselves - they're everywhere.

reply
raincole
1 day ago
[-]
> Another issue is that some of the words are segmented very unnaturally

I immediately noticed that too. Are the "gaps" generated by an LLM? I think the model might not understand Japanese very well.

reply
yorwba
1 day ago
[-]
It's a bit like segmenting "don't see" into "don't" and "see." ません is the negative of the auxiliary ます just as "don't" is the negative of the auxiliary "do." If you have to split Japanese text into words and want to be principled about it, treating ません as a separate word is not a bad way to go about it.

But of course there are other ways, so a "fill in the blank" question with two gaps right next to each other is generally a bad idea.

reply
raincole
1 day ago
[-]
The point is not that you can't cut みません into み and ません. The point is that it should be one single gap in the first place.

It's like cutting gaps out of English sentence like this: I'm [go][ing] to beat the shit out of that guy. Sure we know the logical way to break down 'going' is 'go' and '-ing', but it should be one single gap anyway.

reply
johnisgood
21 hours ago
[-]
Damn, where did that example come from? :P
reply
owenpalmer
1 day ago
[-]
+1 this definitely makes sense, since you're gonna have a million verbs ending in "masen", just make it a separate word and understand that it's just part of the conjugation.
reply
oregoncurtis
1 day ago
[-]
I agree, several little issues with Japanese that don't make it currently useful. Cool idea though!
reply
hrydgard
1 day ago
[-]
Great stuff!

Small UX thing: Make it so you can just click a word to fill in the next empty spot, instead of having to drag, similar to when building sentences in Duolingo. Especially when not on a touchscreen, having to drag is pretty painful and reduces accessibility.

reply
mirekrusin
1 day ago
[-]
Aaa, you saved me, thought it's broken, but you have to drag this thing!

ps. video shouldn't loop as default, it's annoying.

reply
drob518
19 hours ago
[-]
I actually like the default looping. When I’m learning and trying to train my ear, I need to listen to the phrase over and over and it’s helpful to not have to click play again.
reply
hoseyor
1 day ago
[-]
You didn’t even read the most basic settings that clearly say “click and drag interface” or something similar. But I still agree, tapping/clicking should work in sequential order eventually (it’s not as easy to implement).

Re, looping; there are controls to turn it off. You aren’t paying attention one bit. If you’re going to say things, at least be diligent in the things you are going to address.

reply
ketralnis
1 day ago
[-]
I also don't read all of the terms and conditions, and I feel free to get mad at unreasonable items that I discovered while using the product. Fight me.
reply
raincole
1 day ago
[-]
FYI: when people say "X is default and it's annoying", it doesn't necessarily mean that they don't know how to turn off X.
reply
hombre_fatal
1 day ago
[-]
You don't need to be so combative in this feedback thread for someone's language learning app.
reply
whycome
1 day ago
[-]
It’s not clear that those controls are for the video on first glance. I thought they referred to the exercise itself (eg, restart exercise).

I think you’re not thinking like a new user.

reply
ph4evers
1 day ago
[-]
Will do. I also like the click to place more than dragging & dropping.
reply
iambateman
1 day ago
[-]
This has a ton of potential! Keep going!

Duolingo is tough because they set the expectation that this should be free, so you're walking into a challenging business.

But I think the concept is fundamentally better to connect language learning to something entertaining and relevant. If you can make that work, you have a heck of an app.

You can do it!

reply
beardedwizard
1 day ago
[-]
The trick to competing with Duolingo is to _actually_ teach people new languages that they actually learn, rather than giving away the illusion that they are learning a new language on Duolingo.
reply
mlsu
1 day ago
[-]
Is it?

At the end of the day, whether it's effective or not, Duolingo sells the feeling that you are learning a language to people. Winning a competition with Duolingo means doing better at making people feel like they are learning a language -- the strategy to win against Duolingo probably involves watering down the learning even more, to better sell the feeling.

A good way to think about it is look at some organization that wants to be effective at actually teaching its employees a new language, like the state department:

https://www.state.gov/foreign-service-institute/foreign-lang...

20 hours a week of intensive instruction.

Spanish 30 weeks Cantonese 88 weeks Turkish 44 weeks

This is what it actually takes.

reply
jpcom
1 day ago
[-]
Yes, it takes commitment to master a language. In the case of Japanese, which traditionally takes the most weeks to master when coming from English, we made Japanese Complete based on frequency analysis to help speed up the process of acquisition. With 777 kanji carefully selected by frequency you can get 90% coverage of kanji in the wild. This is about a third of the "daily use" set of ~2200 kanji so the process is greatly accelerated. If you're interested in seeing what 777 kanji look like, I recently created a small kanji quiz game that quizzes by English meaning words [0].

[0] https://japanesecomplete.com/kanji-game.html

reply
mandmandam
21 hours ago
[-]
Very cool; and pretty too!
reply
yieldcrv
23 hours ago
[-]
there is an underserved audience that wants an engaging way to learn a language and are disillusioned with Duolingo already

Duolingo is for people that will never travel for more than a weekend once every other year, and its fine that its entertaining for them or their last minute crash course to feel less ignorant. Lately I've seen it used by people that want to feel closer to their roots.

But I don't think people actually engaging with other cultures and going abroad to do so are still using this. On the other hand, LLM's are really good at slang and colloquialisms, something neither Duolingo or an in person teacher will reveal to you.

reply
Tainnor
12 hours ago
[-]
> there is an underserved audience that wants an engaging way to learn a language and are disillusioned with Duolingo already

I'm just very unsure whether it's possible to design an effective language learning program that is "engaging" in the way that Duolingo users want it. At the end of the day, you should feel engagement from using the language (and seeing yourself improve) and not from external gimmicks.

reply
alchemyzach
1 day ago
[-]
True but then I remember that most people are just paying for the feeling. There's millions to be made actually teaching people stuff (learning is hard) but there are billions to be made making people feel like they are.

That said, I do think betting against Duolingo will pay off long term. But the put options are so expensive... probably better to just short the shares

reply
matwood
1 day ago
[-]
> rather than giving away the illusion that they are learning a new language on Duolingo

I disagree that it's an illusion. People are learning a new language when using Duolingo, but 5-10 minutes/day means it will take a long time before they are proficient. Someone else linked to the state department website showing 550-690 hours of learning required on the English adjacent languages.

reply
ph4evers
1 day ago
[-]
Thanks! Competing with the giant like Duolingo is hard. But I believe that there is an edge, especially if these transcription models keep improving. I find them quite good already but simple mistakes are very off-putting.
reply
philipjoubert
1 day ago
[-]
This is great - I've actually started building something similar myself a few months ago.

Requests:

- Split Spanish between Spain and Latin America

- Add difficulty levels (consider speaking speed and vocabulary used)

- Ability to select which topics I want the videos to be about (e.g. science, celebrity gossip, AI)

reply
ph4evers
1 day ago
[-]
Thanks!

> Split Spanish between Spain and Latin America Will do!

> Add difficulty levels (consider speaking speed and vocabulary used)

I'm working on splitting it up in easy/normal videos. That should be do-able to assess.

> Ability to select which topics I want the videos to be about (e.g. science, celebrity gossip, AI)

I'm thinking about creating a browser plugin where you can tick a box to automatically import it into Fluentsubs. Or create an exercise from an existing video. It will take minutes before it is fully transcribed but it can be a nice way to prep your own content without people blaming me that I serve biased content.

I'm not sure though if people are willing to install browser plugins. I'm always a bit weiry with plugins that are invasive on websites like YouTube.

reply
nbcesar
1 day ago
[-]
+1 to splitting Spanish. Even better is picking a Spanish speaking country and listening to news from that specific country.
reply
rurp
1 day ago
[-]
One minor but very nice aspect of the UX is that I was able to click the link and immediately try it out. I wasn't even planning to really use it but ended up completing a round. My only complaint is that the drag and drop is kind of annoying as the default selection process, clicking would feel more natural.

For comparison I tried doing the same with Duolingo and the UX is much, much worse. After multiple clicks and two noticeably long loading screens the first question I got was "How did you hear about Duolingo?" followed by a question about why I'm using the product. Blech! I wanted to try out the product, not help their marketing department.

reply
pajop
1 day ago
[-]
This is so good! I've been looking for a tool that will simulate the "listen to the Spiderman movie 50x" experiment https://www.youtube.com/watch?v=eliB_y0fmSk and this site can do it!
reply
hk__2
1 day ago
[-]
I tried an exercise with Italian, but for some reason one of the words is not in the list to drag and drop ("qualcuno"), so I’m stuck: https://app.fluentsubs.com/exercises/cm8y1r2cv004m8v1pr775ko...

Edit: also tried in French, and it shows some words in red (I guess that means "invalid" -- please don’t convey information with color only) although they are correct: https://app.fluentsubs.com/exercises/cm8y1o6d5002s8v1p2h0m2f...

reply
ph4evers
1 day ago
[-]
Thank you for trying and the feedback!

I'm working on improving the feedback. It is a bit confusing since some words are very similar so you have no idea what went wrong.

I checked the Italian video. But I don't fully understand: https://imgur.com/a/YcF3dnb . It doesn't pick qualcuno as a filler word. Is it still broken?

reply
tom2948329494
1 day ago
[-]
Just a quick note – the "Configure Your Exercise" step was a bit confusing. It took me a while to figure out what “Number of Gaps” even meant, since that’s not something I’d usually think about configuring.

Also, choosing an input method felt tricky. I hadn’t used the product yet, so I didn’t really know what to pick or what would work best for me.

Once I got into the app, everything made sense, but it wasn’t clear upfront.

Maybe you could let people start with a default setup and explore the options while using it. That way, the learning happens more naturally and the config step doesn’t feel like a blocker.

reply
slab_city
1 day ago
[-]
Not knowing what "number of gaps" means has no consequence. Just use the app.
reply
setsewerd
1 day ago
[-]
If that's true then why include it at all? From a UX perspective you don't want to throw a bunch of configuration options at the user before they even know what the options mean.
reply
tom2948329494
1 day ago
[-]
It's a hurdle people have to take; and its eating from their 1.5second attention span. Some will get stuck or leave. OP asked for thoughts, this is to help him convert more people.
reply
Vinnl
1 day ago
[-]
I just tried the Dutch (my native language) version, and it looks neat, but at some point it asked me to type Emmeloord, which is a small town in the Netherlands. That would be very challenging for someone learning the language without being relatively familiar with the Netherlands, so maybe you can tell the LLM to avoid names?
reply
ph4evers
1 day ago
[-]
Hah thanks for the suggestion. I'll make it more strict!
reply
sergiosgc
1 day ago
[-]
Great idea, nice proof of concept. It'd be nice to see a translation into English after we finish the sentence, as it'll inevitably introduce words I don't known yet, and there's a learning opportunity.
reply
ph4evers
1 day ago
[-]
Thanks! It is available on Desktop immediately after you finish a segment. I'm thinking of bringing it back to mobile. I made it a toggle to save some space on small devices
reply
whycome
1 day ago
[-]
The few UX things can make for a really frustrating experience. You don’t want to push away your users in their first testing.

1. Change the word “gaps” to “blanks” for English audiences. It fits the common phrase “fill in the blanks” better. And maybe call it that too.

2. Don’t make the blocks move around for the drag and drop. It makes for a frustratingly slow process to find where the word you were about to grab moved to.

3. Don’t just correct a wrong answer, show what the user chose. I had too many moments where I was convinced the answer was what I had selected. Even using the red/green doesn’t quite make sense if you’ve replaced an incorrect answer with a now correct answer.

3. Consider doing the check after all words have been dropped in so they can read the sentence as a whole. And thus give them the chance to change their word choice.

reply
Timpy
1 day ago
[-]
Just a friendly heads up, for the Japanese exercises the video starts just a bit too late and the word you're listening for is cut off. This might only be pertinent for languages where vocab words are appearing at the beginning of sentences, French and Spanish didn't have "gap words" at their sentence start for the few exercises I tried.

This is a cool app, I would have enjoyed this when I was grinding on Japanese back in the day.

reply
inetknght
1 day ago
[-]
My biggest complaint about Duolingo is the lack of feedback about how to improve. There are several words whose pronunciations I think I correctly have but the app doesn't understand my pronunciations ever. There are also some words whose dictionary translations aren't provided or are used differently than the translation help offers. Without feedback to ask questions and get answers it's very frustrating.
reply
slumberlust
1 day ago
[-]
Would love to see a way to understand the english equivalent of each word. As it stands now you aren't really expanding your vocab if you are just listening and copying what they say without knowing the word's meaning.
reply
ph4evers
16 hours ago
[-]
You can click on a word after finishing the segment to get a translation.
reply
swyx
1 day ago
[-]
my immediate feature request. this project is ALMOST there teaching me.
reply
JackYoustra
1 day ago
[-]
This looks great! A humble request: a more button that I can press to sign up for an email when a language I seek gets added.
reply
ph4evers
1 day ago
[-]
Thank you! I'm trying to push new updates to a sub-reddit here: https://www.reddit.com/r/fluentsubs/ . Simply adding support for manually transcribing videos should be quick to add. However, it also greatly depends on how quick these transcription models get better.
reply
polymatter
1 day ago
[-]
Second this request
reply
mrwww
1 day ago
[-]
Super cool that you've got Dutch as well! I make https://hetnederlands.com, would be happy to do a link exchange or something like that. Feel free to get in touch lars@hetnederlands.com
reply
mitthrowaway2
1 day ago
[-]
I tried Japanese; the Youtube video that autoplayed had its timing slightly off so that instead of saying あたまも疲れました I only heard まも疲れました. It was pretty confusing but fortunately the answer was displayed right in the video because the video itself had its text spelled out.

https://app.fluentsubs.com/exercises/cm8v909oq00fj9x1kztl1ez...

reply
anotherpaul
1 day ago
[-]
Nice, tried it. Looks cool. On the phone the drag and drop is a bit tricky. Dropped a wrong word and it got score emediatly as wrong, even though I was going to fix it. I expected scoring to happen after I click "submit". But maybe that's the same in Duolingo, no idea.
reply
ph4evers
1 day ago
[-]
Thanks for trying. Yes this is on the roadmap. I think it is more intuitive for phones to click, and then hit submit instead of dragging (especially with large fingers hah)
reply
owenpalmer
1 day ago
[-]
I absolutely love the idea. I would honestly use this. However, when I tried the English learning, it incorrectly marked words wrong several times. Something to check out.
reply
ph4evers
1 day ago
[-]
Thank you! It seems that the video is pretty well transcribed but it unluckily selected segments with a few words missing :/
reply
owenpalmer
18 hours ago
[-]
The words were correct in the YouTube subtitles, both in spelling and sequence. It must have been a problem with the transcription or some other bug (whitespace?)
reply
vincvinc
1 day ago
[-]
first screen is 'Select a language' - maybe good to make clear if that's your own language, or your target learning language
reply
logoji
1 day ago
[-]
True, I selected my own language at first
reply
hobofan
1 day ago
[-]
I think one other point to consider in the content filtering: One of the first examples that was shown to me had in-video subtitles, which made the exercise too trivial, as the answers were essentially given away.
reply
gwd
1 day ago
[-]
I love having real sentences -- so much more engaging than the random things made up by Duolingo!

What are your long-term plans with this? I'd love at some point to be able to combine something like this with an algorithm I'm working on called Guided Immersion.

Basically, the system tracks what words you know and don't know, and so could tell you how hard a given sentence is for you. And it also tracks what words it would be useful to review and/or learn (spaced repetition and frequency analysis), to tell you how valuable a sentence would be for you.

The algorithm is generic and can be adapted to any language; right now it's been adapted to Mandarin Chinese, Korean, and New Testament Greek. (Which unfortunately so far doesn't seem to overlap with any of your available languages.) I'm working on an API to allow any content providers to use the algorithm.

Adding this to your system could help focus the content you're showing people to things that they're likely to be able to understand without having to look up most words, and helping them incrementally grow and solidify their vocabulary using the built-in spaced repetition.

Drop me a line if you want to chat at some point -- my email is in my about.

reply
timeinput
1 day ago
[-]
This is an amazing concept.

It would be nice to limit the YouTube content a bit like not just news, but an option for news in slow French, or something else. At least for me news in slow French is way easier to understand than news in French at 0.5x in you tube.

Maybe it's just my phone, but the dragging and dropping wasn't hit or miss it was mostly broken. On an English speaking video (my native language) filling in three gaps took me like five video repetitions to get the words in place. It made me feel a lot better about my Spanish speaking performance. Just clicking the words like someone else suggested would solve the problem completely for me, but it might be like a "hit box" problem on the words.

reply
annienar
1 day ago
[-]
I tried the japanese one, as an A1, I can't read/don't know kanji yet, would be nice to have an option to see katakana/hiragana only, an option to have furigana and an option to see the kanji. Also would like an option to save phrases and not just a word. but likes it overall
reply
ph4evers
1 day ago
[-]
Thank you! It should store the word and the sentence so that rehearsal is always with both.

I focussed a lot on European languages at first so the support for the Asian languages is a bit lacking. The only thing I did so far was changing the font and increasing the font size. There is a lot more to do! Thanks!

reply
mcjiggerlog
1 day ago
[-]
Really cool idea! I tried a few Spanish ones (I speak Spanish) and unfortunately it was marking things as incorrectly wrong on 2/5 videos I did!
reply
ph4evers
1 day ago
[-]
That's a bit unfortunate, sorry about that!

I only checked English, French, Dutch and German and assumed that Spanish would be OK. Was this for drag & drop. And do you maybe have the video? Maybe I need to tune the quality threshold specifically for Spanish videos.

reply
mcjiggerlog
1 day ago
[-]
I actually did the same video on desktop and the same answers worked fine! Screenshots of it failing in an android webview, but passing on desktop firefox: https://imgur.com/a/vALlFdH.
reply
ph4evers
1 day ago
[-]
Oh wow, I think this is a cross platform bug where I dumbly assumed that strings were equal without normalizing it. I'll fix it! Thanks!
reply
mdaniel
1 day ago
[-]
It seems we either ate all your LLM credits or knocked your server over since the spinner just spins (checking dev tools coughs up that https://app.fluentsubs.com/api/exercises/daily?language=fr is 504)

After 4 retries, the spinner finally gave up but it incorrectly said "Sorry, no exercise available for this language today." and not, as it should have, "We were unable to load the exercises. Try again later, or contact support at ${email}"

---

The AppSec-er in me wants to point out that returning the version of nginx that you're using is an antipattern since it enables more targeted attacks if the version has woes; it does it in the error, and it does it in the headers

reply
ph4evers
1 day ago
[-]
Thanks for reporting! I'll fix the Nginx version exposure.

Yes, the server got knocked out. I was not expecting this much traffic hah. I already upgraded it but I have an NLP server with 10 language models loaded and it seems to be grinding CPU resources.

reply
N-Krause
1 day ago
[-]
I am a audio-visual learner and on Duolingo, which I am currently using to learn Spanish, my biggest problem is, that I have not a real visual for the words. Sure sometimes you get a picture for single substantives, but learning via video and watching mouth movements is so much better for me.

So this is a welcome tool I am definitively gonna check out.

reply
black_puppydog
1 day ago
[-]
Hey, this looks really nice and worked like a breeze for French!

Question: out of the processing steps you mention - transcription, quality filtering, segment selection, and (I guess) wrong-word selection) are there any truly manual steps? Those would be the ones that prevent you from building this for just about any language that has good transcription available, right?

reply
ph4evers
1 day ago
[-]
There are no manual steps. But it is hard to gatekeep quality. The transcription models work well for the large languages but not so much for the smaller ones.
reply
mattsouth
1 day ago
[-]
It looks great - nice work. I tried the french example and found it challenging and useful - a great addition to my duo lingo practice. So much so that I signed up. But in doing so I lost the credits that Id apparently acquired by completing the example which was a little disappointing. I hadnt seen the Easy French videos before - they look nice too.
reply
bomewish
12 hours ago
[-]
I'd straight up pay 5 or 10 bucks a month for this if it was like... 200% more functional/featured/professional/working. VERY good proof of concept and I love it. Target language is german fwiw.
reply
nougati
1 day ago
[-]
As a resident Duolingo apologist this is certainly awesome! I appreciate how little landing-page fluff there was before I could give it a shot. I tried Japanese and felt it was only reasonable in tandem with my in-built translation extension, since Kanji-reading knowledge itself is a major hurdle of learning. Furigana would really help this, but personally, being able to translate the words I pick helps a lot during the challenge of hearing new vocabulary in native Japanese.

As well, I am learning multiple languages, and noticed that the settings panel seems to be the way to switch between them. I think it's a little unnatural to force a user to do this, but if there's an intention for bookmarking languages of interest for separate collections of videos & transcription exercises I can say I'd be happy to pay, honestly. The pricing itself seems reasonable and I appreciate that I can feel the app out for free.

Interesting project!

reply
ph4evers
1 day ago
[-]
Thank you! And great suggestions!

I focussed first on European languages as I'm learning French. But I'll put some more effort in improving the Japanese experience since it seems to be very popular.

> but if there's an intention for bookmarking languages of interest for separate collections of videos & transcription exercises I can say I'd be happy to pay, honestly.

Would a language selection box at the top be enough? Or do you mean a more elaborate way to switch between languages?

reply
nougati
1 day ago
[-]
For me, the main interest would be to switch the interface for one language to another in ideally 1-2 clicks; so if there was an interface element that captured the languages I was 'working on' that would be neat. Then I'd be happy to peruse the full list whenever curiosity spikes.

Otherwise, great work on a good use of existing technologies to provide meaningful educational benefit for yourself and others!

reply
Miraltar
1 day ago
[-]
That's neat ! Although I got an issue on the Finnish challenge, when I drag the (correct) word "koho" it transforms into the (incorrect) word "koko". I thought I missclicked and tried the whole challenge again but I reproduced it despite being very careful.
reply
ph4evers
1 day ago
[-]
Thanks for trying, and sorry about that. I thought that the videos for Finnish where on a decent enough level (only checked one). I'm afraid the transcription quality is not on par yet for Finnish. I'll add a warning for the smaller languages and hopefully the models will improve.
reply
sharmasachin98
1 day ago
[-]
This feels like a great blend of immersion and repetition. Curious if you’re doing any difficulty adaptation based on content complexity or vocabulary frequency?
reply
dzonga
1 day ago
[-]
Beautiful work. this has massive potential. I like the video aspect - it's almost as how people learned languages back then by listening to CDs and Tape. but now you can read someone's lips
reply
kmos17
1 day ago
[-]
Just did one spanish video, worked really well. The interface is simple enough and easy, great start. It would be great to have a translation appear after completing the words, and maybe a way to save words.
reply
whycome
1 day ago
[-]
The click and drag UX is cool. BUT, it’s super annoying that it reorganizes every time you drag one off. So the next one you may have been looking to drag has now moved (or it means you accidentally grab the incorrect one). Can they stay in their positions? (Eg, replace in place with a greyed out version of the removed word)
reply
adilmoujahid
1 day ago
[-]
Great idea! How did you decide on the pricing?

I launched a Japanese Kanji Learning App (KanjiMaster.ai) last month, and I chose a subscription instead of a one-time payment.

reply
ph4evers
1 day ago
[-]
Thanks! I decided on it because I think people are fed up with subscription systems and it was easy to implement. However, I made two sales (yay! first time ever) but I paid $20 today to DeepL. I might change it in the future.
reply
adilmoujahid
1 day ago
[-]
I just purchased 6 months of Pro access. Good luck with this project! It has good potential.
reply
ph4evers
15 hours ago
[-]
Thank you!!
reply
JetSetIlly
1 day ago
[-]
It's a good idea and something I will be interested in using

However, I was very confused by the interface at first. I started a with a 3 gap exercise. I dragged what I thought was the correct word into the gap. Listened again, changed my mind but I couldn't drag in my new choice. It was a while before I realised that the correct word had been inserted for me. This was despite me not completing the other gaps.

It would be better if the answers weren't given until the user submits the answer.

reply
dvh
1 day ago
[-]
I placed one word wrong and it didn't tell me what was the correct word, so I learned nothing, I only failed.

Also I'm maybe jlpt4 and the text was too hard, you should let me choose difficulty.

reply
ph4evers
1 day ago
[-]
Thanks for trying! Sorry about that. I've changed the daily exercise to an easier one for Japanese. Right now it takes random videos from all levels for the exercises, but I'm working on creating one simple one and a more challenging one.
reply
gniv
13 hours ago
[-]
Cool idea! I tried French with manual input. How do I move on, there is no button to advance.
reply
deepfriedchokes
1 day ago
[-]
This is awesome!

My biggest request would be the ability to slow down the videos for those of us who are beginners.

“Gaps” wasn’t clear to me in the settings initially, but is obvious once you start. Maybe clarify it a little?

Otherwise I enjoyed this a lot! Nice work!

reply
hombre_fatal
1 day ago
[-]
Nice UX.

News is good because it is inherently more interesting than any old video vs having to curate a bunch of interesting videos. It's also good that the videos loop—most tools that have tried to sync videos seem to never autoloop which means you have to keep manually playing it which is annoying.

Some improvements:

Increase the amount of exercise videos for the pro subscription—I only see three and only one new 2min video per day. The format is good enough to be a regular learning tool. I'd rather see a wall of pro-only videos when evaluating whether I went to subscribe. You want to give a sense of immediate value via backlog that the user will unlock since the impulse buy is that I get to immediately do a bunch of exercises because I loved the teaser exercise.

I think the ideal is that I like the demo lesson, I register, I click the exercises list to do another exercise, and I see a bunch of paywalled interesting videos that I'll be able to watch&learn, so I pay right there on the spot after clicking a video that I wanted to listen to.

Exercises:

- Alphabetize the word list so they are easier to find. Takes me forever to find words in this kind of setup, same on Duolingo.

- Allow text input even with the word list visible. The exercise customization option would then just be "Show word bank: boolean".

- Let us click words.

reply
ph4evers
1 day ago
[-]
These are some really awesome ideas for UX, thank you!

And I agree. The value from "Pro" should be very clear. What do you think about the one-time payments? Do you think that works or should it be a subscription?

reply
matwood
21 hours ago
[-]
I liked this a lot. I'm in the process of moving to Italy and am deep in learning Italian. I loved the different speeds and accents from the speakers.
reply
gokhan
23 hours ago
[-]
Nice work. A similar concept with songs, I guess it was called lyricstraining.com earlier:

https://lingoclip.com/

reply
sharperguy
1 day ago
[-]
Hmm, embedded youtube videos just do not work for me anymore. Maybe because I have too many privacy extensions enabled in firefox. I just get the "sign in to prove you're not a bot" message, and no way to sign in except manually opening youtube and trying to find the same video.
reply
tom1337
1 day ago
[-]
I wonder if this could be used as something like early recaptcha. Have a machine do transcriptions and for the parts where it's not entirely sure just let users play the game and then accept what most users chose as the correct solution. Later on train your automatic transcriber on this.
reply
Caduceus1
1 day ago
[-]
Any timeline for other languages? Would very much like to see Greek. Alvast bedankt ;)
reply
ImPleadThe5th
1 day ago
[-]
This is amazing! Definitely going to use this during my German study!
reply
burningFish
1 day ago
[-]
Pretty cool honestly, very nice job. The UX is well made, no distractions, you can consider doing several small sessions during the day to learn during breaks. I love it! I would personally be quite interested in Chinese (in that case, I would strongly recommend putting the accents on latin characters, otherwise users cannot know how to pronounce).

I tried Spanish and Japanese. A tiny recommendation for Japanese: it would be nice to have both kanjis and hiraganas in the same block for the word choices. That way, you can decouple the learning of kanjis from the pure listening.

Great work, really!

reply
ivan_gammel
1 day ago
[-]
That’s cool. I managed to guess several sentences without even watching videos.
reply
xattt
1 day ago
[-]
Have you seen Mauril for English-French training?

https://mauril.ca/en/

reply
skynetv2
1 day ago
[-]
I am 600 days on Duolingo I tried Spanish, I did not enjoy it. The videos speak Spanish too fast and the words are alien to me.
reply
CWIZO
1 day ago
[-]
Great idea. However, the clip I got was spoken so fast that if I was able to actually understand any of it I think I wouldn't be learning Spanish as I'd have already mastered it.

Is there a beginner mode?

reply
dionian
1 day ago
[-]
you could change the video speed, would be cool if he added a button to do it
reply
palata
1 day ago
[-]
This is cool!

I'm curious now: how do you transcribe the videos? And how do you align the transcript with the video (in terms of timing)? Are there libraries doing that?

reply
ph4evers
1 day ago
[-]
I'm using AssemblyAI and Deepgram. AssemblyAI for the large languages and Deepgram for the smaller ones.
reply
stephankoelle
1 day ago
[-]
Don't autoplay in a loop it's very annoying. With that gone, it will be fun. Remove drag and drop.
reply
JimmyBuckets
1 day ago
[-]
Awesome idea! Do you plan to add Portuguese soon? I found it surprising that Dutch is in there before it given there are far fewer speakers. Was this related to the amount of content available?
reply
ph4evers
1 day ago
[-]
Thanks! And yes I'll add it soon. I'm Dutch so I could validate the videos.

> Was this related to the amount of content available?

Yes, Portuguese is available in the app, but I only transcribe the Easy Portuguese videos for now so I don't have a lot of content available at the moment.

reply
rlf_dev
1 day ago
[-]
I checked the Portuguese content available and you should clarify it's Brazilian (and change the flag to the Brazilian one so it doesn't induce in error).
reply
ph4evers
1 day ago
[-]
Yes, will do that. Thanks for the suggestion!
reply
axpy906
1 day ago
[-]
Suggest to get rid of drag and drop for multi choice or something else. Tried doing on mobile and it’s a bit difficult.
reply
joo2024
1 day ago
[-]
could u add euro portuguese please? ive seen many euro portugues language models. ive been meaning to learn but most are brazilian
reply
IntStorage
1 day ago
[-]
This is a great idea! Anyway to stop the videos from constantly replaying while filling the gaps?
reply
KerryJones
19 hours ago
[-]
Love the idea! Any chance you could get Mandarin?
reply
ed_db
1 day ago
[-]
Looks promising, please let me know if you're able to add Swedish or if that's on a roadmap.
reply
pjc50
1 day ago
[-]
For some reason, probably my corporate firewall, this is blocked by certificate errors for me.
reply
ph4evers
1 day ago
[-]
Probably YouTube is blocked by the corporate firewall. Or my whole domain?
reply
Aromasin
1 day ago
[-]
Mines' the same. My local firewall blocked the site when the YouTube embbed tried to play, and when I switched to my work VPN it blocked the domain altogether.
reply
pjc50
1 day ago
[-]
Youtube itself is fine. It's not a domain block but "certificate issuer unrecognized". Palo Alto Networks?
reply
scrollop
1 day ago
[-]
This is very good, thank you.
reply
initialg
1 day ago
[-]
i'm loving it! added it to my daily tasks now!
reply
kstenerud
1 day ago
[-]
Looks cool! Unfortunately, the buttons are unresponsive on Firefox :/
reply
tifik
1 day ago
[-]
The signup confirmation email has awstrack.me tracking in it :(
reply
ph4evers
1 day ago
[-]
Oh I thought I disabled that. Sorry about it. I'll remove it.
reply
facile3232
1 day ago
[-]
Will give it a shot if you add Mandarin/simplified or swahili.
reply
nathell
1 day ago
[-]
I’ve been learning Spanish on Duolingo. It has brought me from zero to scoring 96% on this test – I didn’t realise I was so advanced!

I love the concept and the execution. This is a rare instance of a Show HN that I not just admire, but can easily see myself using regularly and paying for.

Please, please monetise this in such a way as to avoid enshittification.

reply
ph4evers
1 day ago
[-]
Thank you! Right now it is not costing me a lot of money. So hopefully if I provide enough value and a decent price it can be a sustainable project!
reply
a_c
1 day ago
[-]
I'm getting "Failed to load video player"
reply
stuaxo
1 day ago
[-]
It's a shame the news is so depressing.
reply
bomewish
12 hours ago
[-]
Initial reactions.

1) Let us keep the right sidebar permanently out, and DON'T grey out the rest of the screen. I want to be able to click on target language words and immediately see them. Like, you've given us the translated sentence, but I can't see which word is which;

2) Colour _the same words_ in both languages when doing mouseover;

3) Or just highlight BOTH as we're listening [but note issue below!];

4) Make the keyboard use a bit more intuitive - i.e. left/right obviously means "go back or forward in the video/audio", but now I have to CLICK on the yt video again to get that behavior. It should be auto so I don't have to do that. Similarly, I want to click on a word to know it's meaning, but then go back to space->pause behavior. Rn clicking a word breaks that. Just adds friction to users.

5) Consider yt-dlp to save the videos so if we are studying one, and yt pulls it, we can keep using. Maybe for the roadmap.

6) Consider allowing us to add words to vocab -- and which vocab -- directly from mouseover [without clogging up UI - not sure there]. Right now it's a bit convoluted [right sidebar, which again should be permanent and integrated, not greying out the main screen - but even if that was fixed, that's a lot of mouse movement]

6) Handle idiomatic language issues better. You'll probably need another LLM pass/method for this, but IT'S a BIG ONE! Languages don't map 1:1 obviously, so for example this one:

https://app.fluentsubs.com/stream?v=cm8mnqrqe084ervb0mi6a4sa...

"genommen" was translated as "taken" <- means nothing.

I dump into 4o and it explains

In the phrase „genau genommen“, the word „genommen“ is part of a fixed idiomatic expression and doesn't translate literally as "taken."

„Genau genommen“ means "strictly speaking" or "to be precise."

So the full sentence:

„Wir sind heute wieder auf der Straße unterwegs, genau genommen auf dem Flohmarkt…“

translates to:

"Today we're out on the street again — strictly speaking, at the flea market…"

It’s specifying or narrowing down what “on the street” means in this context.

**

So you'll need to pull out these idiomatic phrases and then make sure they can be analysed as a single unit, so to speak. Learners are gonna have to be acquainted with those, and now the workflow is obviously broken.

Basically just get a model to bundle them and then in the sidebar on the right that has like "drill into X" you've got the PHRASE as a unit of analysis.

reply
IdontKnowRust
1 day ago
[-]
Is this in some way related to youglish?
reply
_qua
1 day ago
[-]
This is a great idea. Nice job!
reply
madduci
1 day ago
[-]
Amazing, this is really awesome
reply
flyinglizard
1 day ago
[-]
Looks real nice. I'll be using it. If you could map spacebar to pause/unpause the video by default (without focusing on the YouTube window first) that would be great.
reply
preciousoo
22 hours ago
[-]
This is nice!
reply
MichaelGlass
1 day ago
[-]
love it! Just wanted to share my support.
reply
anon1094
1 day ago
[-]
I tried the japanese version. I like that you are using real Japanese language YouTube videos. You can see the kanji on the videos though so it kind of defeated the point. Hide the video? Great idea though and very fun too.
reply
ph4evers
1 day ago
[-]
Thanks for trying! You can hide the video by clicking the video button.
reply
dionian
1 day ago
[-]
I absolutely love this - one thought, clicking the words should auto drop them into the first open spot.
reply
readthenotes1
1 day ago
[-]
Apparently I need to sign in to protect the community or s/t

So there was no way to play the video.

Also that blinding flash of white when it starts is unnecessary cruelty

reply
ph4evers
1 day ago
[-]
Aj, sorry about that. I think it is YouTube blocking you. I didn't think of that edge case yet so I think my app will keep trying to play the video. Thanks for the report.
reply
littlekey
1 day ago
[-]
I tried the Polish and it told me sorry, no news today. ¯\_(ツ)_/¯
reply
iamkonstantin
1 day ago
[-]
Did you hand-pick the videos? My first one was some Elon Musk conspiracy dumpster and the second one some church “morality” thing… I think it’s a good example of what not to do with LLMs.

Also, your page needs to disclose any content filtered by or generated by a model.

reply
ph4evers
1 day ago
[-]
No I let the LLM filter on "non-war and non-politics" but I don't have a ton of content available (yet) so it might picked something that was not great. Which language did you try?
reply
dataengineer56
1 day ago
[-]
The English icon has the Union Jack flag rather than the US flag, so it automatically elevates the service above Duolingo for me.
reply
pjc50
1 day ago
[-]
English (Traditional) vs English (Simplified)
reply
elric
1 day ago
[-]
That meme is such a load of hogwash. In many ways, US English is closer to "traditional" than UK English. They've both diverged somewhat from what they were in the 17th century. Neither form has been "simplified" in any way.

As for the Union Jack: the UK has at least 3 rather different languages (English, Gaelic, Welsh), possibly a few more depending on how you count the different kinds of Gaelic.

Using a country flag to represent a language has always struck me as being silly. Only rarely do they map 1-to-1.

reply
pjc50
1 day ago
[-]
It's entirely a joke based on the two different versions of "Chinese" offered on most websites, it's not really meant to be taken seriously. But I've heard that there's an island in New England somewhere whose local accent is closest to Elizabethan English.
reply
npongratz
1 day ago
[-]
Tangier Island off of Virginia, in the Chesapeake:

https://www.bbc.com/travel/article/20180206-the-tiny-us-isla...

Also, for what it's worth:

> Some people have characterised Tangier’s way of speaking as ‘Elizabethan’ or ‘Restoration’ English, but that’s nonsense. Languages aren’t static and the Tangier dialect has changed a lot because of its isolation. It’s a distinct creation of its own," Shores said.

reply
csh0
1 day ago
[-]
Perhaps you’re thinking of Ocracoke, North Carolina[0]

[0]https://www.bbc.com/travel/article/20190623-the-us-island-th...

reply
watwut
1 day ago
[-]
Yeah, but there is a real difference between simplified and traditional Chinese characters. Traditional are more ornamental/complicated while simplified are ... simplified/minimalist .
reply
BalinKing
1 day ago
[-]
Honest question, what's the meaning behind this joke? Is it just referencing the fact that American English drops "u" in the spelling of e.g. "color"?
reply
pjc50
1 day ago
[-]
It's primarily a reference to various language selection dropdowns offering "Chinese (Traditional)" (which is used in Taiwan) and "Chinese (Simplified)" (which is used on the Chinese mainland). That difference arises from Mao-era simplification of many of the most common hanzi characters to make them easier to write or distinguish.

Mixed with, yes, the variant spellings and word choices (e.g. chips/crisps/biscuits) that make it apparent to British English readers when something is American.

reply
BalinKing
1 day ago
[-]
I think my confusion is more from the implication that variant spellings imply "simplification"—even at a glance, simplified and traditional hanzi differ greatly in complexity, whereas I don't see how "chips" is any simpler than "crisps", even as a joke....

EDIT: Of course, it doesn’t matter one bit in the grand scheme of things—feel free to ignore my pedantry over a silly joke :-)

reply
JimDabell
1 day ago
[-]
This really isn’t a positive point. Flags represent nations, not languages, and it can be quite offensive to equate the two.

To use your example, there are plenty of Irish people who speak English but would resent being forced to identify with the Union Flag.

For another example that is very relevant today, there are plenty of Russian-speaking Ukrainians who hate Russia. Using the Russian flag to represent them would at best be distasteful.

reply
coldpie
1 day ago
[-]
That's actually a really good point that seems obvious, but I hadn't considered before. I wonder what a better solution is. ISO language codes[1], I guess?

[1] https://en.wikipedia.org/wiki/List_of_ISO_639_language_codes

reply
nkrisc
1 day ago
[-]
That’s the problem with conflating nations and language.

For example, the very first English video I got was a South African English accent.

reply
dotancohen
1 day ago
[-]
It works to a first approximation.

Of the five languages I have configured in KDE, three of them are country-specific. So I use the flag indicator, which is far quicker for me to locate and identify out of the corner of my eye than would be a text label (which would require using the retina and thus more time and attention).

reply
nkrisc
18 hours ago
[-]
Sure, fine for personal uses. I mean broadly and generally.

As for English, the United States has far and away the largest number of native English speakers.

Not that I think the stars and stripes has any more right to represent “English” as a concept any more than the Union Jack. If you’re going on origin, why not the flag of England instead?

reply
dotancohen
11 hours ago
[-]

  > If you’re going on origin, why not the flag of England instead?
I actually really like that idea. The US and UK flags seem to represent more culture than language.
reply
hoseyor
1 day ago
[-]
Rather ironic, considering that it’s a flag to indicate personal union of ownership of subjects and lands by the Scottish king who inherited the subjects and lands of England, but you prefer it to be the icon for the language of the state of England, a country in which its own language is more or less indecipherable in many places due to accents, dialects, and degeneration and creolization.

You would be far more likely to understand any given English speaking person in the USA than in England. It should really be called American at this point.

reply
mavus
1 day ago
[-]
> accents, dialects, and degeneration and creolization. There are just as many accents and dialects of English in the Americas as there are in Britain. Even your term "creolization" comes from Louisiana. It's a matter of perspective and something that all language learners will have the face, the difference between 'standard' English/Spanish/German and regional variations both within it's originating country and from abroad.
reply
latexr
1 day ago
[-]
Clearly I’m in the minority, but I found the idea awful. The execution on the exercises is good—I especially like that you mix similarly sounding words—but my first thought as soon as I read your description was that the news are a terrible, worrying choice which could be misused to push a specific agenda on learners. Lo and behold, first thing I try is Musk’s dad calling people bums. Learners shouldn’t be subjected to polarised opinions at the same time they are trying to internalise words. Use instead some neutral science channels like Veritasium, CGP Grey, or Vsauce.
reply
ph4evers
1 day ago
[-]
I agree that channels should be checked more carefully. I initially added two news channels per language. But some of those are pretty horrible (like Skynews). I'll put some more time in adjusting the channels. For example, TF1 is really great for French. It can be colored but it has many non-political or more local items.

I picked news channels because they often have short well spoken videos.

reply
pjc50
1 day ago
[-]
This is probably better even if you just select non-US news channels showing non-US news items. NHK 24 kind of thing.
reply