Turning video content into text with embedded translation, dictionary, and karaoke-style of narration tracing BubbleReader 

Executive summary Boredom, friction, and procrastination are usually the main barrier when studying any complex content (foreign, technical, abstract) for learning or studying purposes. The bubble reader is for anyone who needs to overcome those barriers: - from authentic materials taken from YouTube - by being able to repeat wherever they want with automatic follow-up of words - with inline words and expression translation The platform addresses 3 specifics requirement for anyone who wants to make progress in the target language they wish to learn (either language learning or technical learning): - Vocabulary learning - speaking practices (Karaoke style) - Listening practices 

Project background 

There are 3 sources of frustration when learning Japanese ZZZZzzzzzzz…. 1.Friction because of swapping between multiple Content sources and types 2.Boredom because of “ping-pong” type of dialog content creating “no hook” 3.Procrastination because there’s no “incentive” to be active 

VS A new hope is necessary 1.Friction 2.Boredom 3. Procrastination 1.Integrated content 2.Engaging content 3. Hooks the mind 

COMMUNITY CONTENT TECHNOLOGY DESIGN Bubble Reader Finding the magic trinity is the key 1. Community Content is what will keep the motivation high (fresher content all the time 2. Technology is what will make this content accessible 3. Design is what will make the user hooked 

www.bubblereader.com: 
 Overview and current state 

The platform os a web application, runnable pretty much on all OS, browsers and devices 

Current implementation: breakdown of the features 1 / 3 1. The content is YouTube embedded videos. 2. The narration from the video is synched with a “Bubble” (a rounded cursor). 3. On screen text turns from grey to white as the narration progresses. 4. Furigana for Kanjis are displayed 5. A translation is displayed inline. 1 2 3 4 5 

Current implementation: breakdown of the features 2 / 3 1 2 3 From an overlaid word: 1. Inline dictionary 2. Text to Speech to repeat the selected word 3. add the selected word to a personal word bank 

Current implementation: breakdown of the features 3 / 3 1 2 3 1. Youtube’s features such as playback spee 2. Auto-scroll on/off (screen re-center automatically when the bubble reaches a certain distance from the bottom of the screen) 3. Translation ON/OFF 

Current implementation: breakdown of the features 3 / 3 1 2 3 1. Youtube’s features such as playback spee 2. Auto-scroll on/off (screen re-center automatically when the bubble reaches a certain distance from the bottom of the screen) 3. Translation ON/OFF 

Marc-Alexandre Cartiant Lixil (Michael) He Thank you!