-
-
-
ReadLens spots readable text by itself and puts a "Page detected" button right under the page. One thumb tap reads it.
-
The same page, rewritten in your own reading profile: bigger letters, wider spacing, colored syllables. Pages turn like a book.
-
Focus mode shows one sentence at a time. A thumb swipe moves to the next one, so both hands can stay on the book.
-
Every reader is different: three fonts, size, spacing and colors, with a live preview and a contrast check.
Inspiration
About 1 child in 14 has dyslexia: a 2022 meta-analysis of 58 studies found it in 7.1% of primary school children, with the same rate across writing systems. That is two children in a typical classroom.
For those children, a school page can feel like a wall: letters crowd together, b turns into d, lines slide into each other. Research shows that wider letter spacing alone cuts reading errors for dyslexic children, and every reader has their own comfortable font, size and colors.
This project started at home. My wife has been a primary school teacher for 24 years, and she has taught many children with these difficulties. She uses tools that reprint a document with different spacing, colors and contrast, and she has seen what a difference they make.
When I saw my son taking part in this hackathon, I discovered the headset through him, and I thought of her pupils straight away. I did the research on my side, on dyslexia and on what actually helps, and asked him to help me with the development.
The help exists, but it depends on someone else. Those tools are still rare, and hardly known outside the classrooms that use them. An adapted page means a teacher who knows them, has the time, and reprints each worksheet. Many teachers cannot do that for every child, every subject, every day. And nobody reprints the library book, the textbook or the note on the board. So the same child can be supported in one class and left alone in the next.
We wanted to put that adaptation in the child's own hands: the real page changes, for any page, without waiting for anyone to prepare it.
Why not just read it aloud? Smart glasses, Meta's included, can already read a text out loud. That helps to get through a page, but it does not solve learning: a child who only listens is not practicing reading. ReadLens keeps the child reading, with their own eyes, on a page they can finally manage.
What it does
ReadLens is a mixed-reality reading aid for Meta Quest 3 and 3S.
- It finds the text for you. Hold up a page in passthrough. ReadLens looks about once per second, and when it sees readable text, a "Page detected" button appears right under it.
- One thumb tap reads it. Tap your thumb on your index finger, or touch the button. Both hands can stay on the book.
- The page comes back in your own style. The same text reappears in a floating window with your reading profile: three fonts (OpenDyslexic, Atkinson Hyperlegible, a classic one), size, letter, word and line spacing, page and text colors, coloring by syllables (English and French), words or lines, and b / d / p / q highlighted.
- Pages turn like a book. Each capture is a page. Swipe your thumb right for the next one, left for the previous one. Pages are kept for the next session.
- Focus mode shows one large sentence at a time.
- Find your comfort. The first launch asks four simple "this one or that one?" questions on the same sentence. Four taps build the profile. Everything stays editable in Settings, with a live preview and a contrast check that warns when colors get hard to read.
It also reads handwriting, and you can frame part of a page with both hands to capture only that part.
How we built it
Unity 6 with Meta XR Core SDK, Interaction SDK and MR Utility Kit (v209), OpenXR.
- Seeing the page: frames from the Passthrough Camera API are read back asynchronously and sent to Google ML Kit text recognition, running on the headset through a small Java plugin. No cloud, no network permission at all.
- Placing the button: OCR line boxes are projected back into the room with the camera pose of that frame, so the button sits under the real text.
- Rewriting the page: OCR lines are reflowed into paragraphs, then rendered by a pure C# engine (syllable splitter, rich-text formatter, sentence splitter, contrast math) covered by 26 automated tests.
- Sharp text: the window is drawn as a compositor layer with supersampling, at a steady 90 Hz.
- Hands only: Interaction SDK poke and ray on every control, thumb microgestures for tap and swipe, a grab bar to move the window.
Challenges we ran into
- Small text is hard to read in a headset. Moving the window to a compositor layer and raising the render scale made the difference.
- OCR returns loose lines. Turning them back into paragraphs, with hyphenated words rejoined, took several passes.
- Capturing while holding a book: pressing a button is impractical with full hands. Automatic detection plus a thumb tap solved it.
- The thumb swipe also triggered the default snap-turn of the interaction rig, so the room rotated. We disabled locomotion.
Accomplishments that we're proud of
Accessibility is the product, not a setting, and it no longer depends on who prepared the page. Setting it up needs no reading: you compare two versions and pick one. All presets pass the WCAG 4.5:1 contrast ratio. Camera frames are processed in memory on the headset and never stored or sent; only the reading profile and the captured text are saved, locally.
What we learned
The best interaction is the one you do not have to look for. The first version had a Capture button; testers holding a page never found a free hand for it. Letting the app notice the page changed everything.
We also learned to be careful with claims. The research supports wider spacing; it does not show that any special font helps every reader. So ReadLens offers choices and lets each child decide.
What's next
Laying the adapted text directly over the paper, reading aloud with word highlighting, more languages, and trials with families and speech therapists.
Sources
- Yang et al., Prevalence of Developmental Dyslexia in Primary School Children: A Systematic Review and Meta-Analysis, Brain Sciences, 2022.
- Zorzi et al., Extra-large letter spacing improves reading in dyslexia, PNAS, 2012.