Close

Sophie can now read!

A project log for Home Robot Named Sophie

A next generation home robot with a omni directional drive unit and 6 axis collaborative robot arm

apollo-timbersApollo Timbers 01/05/2024 at 13:420 Comments

I had a reading module I made long ago, it worked but only with hard coded path images.  Now that the ZED is all set up, I have the reading module boot up zed_snap.py and then get the image path of the image taken. Pytesseract a optical character recognition (OCR) tool then attempts to read what is in the image. It does indeed work the robot can now read stuff put in front of it.  It will need so fine tuning, like maybe the ability to scale the image up, stabilize and also just block just the text/book page removing any background noise. Goal is a kid can hold up a book and it can read to them...

*Forgot to mention it has no understanding of what it is reading it is just reading what it can find in the image...but still!

The reading module and zed snap python programs can be found here- https://github.com/thedocdoc/Sophie/tree/main

Positives:

Negatives:

Discussions