Close
0%
0%

Omnidireccional Robot controlled by Amazon

The purpose of this project is to create a robot car with ominidirectional step motor wheels, and replace one of humans by a Robot

Similar projects worth following
With the introduction of the National Common Curricular Base (BNCC) several discussions have taken place in order to identify what is the best way to effect the inclusion of Computer Science fundamentals, specifically related to Computational Thinking (PC),in basic education. During the last twelve years, a technology for the development of PC skills in undergraduate courses has been developed and improved, called Furbot, which four years ago became a game and was successfully applied in Elementary School I in state public schools in the Blumenau region. Thus, the game Furbot, developed in Unity 2D, aims for the player to leave a point of origin and reach a point of destination by guiding a robot along a path and dodging obstacles using programming commands.

The idea is to replace the virtual by a real Robot and make the movement using infrared, card images (Amazon Rekognizer), and voice (Amazon Alexa)

Replacing a human :) and make the kids happy!

The purpose of this project is to create a robot car with ominidirectional step motor wheels, and replace one of humans by a Robot in this large game board developted in the FURB, Blumenau´s University, Brazil. The control will be using infrared and the most importante, Voice and Image Rekognizer, both services of Amazon.

The first try was to try the  robot found in Aliexpress with omnidireccional dc motor wheels, but we got problems with torque at low speed, then we have to up speed, but had problem too with innercial and many of times no precision on infrared sensor reading, because cross to fast the black marker on game board, and main problem, the dc motor whistles

look :(

Now with Step Motors :)

Tests with Step Motor

We had to:

-replace the the step motors to move the robot from one rectangule to another, having precision with the help of 6 infrared sensors and step motors

-replace the Arduino Uno by a Arduino Mega ARM to get more GPIOS to control the 4 step motors and make the reading of 6 infrared sensors 

-build a 3D support to motor on chassis and axis converter to connect the step motors to the wheel

-build a prototype of a square using the insulating tape on the table to make tests with  step motor wheels, to test speed and torque. We used 5V step motor model 28byj.

After the assembly of step motors and sensors:

The commands to the robot can to be sent in various ways: 

- remote control (IRDA)

-voice commands from the Alexa assistance (Alexa "Echo" on ESP32 LyRat)

- ESP32CAM connected  Amazon Recognizer  (to detecting text on original instructions Cards) and also via socket from PC after get streaming image of gamed board and processing it.

"Alexa, my little Robot" 

Then

"Robot, move to west"

"Robot, move to east"

"Robot, move to north"

"Robot, move to south

and instructions cards

Cards movements that the robot detects (Amazon Rekognizer)

"move South"

'"move West"

"move east"

"move north"

Proximidy Card Detect, infrared transmitter and ESP32 CAM

Updates of prototype:

Hardware

-build a new chassis that use the aliexpress original and defines the news holes positions and support to Arduino Mega, ESP32 CAM,  sensors support and step motors and finally the Lyra T Amazon "ECHO"

-replace the Arduino Mega ARM by a Arduino Mega 2560

-add more 2 infrared sensors to get more precision in all movements, because sometimes the robot skids a bit and need to make adjust on stop position

Software

-ESP32CAM Software access to AMAZON AWS IoT Core,  AMAZON Rekognizer, Infrared and finally communications with Arduino Mega 2560

-LyRa T ESP32 Software (similar to Alexa Echo)

Wheels

Last update before Add the Lyra T and speakers on Robot and make finally the Chassis and Battery charger

This is what the robot see :)

See more

Amazon "OCR"

Alexa....

And wear the Robot :)

main.rar

This file is the Alexa example of Espressif, using the ESP-ADF libraries, used on Lyra T starter kit. Just compile to Lyra T, no changes from the original. https://github.com/espressif/esp-adf Here some discussion about portuguese port https://github.com/espressif/esp-va-sdk/issues/65

RAR Archive - 4.92 kB - 04/21/2023 at 13:23

Download

hackaday.py

This is the Lambda Python example que invoke the Amazon Text Rekognizer service. Who call this event ? The AWS IoT when receive a JPG image from ESP32 WEBCAM :) Works together with AWS IoT core ACT RULES https://www.youtube.com/watch?v=IkR2g0fJ94o

x-python - 3.68 kB - 04/21/2023 at 13:22

Download

hackaday.js

This is the Lambda Javascript example that talks with Amazon Alexa and make communication with AWS IoT, where the ESP32 WEBCAM is connected. Who call this event ? The AWS IoT when receive a JPG image from ESP32 WEBCAM :)

javascript - 8.93 kB - 04/21/2023 at 13:21

Download

SCH_hackday.schdoc_2023-04-10.json

This this the first Schematic version of Shield to the Arduino ATMEGA. Newer version will be draw in the robot Chassis. It´s on EasyEda format. easyeda.com

JavaScript Object Notation (JSON) - 66.89 kB - 04/21/2023 at 13:20

Download

hackaday.pcbdoc

This is the first PCB version of Shield to the Arduino ATMEGA. Newer version will be draw in the robot Chassis. It´s on EasyEda format. easyeda.com

pcbdoc - 780.81 kB - 04/21/2023 at 13:19

Download

View all 10 files

  • 1 × Arduino ATMEGA2560 This component will have the main function of read the 6 sensors and make the moviment controlling the 3 step motors. It will receive the commans from the ESP32 CAM, using a infrared receiver.
  • 1 × ESP32 CAM This component will have the main function to connect to AWS and send the JPG image got from the game card. It will to subscribe to AWS IoT core. After the image been processed on Amazon or got a Alexa command invoke, will transmite by infrared the command do ATMEGA 2560.
  • 1 × 28BYJ-48 + DRIVER This component will drive the Step motor.
  • 1 × KY-022 This component (on ATMEGA) will receive the INFRARED command send by ESP32 CAM
  • 1 × Ky-005 This componente (on ESP32 CAM) will transmit an infrared command to ATMEGA

View all 7 components

  • to do

    Miguel Wisintainer04/21/2023 at 13:33 0 comments

    Make new  Chassis to replace the original

    Update the Arduino MEGA shield to accept 8 infrared sensors

    Rebuild the Wheel Support

    Add infrared extensor to different square boards

    Add a Skin to the Robot with head movement :)

    Add Lyrat support + Lyrat Speakers

    Review Arduino Code

View project log

Enjoy this project?

Share

Discussions

Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates