Preliminary Research and Documentation

The following research and documentation is meant to get this project started. Please consider this a work in progress. Significant work is needed to move this project forward.

 

Software Specifications

The following sections describe the specifications for Whole Home GestureVoice Control system.

 

ComputerSpeech vision Recognition Platform 

CamerasThere placedare multiple speech recognition platforms that are currently in use in the home automation industry. Some of them need a cellular phone to recognize voice commands 

Speech recognition devices are installed at strategic locations in the seapodSeaPod that can recognize voice commands. 

identify residents and validate their authenticity. AI and ML track actions, movements and gestures. Once authenticated, the cameras look for specific actions and gestures to execute commands.

The cameras are installed at specific locations and the software controls the specific action in that area. For example, a camera installed above a door can control actions of that door. A camera installed in the shower controls the water flow and temperature only.  

 

Input Gestures

The software application has default gestures built-in for basic functions.  Residents can change the defaults and add their own customized gestures and define the output. 

 

Default Gestures

The following basic gestures are built in to the system:

Lights

• Wave - to turn on or turn off home gesture control system
• Index finger pointed up - Turn on lights
• Index finger pointed down - Turn off lights
• Fist to spread all fingers apart - increase brightness of light
• All fingers apart to fist - decrease brightness of light.

 

Door and Windows

• Wave - to turn on or turn off home gesture control system.
• Spread hands apart - Open window or door.
• Bring hands together - Close window or door.

 

Lock and unlock

This feature is enabled only when the resident is inside the seapod. Touching the thumb and index locks a door or a window. The opposite action unlocks the door or window.

 

Emergency and SOS

For emergencies and SOS at seapods, all cameras are actively looking for the international symbol of distress. 

Figure 1- International gesture signal for emergency and SOS.

 

Contributors can brainstorm and arrive at various other gestures that a resident can use to control the functioning of the seapod switches and appliances.

 

Licensing

This project is being developed as an open-source project with the following licensing: