Preliminary Research and Documentation

The following research and documentation is meant to get this project started. Please consider this a work in progress. Significant work is needed to move this project forward.

 

Specifications

The following sections describe the specifications for Whole Home Voice Control system.

 

Speech Recognition Platform 

There are multiple speech recognition platforms that are currently in use in the home automation industry. Some of them need a cellular phone to recognize voice commands commands. This project aims at using standalone devices that can recognize and interpret voice commands and execute a given task.

Speech recognition devices are installed at strategic locations in the SeaPod that can recognize voice commands. 

identify residents and validate their authenticity. AI and ML track actions, movements and gestures. Once authenticated, the cameras look for specific actions and gestures to execute commands.

The cameras are installed at specific locations and the software controls the specific action in that area. For example, a cameradevice installed aboveat the main entrance can authenticate a dooruser canby controlspeech actionsrecognition ofand that door. A camera installed inopen the shower controls the water flowdoor and temperaturelight only. a lamp automatically. 

 

InputHardware GesturesPlatforms

TheRaspberry softwarePi applicationand hasArduino defaultare gesturesused built-in most home automation solution. A number of OpenSource code bases and hardware configurations, exist today that an be researched, designed and implemented for basic functions.  Residents can change the defaults and add their own customized gestures and define the output. SeaPods.

 

Default GesturesTasks

The following is a basic gestureslist areof builttasks in tothat the system:Whole Home Voice Control must accomplish

Lights

• WaveAuthentication - to turn on or turn off home gesture control system
• Index finger pointed up - Turn on lights
• Index finger pointed down - Turn off lights
• Fist to spread all fingers apart - increase brightness of light
• All fingers apart to fist - decrease brightness of light.

 

Door and Windows

• Wave - to turn on or turn off home gesture control system.
• Spread hands apart - Open window or door.
• Bring hands together - Close window or door.

 

Lock and unlock

This feature is enabledimportant onlyfor whensafety and security of the residents. This will allow the resident isto insidelock or unlock the seapod.main Touchingentrance of the thumbSeaPod

Lighting - This feature controls the lighting, brightness of the room and indexmood lockslighting.

 Curtains or Blinds - Motorized curtains or blinds are controlled by voice commands.

Coffee Machine - Voice command to brew a doorcup of coffee or tea

Entertainment - Voice commands to switch on a TV or a window.projector, Thechoose oppositea actionchannel unlocksand adjust the doorvolume.

or

Water window.

-

 

Voice

Emergency and SOS

For emergencies and SOS at seapods, all cameras are actively looking for the international symbol of distress. 

Figure 1- International gesture signal for emergency and SOS.

 

Contributors can brainstorm and arrive at various other gestures that a resident can usecommand to control thetemperature functioningand flow of thewater seapodin switchesa shower, kitchen, and appliances.

toilet flush.

Pumps - Voice command to switch on or switch off the water pump.

 

Licensing

This project is being developed as an open-source project with the following licensing: