Preliminary Research and Documentation
The following research and documentation is meant to get this project started. Please consider this a work in progress. Significant work is needed to move this project forward.
Software Specifications
The following sections describe the specifications for Home Gesture Control system.
Computer vision
Cameras placed at strategic locations in the seapod identify residents and validate their authenticity. AI and ML track actions, movements and gestures. Once authenticated, the cameras look for specific actions and gestures to execute commands.
The cameras are installed at specific locations and the software controls the specific action in that area. For example, a camera installed above a door can control actions of that door. A camera installed in the shower controls the water flow and temperature only.
Input Gestures
The software application has default gestures built-in for basic functions. Residents can change the defaults and add their own customized gestures and define the output.
Default Gestures
The following basic gestures are built in to the system:
Lights
- Wave - to turn on or turn off home gesture control system
- Index finger pointed up - Turn on lights
- Index finger pointed down - Turn off lights
- Fist to spread all fingers apart - increase brightness of light
- All fingers apart to fist - decrease brightness of light.
Door and Windows
- Wave - to turn on or turn off home gesture control system.
- Spread hands apart - Open window or door.
- Bring hands together - Close window or door.
Lock and unlock
This feature is enabled only when the resident is inside the seapod. Touching the thumb and index locks a door or a window. The opposite action unlocks the door or window.
Emergency and SOS
For emergencies and SOS at seapods, all cameras are actively looking for the international symbol of distress.
Figure 1- International gesture signal for emergency and SOS.
Contributors can brainstorm and arrive at various other gestures that a resident can use to control the functioning of the seapod switches and appliances.