Facial Recognition Smart Glasses For Visually Challenged Person

Abstract

Developing a tool for the visually impaired people is not a recently emerged problem. But developing a computer aided tool is a still developing area. The Smart Glasses project helps blind and visually impaired people to detect and recognize the office tools around them, which they see through a small camera, the camera is fixed on the glasses. This technique helps providing job opportunities for the blind, especially office work through a voice message sent to an earphone placed on the blind ear to help them find various items easily and independently, also saves time and efforts. Our aim is to create an intelligent system, imitating the human eye, which transfers different scenes and images to the brain. The brain in turn analyzes the images or scenes, and based on previously stored information, the surrounding objects are identified. For this purpose, we use a small device that performs similar to the human brain, called "Raspberry Pi"; It is a small device that analyzes the images and scenes with the help of the camera. This project has an in-built sensor in it which spreads ultrasonic waves in the direction the person is going by scanning at most 5-6 meters of 30º range. This new system may solve some of major problems of blind persons that are still existing. Finally, the sound of each person in the database is called, and a message is sent to tell the blind about the person in front of them.

Existing System

In this system, two cameras placed on blind persons glasses, GPS free service, and ultrasonic sensor are employed to 4 2 provide the necessary information about the surrounding environment. A dataset of objects gathered from daily scenes is created to apply the required recognition. Objects detection is used to find objects in the real world from an image of the world such as faces, bicycles, chairs, doors, or tables that are common in the scenes of a blind. The two cameras are necessary to generate the depth by creating the disparity map of the scene, GPS service is used to create groups of objects based on their locations, and the sensor is used to detect any obstacle at a medium to long distance. The descriptor of the Speeded-Up Robust Features method is optimized to perform the recognition.

Proposed System

The proposed system includes a depth camera for acquiring the depth information of the surroundings XD, an ultrasonic rangefinder consisting of an ultrasonic sensor, an embedded CPU (Central Processing Unit) board acting as main processing module, which does such operations as depth image processing, data fusion, AR rendering, guiding sound synthesis, etc., a pair of AR glasses to display the visual enhancement information and an earphone to play the guiding sound.

Architecture

BLOCK DIAGRAM