Design of Smart Super Market Assistance For The Visually Impaired People Using Yolo Algorithm

Abstract

Among the population of India, nearly 1.6 million children are blind or visually impaired by birth. The challenges faced by the visually impaired persons are high in day-to-day life. There are number of challenges faced by them like requiring guidance for the usage of public transport, to walk independently. One of the most common problems is the dependency on others for the purchase of household items. Hence, a unique solution is required which makes the people to identify and purchase the products in the supermarket without dependency. This research focuses on a portable camera-based assistance that helps them to identify the grocery items along with the framework to read the text on the labels. This experimental system consists of three modules: object detection and classification; reading the text from the label; text to audio converter. The input to the camera is fed by the Raspberry Pi kit. The captured video is segregated as pictures of the grocery items. The proposed deep learning algorithm for the detection of object is You only look once (YOLO). The accuracy of the detection is pre-dominantly high compared to the existing algorithms. The captured image of the grocery item label is preprocessed to blur the unwanted text. Optical character recognition (OCR) is applied over the label to convert as the text where machine can read. At last, the processed text is converted as audio for the guidance of the people. Thus, a flexible supervisory mechanism with user-friendliness is developed for helping the visually impaired people. © 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.