Best Flask open-source libraries and packages

Oculli

Occulli -Visual help for the visually impaired
Updated 4 years ago

Occuli

Visual help for the visually impaired

Description:

Identity theft is a problem that affects almost everybody, but the visually impaired is affected more by it.
Our android application aims to solve this problem by using face recognition and object detection.

What it does:

This is the general flow of our app: The visually impaired person wears the phone like an id card with the screen facing outside. Earphones are also connected to the app.

  • Detection mode:

By default, the app is in detection mode. If a known Person approaches the visually impaired person, the camera picks up the persons face and sends the person’s name as an audio message to the visually impaired person.

  • Recognition Mode:

If an unknown person approaches the visually impaired person, the visually impaired person clicks the volume down button(switches to recognition mode) and gives the phone to the unknown person who would then state his name and then the phone’s camera will scan his face and add it to the list of known faces.

  • Sentry mode:

Another important feature of this app is the object detection built into it. When the visually impaired person clicks the volume up button, the app switches to sentry mode in which this person can point to one direction and take a photo and then the app would send an audio message explaining about all the things in that direction. (ex: There are 2 persons in that direction)

Flowchart:

Flowchart

Installation:

For Sentry Mode:

First, clone the repo,
$git clone https://github.com/bnair2001/oculli.git

Then run,
$pip3 install requirements

$pip3 install torchvision

    if the above dosent work then use,
    $pip3 --no-cache-dir install torchvision

Then to run the API,
$flask run

For Detection mode and Recognition mode:

Open the android folder in this repo using android studio and build the android app.
PS: The build may take about 20 minutes

Demo video:

APK:

Drive link to apk

Credits:

Steve PaulBharath NairMatt Wang