Covid19 Thermal Mapping | Where There’s a Link, There’s a Way

Where There’s a Link, There’s a Way

Since the COVID-19 pandemic began, there has been a proliferation of websites and portals developed to share resources about the topic. Your challenge is to find innovative ways to present and analyze integrated, real-time information about the environmental factors affecting the spread of COVID-19.

Covid19 Thermal Mapping

Summary

It is an IOT Wearable device (Sunglasses alike) integrated with thermal Cam lens, Linked wirelessly with an android mobile app at the back-end. The Sunglasses streams real time thermal images for the surrounding human (Objects) to the backend mobile app, which in return processes these frames based on NASA data resources, I.e Body temperature exceeding normal Threshold, to trigger an alarm for suspicious infection with Corona Virus (Covid19).

How We Addressed This Challenge

Covid19 Real Time Thermal Mapping project consists of two parts (Hardware & Software)

  • Hardware:

3D printed glasses with integrated Thermal lens cam attached to wifi module and battery, all fit in the glasses' arm, which make the glasses user friendly easy accessible to be acquired by anyone. 

  • Software:

The glasses is linked with back-end android mobile app, where all the processing is done on the thermal image stream received from the glasses' IR Thermal CAM via the WIFI module.

Sample of processing handled by the mobile app is:

  •  To process the image pixels saturation for the thermal image received, so as to trigger an alarm for possibility of infection with Coronoa virus (Covid19) if the saturation is too high, meaning that the Object (Human object) temperature is higher than the normal threshold and suffering a fever (one of Covid19 symptoms).
  • To train the processed images to detect Human object by the help of use of machine learning and label each human with his/her measure thermal body temperature.
  • To use Weather API (offered by Space Challenge resources) to detect the time zone and the current weather status (either sunny day time or night time) to help avoid any external parameters might cause false positive results on the recorded thermal images stream.
  • Finally after recording suspicious case infected with Corona virus (Covid19) based on his/her body temperature, the app triggers an alarm labeling that the passing human suffers high temperature over threshold (stated as fever) as mentioned in FDA (Symptoms Signs).

 the mobile user should keep away to avoid infection and take all possible precautions stated by Centers for Diseases Control and Prevention CDC (https://www.cdc.gov/coronavirus/2019-ncov/symptoms-testing/symptoms.html). Alternately the app will upload the captured data (Geo-location and time stamp for the suspected infection case) via online cloud hosted database for real time mapping.

How We Developed This Project

The project idea is not new, it already exists and used in the Chinese police officer helmet to easily monitor walking humans and detect anyone with sever high temperature (Covid19 symptom). ‌The main difference leveraged in our idea that it is more user friendly and compact in size, so as anyone can put it on and easily detect in real time infection suspected humans around.

The practical benefits for this device work on two scopes (Individual and Community)

Individual Scope:

The device owner can easily monitor passing by passengers and help avoid dealing with infected persons after warned by the alarm triggered from his mobile app.

Community Scope:

Imagine house blocks where there is 200 citizen population and there are 5 users wearing our Real Time Thermal Mapping device passing and monitoring nearly 40 persons per day; thus, easily you can drew thermal map for all citizens residing in that block in less than a week and managed to help your government with this civilian survey, which will be added to their database for easier counting and bounding the infected cases.

Implementation Phase:

For the lack of time and materials, our team couldn't manage to get the required project components before the due date as these components should be imported from abroad.

That is why our device implementation phase wont be on time but we managed to plan the implementation process and design all the schematic phases and codes we need in order to implement our project once borders are opened and shipping is back to normal again plus we presented a demo simulation with video recorder glasses to simulate our idea (in the supporting files section 30 seconds video).

The tools and hardware modules used in our project:

Flir Lepton Thermal CAM 3.5

ESP WIFI Microcontroller 

Battery 

3D Printer 

3d Sun Glasses Design 

Google Firebase (ML KIT)

raspberry pi zero

Onion-Compute Platform IOT

Coding Part


Project Demo

Covid19 Thermal Mapping Screenshots:

https://drive.google.com/drive/folders/159BcvPaQODEBT0TdjvDo7OFCtWx40Cl2?usp=sharing

Covid19 Thermal Mapping Presentation Slides:

https://drive.google.com/file/d/1H4XZ-6jcjJv4otBN4q5vCJXNlLiQDmPw/view?usp=sharing

Covid19 Thermal Mapping Device 30 Seconds Demo Video:

https://youtu.be/I85sDZC7-UE

https://drive.google.com/file/d/12WH16B3NZT83HTT2rldQsZRQI9TgHuam/view?usp=sharing


Project Code
Data & Resources
Tags
#Real Time Thermal Mapping, #Infra Mapping, #Human Object Machine Learning, #IOT, #Sunglasses, #Wearable IOT, #CDC Symtomps Update, #Avoid Infection, #Health Precautions, #Covid19 New Normal
Global Judging
This project was submitted for consideration during the Space Apps Global Judging process.