Mission Data| Quiet Planet

Quiet Planet

The COVID-19 outbreak and the resulting social distancing recommendations and related restrictions have led to numerous short-term changes in economic and social activity around the world, all of which may have impacts on our environment. Your challenge is to use space-based data to document the local to global environmental changes caused by COVID-19 and the associated societal responses.

Mission Data

Summary

Integrating environment data from NASA , ESA, JAXA, CSA and CNES into Azure Data Lake

How I Addressed This Challenge

Project Mission Data identified after researching existing resources that there is a major need to integrate data from various space agencies across the globe. The solution architecture developed  addressing the challenge can be invaluable in integrating image data from NASA, ESA, JAXA, CNES and CSA into a single repository like Data Lake and maintaining the data flow.  The data from this data lake can further be used for downstream analytics and answering critical questions such as related to Quiet Planet challenge for Covid-19 and also any future environmental situations due to a pandemic.   

How I Developed This Project

The opportunity to integrate environment data from various Space Agencies across the globe and deliver insight from this environment data inspired me to choose this challenge.

The project has been developed as follows:

· Microsoft Azure portal was considered and created resource group MissiondataCovid19 and added Azure Data Factory and Azure Databricks as resources and added the ARM template to Azure DevOps.

· Azure DevOps to define the problem statement, challenge, description, and considerations, wiki page and two Azure Git repositories.

· Power point slide to isolate out the problem statement, challenge, description, and considerations and develop a Solution Architecture for Mission Data project.

· Substantial amount of time invested in analysing the data sources such as NASA Earth Data (all NASA sites added to Azure DevOps Wiki as reference), Copernicus site, Sentinel Hub, EO Browser app from Sentinel Hub. API json file from Sentinel OGC services analysed and added to DevOps. Open API yaml file analysed and added to DevOps.

· Added configuration utility in Sentinel hub for data sources from NASA, JAXA and ESA.

· Major problem was around getting data from the data sources

· Identified that there is a need to define and develop an end to end Solution which could be further referred to develop a Data solution to this major problem.

· Achieved an end to end Solution Architecture which can now be used as the building block of integrating the environments data from various Space Agencies.

Project Demo

Please refer my following one drive link for Mission Data Solution Architecture and ppt presentation- 

https://1drv.ms/p/s!AtI8daTxyDHCp03dactDxPcl_bn3?e=yq8jt0 

Please refer my following one drive link for Mission Data project screenshots- 

https://1drv.ms/w/s!AtI8daTxyDHCp05kNXq0zT4gQGFR?e=ul64QC 

Below is the Azure DevOps link for the Mission data project 

https://dev.azure.com/achakrabarty0297/Mission%20Data 

Below is the Azure portal link for development of the Data solution- 

https://portal.azure.com/#@achakrabartyhotmail.onmicrosoft.com/resource/subscriptions/3ffddca7-9e5b-432a-bc71-6e4fb28649fe/resourceGroups/MissionDataCovid19/overview 



Data & Resources
  1. https://www.sentinel-hub.com/spaceapps-data/#nasa
  2. https://docs.microsoft.com/en-us/azure/storage/blobs/storage-upload-process-images?tabs=dotnet
  3. Sentinel API- https://docs.sentinel-hub.com/api/latest/#/API/
  4. https://apps.sentinel-hub.com/eo-browser/?lat=69.63&lng=-79.49&zoom=6
  5. https://www.sentinel-hub.com/spaceapps-data/#esa
  6. https://apps.sentinel-hub.com/dashboard/#/configurations
  7. NASA Environment Data- https://earthdata.nasa.gov/
  8.  NASA Global Imagery - https://earthdata.nasa.gov/eosdis/science-system-description/eosdis-components/gibs
  9. GIBS API for Developers - https://wiki.earthdata.nasa.gov/display/GIBS/GIBS+API+for+Developers
  10. NASA Earth Observations -https://neo.sci.gsfc.nasa.gov/
  11. NEO Service endpoints -https://neo.sci.gsfc.nasa.gov/about/wms.php
  12. NEO world view- https://worldview.earthdata.nasa.gov/
  13. NASA Giovanni - https://giovanni.gsfc.nasa.gov/giovanni/
  14. NASA LANCE- https://earthdata.nasa.gov/earth-observation-data/near-real-time
  15. NASA Earth Observatory- https://earthobservatory.nasa.gov/
  16. NASA Earth Data Search- https://search.earthdata.nasa.gov/search
  17. NASA Earth Science Metadata repository- https://cmr.earthdata.nasa.gov/search
Tags
#Data #Analytics #Microsoft #SolutionArchitecture #EndtoEndSolution #DataSolution #CloudSolution
Global Judging
This project was submitted for consideration during the Space Apps Global Judging process.