The core component of the EO Data processing cube is an instance of Open Data Cube. A series of pre and post processing workflows that interact with the cube. Here are the key points and concepts related to your fully automated pipeline:
- Data search module: This module automatically searches for specific data on the CreoDIAS platform and specifically in the finder API. It identifies the required datasets based on certain criteria such as time range, geographical area, or specific parameters, along with the s3 paths that the data are stored.
- Pre-processing: Once the data's paths are identified, this modules performs pre-processing tasks for generating new products in Cloud-Optimized GeoTIFF format such as Backscatter VV/VH, clouds masks, resampled and re-projected opening the door to efficient cloud-based data processing and visualization.
- DataCube indexing: The COG TIFF files generated in the pre-processing step are then indexed into a DataCube. Except from the Sentinel-1 and Sentinel-2 COGs, LPIS have also be rasterized and added in the cube as an additional product allowing the fast spatial aggregation for parcels' analysis.
- On-the-top tools: The module includes a set of tools that are built on top of the DataCube. These tools provide additional functionality for analyzing and visualizing the indexed data. They allow users to perform various operations such as querying, filtering, and extracting specific information from the data.
- API for user interaction: One layer above stands the cube's REST API that enables users to interact with the system. Users can provide parameters such as time range (for selecting specific data over a period) and bbox (bounding box coordinates) to request plots and time series graphs related to the parcels of interest taking into advantage a subset of the on-the-top tools such as the plot and time-series graphs. These visualizations are sent via email to the users so to include them into their in-house systems. In this way, the decision-makers have an additional tools that enhance the monitoring procedure as the plots provide insights into the selected parcels, allowing them to analyze and understand changes over time.