ℹ️ ODD PI 26.4 Objective 6: EIE Dataset Evaluation Support

[abarciauskas-bgse]

Motivation

Evaluate and onboard a representative set of datasets from the Earth.gov dataset inventory into the Earth Information Explorer (EIE). This effort will help validate the ingestion workflow, identify compatibility gaps, and define the requirements for making datasets AI-ready.

Description

The objective of this task is to assess datasets from the [Earth.gov datasets list]and ingest a subset into the EIE tenant.

The evaluation should focus on:

• Compatibility with the current EIE ingestion workflow and TiTiler-CMR.
• Metadata completeness and quality.
• Data formats and access patterns.
• Gaps that prevent datasets from being effectively discovered or visualized.

Acceptance Criteria

• At least 10 datasets from the Earth.gov dataset inventory are successfully ingested into the EIE tenant.
• Compatibility assessment completed for evaluated datasets.
• A documented list of issues, limitations, and recommendations for datasets that could not be ingested.
• Initial criteria and recommendations documented for making datasets AI-ready (data structure, metadata, accessibility, and semantic completeness).

Sub-tasks

• Review the Earth.gov dataset inventory. (partially done)
• Evaluate datasets for compatibility with TiTiler-CMR and the EIE ingestion pipeline.
• Identify datasets that can be onboarded with minimal changes.
• Ingest the selected datasets into the EIE tenant.
• Document ingestion issues and required improvements.
• Define and document requirements for AI-ready data and metadata.

Deliverables

• List of evaluated datasets and their compatibility status.
• List of successfully ingested datasets.
• Documentation of ingestion challenges and recommendations.
• Draft guidelines for AI-ready datasets and metadata.

LOE

TBD

Dependencies

[siddharth0248]

https://github.com/NASA-IMPACT/eie-llm-backend/issues/103