Writing many items in STAC catalog results in error (e.g. jobid j-2506121243464abc8cb05b3670a41505) :
OpenEO batch job failed: StacApiResponseError('413 Client Error: Request Entity Too Large for url: https://catalogue.weed.apex.esa.int/collections/ecosystem-characteristics-alpha3 with response body: \r\n<title>413 Request Entity Too Large</title>\r\n\r\n
413 Request Entity Too Large
\r\n
nginx\r\n\r\n\r\n')
The STAC catalog size is increased (by Bram) from 5MB to 20MB, however this is only a temporary solution since:
- we'll hit the limit at some point again adding items
- the querying/loading/writing will take longer and longer
Most likely the cause is that the Derived Attributes is long as per item the input files are linked which means all S1 and S2 scenes for a full year (plus some additional datasets). The metadata items stored in catalog like these derived attributes need to be reviewed and revised to solve the issue on the longer term.
Suggest to assign this to OpenEO team revising the export_workspace (to STAC) function to reduce memory and provide some guidance on how to store these attributes (e.g. in separate JSON file on S3 or ...).
Writing many items in STAC catalog results in error (e.g. jobid j-2506121243464abc8cb05b3670a41505) :
OpenEO batch job failed: StacApiResponseError('413 Client Error: Request Entity Too Large for url: https://catalogue.weed.apex.esa.int/collections/ecosystem-characteristics-alpha3 with response body: \r\n<title>413 Request Entity Too Large</title>\r\n\r\n
413 Request Entity Too Large
\r\nnginx\r\n\r\n\r\n')
The STAC catalog size is increased (by Bram) from 5MB to 20MB, however this is only a temporary solution since:
Most likely the cause is that the Derived Attributes is long as per item the input files are linked which means all S1 and S2 scenes for a full year (plus some additional datasets). The metadata items stored in catalog like these derived attributes need to be reviewed and revised to solve the issue on the longer term.
Suggest to assign this to OpenEO team revising the export_workspace (to STAC) function to reduce memory and provide some guidance on how to store these attributes (e.g. in separate JSON file on S3 or ...).