Filtering for release/staging - spec

[dosumis]

Delete all ds:DataSet where ds.production or not exists(ds.production)

Delete all i:Individual where (ds)-[:has_source]-(i:Individual)<-[:depicts]-(ch:Individual) WHERE ds.production is False or not exists(ds.production) unless the pipeline is configured for staging and i.staging = True

Delete any node where n.block is True
Delete any edge where e.block is True

@Robbie1977 @matentzn - please review

[matentzn]

Makes sense to me!

Blocking would be really easy to do like that:

1. select all nodes with blocked=true, delete (ROBOT remove)
2. ROBOT remove --term n2o:block

[Robbie1977]

Happy with that but @dosumis do you mean 'ds.staging = True' rather than 'i.staging = True'

[dosumis]

Hi @Robbie1977 - I probably should have described use cases first.

For staging, my understanding was that we want to be able to use it to test small numbers of images in a dataset - hence the tag on individual. I have no objection to being able to use it for a whole dataset too.

In which case:

• Delete all ds:DataSet where ds.production or not exists(ds.production) unless the pipeline is configured for staging ds.staging = True

• Delete all i:Individual where (ds)-[:has_source]-(i:Individual)<-[:depicts]-(ch:Individual) WHERE ds.production is False or not exists(ds.production) unless the pipeline is configured for staging and i.staging = True or ds.staging =True

[matentzn]

STAGING=DEV

• staging true & prod false: dont delete
• staging true | prod true: dont delete
• staging false & prod true: dont delete
• staging false & prod false: delete

To put more simply:
IF((staging=false || unbound(staging) && prod = false) -----> DELETE

[matentzn]

Correction:

IF((staging=false || unbound(staging)) && (prod = false || unbound(prod)) ) -----> EMBARGO