You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Dataset with date fields are not managed properly: the related kylo job failed
Steps to reproduce
After the metadata process, submit a dataset with one or more date fields (that you defined properly in the ingestion form)
The kylo feed will start and try to process the dataset.
Expected behaviour
The date field should be handle properly and the job should be completed without errors a
Actual behaviour
The job failed.
Probably the current Hive version we are using doesn't manage properly the data fields.
Stack trace:
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.UnsupportedOperationException: Parquet does not support date. See HIVE-6384
Subject of the issue
Dataset with date fields are not managed properly: the related kylo job failed
Steps to reproduce
After the metadata process, submit a dataset with one or more date fields (that you defined properly in the ingestion form)
The kylo feed will start and try to process the dataset.
Expected behaviour
The date field should be handle properly and the job should be completed without errors a
Actual behaviour
The job failed.
Probably the current Hive version we are using doesn't manage properly the data fields.
Stack trace:
java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.UnsupportedOperationException: Parquet does not support date. See HIVE-6384
Additional info
https://issues.apache.org/jira/browse/HIVE-6384
In the meantime we should consider to hide the "date" type from the ingestion form @panelladavide @giux78
Please see attached a sample dataset in order to reproduce the issue
sample_esiti_anac_TO.txt