Background
The loader_file_format can be configured on the pipeline level and this is fine. But technically it is a normalize setting and we should be able to configure it there as well.
Also not all data types are supported by all formats on all destinations. We should detect those and fail early.
Tasks
-
-
-
-
Background
The
loader_file_formatcan be configured on the pipeline level and this is fine. But technically it is anormalizesetting and we should be able to configure it there as well.Also not all data types are supported by all formats on all destinations. We should detect those and fail early.
Tasks
loader_file_formatto normalize configuration and use it to set the file format. If the explicit value is passed from the pipeline, it has the precedence.