When json output is specified in configuration, tag names are not converted. It's because this process in ColumnNamesConverter class is based on DataFrame schema but in case of JSON output format we have embedded structure. Things to do:
- Retrieve fields of Map type
- Iterate over the fields and change keys of the Map using
withColumn function or any other similar.
When
jsonoutput is specified in configuration, tag names are not converted. It's because this process inColumnNamesConverterclass is based on DataFrame schema but in case of JSON output format we have embedded structure. Things to do:withColumnfunction or any other similar.