The TDV standard File-Delimited adapter introspects all columns in the CSV file as VARCHAR type. It would save time if the data types were inferred by looking at the data in the CSV file.
| Implemented in | 8.5 |
This is already possible using the local file adapter.
Thank you for pointing this out. Most customers use TDV on Linux so we are unlikely to implement support for schema inferencing on Windows. However we are tracking this request in TDV-I-362.
Local File Storage adapter cannot infer the DATE type.
In addition, the Local File Storage adapter is inferior to File-Delimited in the following respects
・Fewer character code types are supported (e.g., SJIS, which is used in Japan, is not supported). (such as SJIS used in Japan)
・Slower speed during introspection than File-Delimited.
This makes the Local File Storage adapter incomplete as an adapter that can infer data types.
From a performance standpoint, please extend the functionality of the File-Delimited adapter so that it can infer data types.
The local file storage adapter doesn't work on Windows environment due to HDFS issue.