At this time, when using "Add Rows" and "Add Columns" operation, memory consumption becomes much larger than total of each data source.
For example, four data sources with 1000 rows each are merged in one datatable with "Add Rows" operations, below data are stored in memory. Data sources and resulting data of each Add Row nodes are also stored .
- four data sources with 1000 rows each --> 4000 rows
- resulting data of Add Row nodes --> 2000 rows + 3000 rows
- resulting datatable --> 4000 rows
Total 13000 rows
These "so called" temporary data (data sources plus resulting data of Add Row nodes) are useful if you have to edit data flow, but they are not required if data flow has been fixed, like daily template analysis files used in Web Player.
Would you consider to add option to release temporary data from memory ? In case if data flow is fixed, below data stored in memory are not necessary.
- data sources
- resulting data of Add Row nodes / Add Columns nodes
Regards,