When using Information Designer, it's possible to use filtering to restrict the rows that are returned and to be very specific about the columns that are returned. We're seeing a significant increase in the use of Library Data Files (SBDFs) as data sources - it would be great to be able to create the equivalent of an information link when loading an SBDF. For example, to be able to select the columns and to filter the rows as part of the loading process rather than through post-loading transformations.
Understood. Thank you.
Thanks for the comment. What you suggest is true of course, but requires all of the data in the SBDF to be loaded to RAM and then you start to do the filtering and the column selection. The request is to be able to decide what data gets pulled into the report in the first place - a bit like you do when using SQL. If your SBDF has 10m rows and contains the data for 100 countries, but you only actually want the data for a single country, it would be useful just to pull the data for that country.
Couldn't this be resolved already using Filters rows and Exclude columns transformations?
Would be very useful. Also, load-on demand load as described in TS-I-6789 would be very useful (which I guess is what meant by filtering rows). Creating an information link using sbdfs as data source would be a great enhancement as it would further harmonize loading data.