Skip to Main Content
Spotfire Ideas Portal
Status Future Consideration
Product Spotfire
Categories Data Management
Created by Guest
Created on Dec 30, 2019

Allow column selection and filtering when loading a Library Data File (SBDF)

When using Information Designer, it's possible to use filtering to restrict the rows that are returned and to be very specific about the columns that are returned. We're seeing a significant increase in the use of Library Data Files (SBDFs) as data sources - it would be great to be able to create the equivalent of an information link when loading an SBDF. For example, to be able to select the columns and to filter the rows as part of the loading process rather than through post-loading transformations.

  • Attach files
  • Admin
    Arnaud Varin
    Reply
    |
    Jan 20, 2023

    Understood. Thank you.

  • Guest
    Reply
    |
    Jan 19, 2023

    Thanks for the comment. What you suggest is true of course, but requires all of the data in the SBDF to be loaded to RAM and then you start to do the filtering and the column selection. The request is to be able to decide what data gets pulled into the report in the first place - a bit like you do when using SQL. If your SBDF has 10m rows and contains the data for 100 countries, but you only actually want the data for a single country, it would be useful just to pull the data for that country.

  • Admin
    Arnaud Varin
    Reply
    |
    Jan 19, 2023

    Couldn't this be resolved already using Filters rows and Exclude columns transformations?

  • Guest
    Reply
    |
    Jan 2, 2020

    Would be very useful. Also, load-on demand load as described in TS-I-6789  would be very useful (which I guess is what meant by filtering rows). Creating an information link using sbdfs as data source would be a great enhancement as it would further harmonize loading data.