Skip to Main Content
Spotfire Ideas Portal
Status Future Consideration
Product Spotfire
Categories Automation Services
Created by Guest
Created on Jun 14, 2023

Parallelize Data Export in Tibco Spotfire Automation Services

Context

Tibco Automation Services is used to: (1) Open analysis from Library, and (2) Export Data Table to Library.

Step (1) opens an `.dxp`, saved in Library, that has 45 Microsoft SQL Server Data Connections, all of which import the full data in-memory. Parallel loading of data tables is observed.

Step (2) exports 45 of these Data Table as `.sbdf` to Library. This step is executed sequentially.


Request
  • Enable parallelization of Data Export, step (2) above.

  • Enable parallelization of the `CreateDataWriter` class to save Data Table as `.sbdf` in Library via IronPython. Based on online docs, there isn't a parameter that allow this currently.


  • Attach files
1 MERGED

Enable parallel processing in Tibco Automation Services data export steps

Merged
Scenario Cache large data fetch from database as .sbdf in Library to improve data load performance in .dxp. Set-up A Tibco Automation Services job which: (1) Open an analysis from Library, and (2) Export Data Table to Library. In cases where there...
over 1 year ago in Spotfire / Automation Services 0 Future Consideration