Skip to Main Content
Spotfire Ideas Portal
Status Implemented
Product Spotfire
Categories Automation Services
Created by Guest
Created on Apr 4, 2016

Automation Services Task to Export Data to Library

I've had a number of situations where I needed more complex data extraction jobs than can be handled through Info Link caching or Scheduled updates.  Being able to create a DXP that does the necessary data cleansing and mashup across sources is a big plus in Spotfire but that logic becomes locked into that DXP.  By using this same DXP as more of an ETL job and staging the data in the library as an .SBDF file allows the complex data prep and transformation logic to easily be reused across multiple DXPs.  Each user DXP now points to data stored in the library that was staged via the ETL-like DXP.  We could then use Automation Services to automate the refreshing of the data.  Having an Export Data Task to Library task that lets you pick from a list of available data tables in the currently opened analysis and being able to specify an extracted file name and folder location is what I'm looking for.

I've built a DXP template that use Iron Python to address some of these needs but having this built into the product is necessary in order to leverage this capability more widely.

Implemented in 7.6
  • Attach files
  • Guest
    Reply
    |
    Jun 3, 2016

    Just recently found out that in 7.6, there is now an "Export Data Table to Library" automation services task.

    You can see information regarding it here.

    https://community.tibco.com/wiki/caching-data-tibco-spotfire-automation-services

  • Guest
    Reply
    |
    Jun 3, 2016

    Oliver, we would be interested in your solution. Any way you can post it on community.tibco.com and share the link here?

  • Guest
    Reply
    |
    Apr 16, 2016

    I have created this task and can share my code if necessary. The use case is exactly the same as above.

2 MERGED

Replace data in Spotfire library with Automation Services

Merged
Use Case: Customer has 97+Million records that needs to get loaded into memory. Saving the dataset in the library in STBF format reduces the loading time from 90+ minutes to ~2 minutes. This dataset needs to be updated/replaced every 3 hours and A...
almost 9 years ago in Spotfire / Automation Services 2 Implemented