Skip to Main Content
Spotfire Ideas Portal
Status Implemented
Product Spotfire
Categories Data Access
Created by Guest
Created on Aug 4, 2020

Spotfire BigQuery Connector - BigQuery Storage API

The BigQuery connector uses the standard BigQuery API which has a low transfer rate about 50MB / batch. In my current situation this results in 60k rows per batch. With analyzing 1-3 million rows the transfer takes between 20-40 minutes when the data is pulled in the in-memory engine.

With Storage API (High Throughput setting in the Simba drivers) the transfer rate can be significantly increased when people analyzing biggers datasets.

Implemented in 11.5
  • Attach files
  • Guest
    Reply
    |
    Aug 10, 2020

    Thanks for a great idea. We will have a look at it.