When enabling data function debugging, we can find below information from analyst's debug log.
This is very helpful to diagnose performance issue however timestamp for each line is not outputted which makes it impossible to figure out how lone each operation took. Please add timestamp information to each line.
2022-09-13T18:18:54,049+09:00 2022-09-13 09:18:54,049 admin [TF Spotfire.Dxp.Data.DataFunctions.DataFunctionImpl+DataFunctionWorkerFactory::] DEBUG Spotfire.Dxp.Framework.ApplicationModel.NotificationService [(null)] - Data function 'gen' debug output;
Debug log:
debug: start evaluate
debug: reading 0 input variables
debug: done reading 0 input variables
debug: executing script
debug: --- script ---
import pandas as pd
import numpy as np
def gen(row=1,col=1):
a=['x'+str(s) for s in range(1,col+1) ]
df = pd.DataFrame(np.random.random(size=(row, col)), columns=a)
return df
df=gen(100000,500)
debug: --- script ---
debug: analytic_type is 'script'
debug: done executing script
debug: writing 1 output variables
debug: returning 'df' as file tmpdir\dfpythondf_artifact_output_ju2kfgaeyzutmp.sbdf
debug: done writing 1 output variables
debug: end evaluate