Please improve Python service to run Python data function on other available engine instead of showing "Error from Remote Service: Internal Server Error (500) - Session is currently closing an engine."
This can be seen if running python data functions repeatedly rapidly, as well as below 2 configurations are set to 0.
dynamic.prune.threshold: 0
engine.prune: 0
We have an customer reported that code like "p = pd.read_pickle('c:/test/pickle_exported_huge_file.zip')" could be very slow if called twice or more on the same python engine, so we suggested him to turn both above 2 configurations off(set to 0).
However this error "Error from Remote Service: Internal Server Error (500) - Session is currently closing an engine." is seen sometimes if running python data functions(this is a much simpler and quick one, and not calling pd.read_pickle(xx)) repeatedly rapidly.
I understand the error makes sense for some scenarios but it doesn't has to show up for our use cases, we hope Python service can be improved to just look for another availble python engine and run from there, instead of showing this error and fail.