The LiveView Server at this time doesn't monitor the keystore for change. On any keystore change, the LV server needs to be stopped and restarted to see the change.
LiveView Server should monitor the keystore for any changes and then reload the keystore when any change is seen.