Don't recompute gradients when opening/closing visualization whilst not changing settings

[NicoKNL]

Right now opening a new type of visualization recomputes the gradient again which is wasted time.