Noiseless clusters and perturbations in networks of coupled quantum harmonic oscillators