The effect of the Saints’ sloth, as foretold in the 1833 parable, was to leave the Lord’s vineyard in the possession of His enemies who would own the vineyard, have the walls and be able to set their own watchmen, and erect their own tower atop His property. That destruction and scattering left the Lord's enemies in possession of His vineyard.
The circumstances following the scattering of the Saints (D&C 101: 51) reminds me of Joseph Smith’s last dream:
A great work remains undone to prepare for the Lord's return. It cannot happen by continuing in the same slothfulness that got us driven into the wilderness. More is required than conceit and contentment as we squander the time remaining. Unless we awaken, we will be utterly wasted at the Lord's return.
Idolatry is not the Gospel.