Yes, every component goes to ground, but then all of those grounds end up going to a single point, and then to the negative battery post.
Either way, the start of every circuit comes to a single point, and the end of every circuit goes to a single point. Disconnecting either of those will have...