Yes, this is by design. if you had the ability to un-share a shared image or truly delete an image, the same effect would occur.
Note that this will not effect collectors if they have added those pics to represent their own collection. The system does not yank away their images. However, if they delete a once-shared-now-unshared-image, they won't be able to re-add it.