Caring for Rhinestones kovelsphotoeditor 13 years ago Rhinestones set in jewelry and buttons often fall out because the glue shrinks with age. Reglue them into place. If the rhinestones are lost, try to find old ones to replace them. Costume jewelry dealers often have extras.