Filling a Hole in a Wall lizuser 4 years ago If you take a nail out of the wall, fill the small hole with spackling paste. Wipe the spackle-filled hole with a damp cloth before it dries to get a smooth finish. If the hole is still showing, use more spackle.