Stain Problem

I just finished staining one side of a poplar door and now notice spots around the nail holes, which weren’t visible until I applied the walnut stain—the carpenter must have filled them. How can I go about correcting this? Should I sand the whole door down or just those spots? Thanks for any advice.