It is better for a rug to be cleaned by a carpet sweeper than a vacuum cleaner. If a vacuum cleaner must be used, be sure it is on low suction power.
Clean your small throw rug the old-fashioned way: put it face down in clean snow. After a short while, gently shake the snow off. You will be surprised at the dirt is gone.