First, you can try plucking out each debris one by one using tweezers and a magnifying glass from a dry towel. You can also hand wash the microfiber towel with hot water to expand its fibers to release the dirt. Finally, washing thoroughly with a good detergent can also help!