iirc once they hatch from their cocoon(Is hatch the right word?) they can't eat. They live for less than a week, slowly starving to death while they look for a mate and try to breed. So, I doubt the little black things are poop.
That's why you(Or at least I) rarely find them active and healthy looking. If you see one and can catch it it's probably just about dead.