Since clothes fluff easily catches onto other clothes, remove it before you put a garment in the cupboard.
If you don't have a clothes brush, use a strip of masking or sticky tape wrapped around your hand, adhesive side out, or a damp sponge.
You'll find that fluff is much easier to remove with a damp clothes brush than with a dry one.
To remove fluff from velvet, a sponge powder puff works well; on wool use a dry synthetic sponge.