Short answer, "no". It actually gets very very very slightly lighter:
When you save data, a binary zero is set by charging the float gate of the transistor, and a binary one is set by removing the charge. To charge it, we add electrons, and the mass of each electron is 0.00000000000000000000000000091 grams. This means that an empty USB drive (which mostly holds zeros) weighs more than a full USB drive (which has ones and zeros). Add data, reduce the weight. However, you would need to weigh more USB drives than exist on the planet together at once before the difference in weight became easily measurable.