Yes, but from heat specifically, not the fabric itself. Cold water and air drying prevent it entirely.
Heat Is the Only Real Cause
Hot water and a dryer's heat cycle break down spandex fibers over repeated washes. This applies to anything with stretch in it, including fitted pieces like Elena or Sienna.
The Safe Wash
Cold water, gentle cycle, lay flat or hang to dry. Machine drying is the single biggest risk to stretch recovery.
Already Shrunk?
A brief soak in lukewarm water with a bit of hair conditioner can relax the fibers enough to gently reshape it while damp.