I've got a friend who spent years in fashion design in NYC before moving out here, so I've heard all about the ups and downs. there are definitely some solid companies to target-Nordstrom corporate, Tommy Bahama, Brooks Running, Zumiez, even Nintendo and Wizards of the Coast. Nike, Fred Meyer, Columbia as well. But you've got to be smart about it. A few places, especially in SODO, are best avoided. And REI, honestly, can be a mixed bag depending on the team.
The pivot isn't easy. Smaller brands are unstable-my friend saw constant layoffs and short-lived projects. If you're looking at specific houses, do your homework on the culture before you jump. Figure out exactly what you want to get into, then research like your career depends on it, because it does.