Mariners GM will not return in 2004