Is it dumb to get a varsity jacket with no varsity letter/patch?

i am on my schools swim team, and im a freshman. i no there's no way i got my letter. would it be dumb to get a varsity jacket without the letter/patch? because if it is, and i don't get my patch next year, im not going to bother getting a 300 dollar jacket that i only wear junior and senior year. my mom said she got a jacket and she didnt get her letter, so i dont know what i should do. ill know for sure that i didnt get my letter on our banquet on tuesday, although i definitely did not get it. thanks in advance and happy holidays! :)