Where can I buy affordable fabric in downtown Toronto?

I am looking forward to making clothing for the summer like pyjamas, a dress, etc.. where can I find good fabric at an affordable price?