Yes, as long as the frequencies match up. I don't think you'll have an issue. Canada/US carriers are very similar in their networks and frequencies with the exceptions being guys like Wind, Mobilicity, etc.
Before T-Mobile sim card,Make sure your Android phone is unlocked.
If it's network restricted phone means,you will need to unlock your mobile.For unlocking you can approach your service provider or else try to buy an unlocking service from any one of the online unlocking service provider like http://www.unlocking4free.com/unlock-... They will provide free unlocking service for old mobile models only.