leave the tstat in. Otherwise the car will run too cool and be in open loop all the time. Gas mileage gets worse, car runs rich etc.
If you've changed the tstat, the water pump, and got all the air out of the system, you've got a clogged radiator...simple as that.