hate our PTACs

juat wondering if anyone has a suggestion for what to do when you have PTAC units already and hate them. We have a lot of street noise that comes through ours. There is also a breeze sometimes, as if there is not enough insulation or seal around it. I would love to put in baseboard radiators or radiant floor heating for the winters and just use fans and airconditioners in the summers but nobody seems to think this is a good idea. Would love to hear suggestions.