If they had you install anything to actually control your pc then remove it...restore it to previous and check it actually uninstalled. If they used windows in built remote desktop then remove its settings.
Inform your service provider that you have falled for this, so that they can monitor the ip address you were on, then (and im assuming your on dynamic IP like most) turn off your router and wait 15-20 minutes and turn it back on. this gets you a fresh IP address from your provider and makes it harder for them to get back on anyway.
Run a antivirus scan on your machines and action anything that you find,
oh and remove any software they "sold" you as its probably infected with something..
I dont have to tell you as you realised but will post for others, anyone ringing you stating they are from or work in connection with microsoft (unless you rang them first) is probably lying, microsoft wont ring you unless you instigated it. Also they wont ask you for money or card details over the phone, do not give out information like this unless you know the source and have validated them like they should have validated you.
Calls like this are unfortunately very common and loads of people fall for it, you have done the right thing by telling the bank immediately. you should be fine.
With luck changing your ip and remote settings will be enough to cut them off. Just be vigilant for a while look for any unusual activity like activity lights when your not doing anything.
This scam is usually after your money not your pc (but not always)