I definitely feel for you Tombraider I also made the mistake of jamming my microdrive into the CF slot right away (was excited) and then found it was very interesting getting it back out again.
Definitely once you do manage to get it out you'll want to add a piece of tape (I used clear scotch tape) to make a pull-tab BUT make sure you don't cover the hole that says "Don't cover this hole" otherwise... well, you'll find out if you do but you won't because you'll be careful, right?
Anyway, hopefully you have some sort of fingernails available to help you in this, on the day that I was messing with my microdrive I happened to have not cut my fingernails really short and was able to use them as 'pincers' to grab the CORNERS of the microdrive where the itty bitty screws go in to hold it together. Then with sure but steady force I was able to pry the drive straight up and out. I wouldn't wiggle it, just grab where the screws are and pull right up.
Your fingers might hate you afterward but you should have a good drive. Just make sure you pull it out slowly or you'll risk dropping your lovely microdrive to the floor and that'd be a bad thing.
As for the pull-tab via tape solution I've had no problems with a piece than ran down both sides of the drive (front and back) more or less in the middle of the drive and having the piece of tape form a tab at the top. It's never come loose, it's never gummed up the drive, and it's never gotten in the way. I've had this microdrive for over a year and no problems with it or the tape. I hope yours gives you many years of good service
