To fix the weird rotation issue, add "xrandr -o right" to your .xinitrc (or to xinitrc.xfce4 if you aren't using it as your main window manager), right before "xfce4-session" near the bottom of the file.
I was also having some problems with the keymap, so I changed it to obey the same keymap as for Matchbox/Openbox. I don't quite remember how I got everything to work, but I've attached my xinitrc.xfce4 file so you can compare. This fixes any keymap issues that I know of.
Make sure you backup your initial xinitrc.xfce4 (or .xinitrc) file before trying this, and make sure you execute "chmod 755 xinitrc.xfce4".
[EDIT]It won't let me upload the file, so I had to add .txt to the end of it. Make sure to remove this extension.[/EDIT]
