After I installed Xubuntu on another Machine, refreshing the desktop worked as expected. Then went back to the first machine and had it working there as well. So I can't reproduce the bug, but I'm sure it was there (and for most operations involving files and folders to or from the desktop). Strange.