I had some xmodmap issues, too. I found the reason was, that there was a driver change from the old kdb to the "new" evdev driver. Xmodmap doesn't work well with evdev since evdev brings it's own keycodes.