Hey, how were you able to get the smudges off? My Toyman has them too.
I was able to scratch them off with my fingernail. If that didn't work, I would have used a scrubbing sponge (the plastic kind with the rough green pad). After that, I would have used a very fine grade sandpaper that I have for customizing, and so on up the grittiness scale until I got it off. As you can tell, I've developed a very detailed process over years of dealing with JLU.
Sandpaper is great unless the part is painted, and then you run the risk of stripping off the paint and having to repaint. I've been able to very lightly sand off smudges while leaving the paint intact, though. It takes a VERY light touch with the finest-grade sandpaper you can get.