Not only what
@UnknownCuber said, but sometimes I'd take apart all the pieces and leave them soaking (except the core) in dish soap and warm water overnight. And these are with my stickered cubes. Although I only do this if I don't have the time to clean everything right away.
For the most part, if you've got a microfiber cloth, just wiping all the pieces clean should be pretty good enough.