Then DO something to it
Try this:
Old Pochman style:
During memo check for corners that are twisted in place
When you have a twisted piece you can memo where the sticker that belongs to U or D is.
During solving: first shoot to the location you memo'd (you now have the U or D sticker in your buffer) then shoot the U / D sticker to where it belongs.
The alternative is to use commutators that twist corners but this is more difficult to learn.