There really are no 'clues'. You need to understand modifiers and then you know when to use them. For example, if you have a patient that had a surgical procedure such as a mole removal, but also was seen by the dr the same day for diabetes and high blood pressure, you would need to use a 25 modifier on the E&M code.
Most people learn from denials, and trial by error.
Hope that helps
Michele