A reader named Warren emailed the following message to me recently: “I’m still a bit confused between to go and to come. U said it’s all about movement to or away from where the speaker or hearer is, my question is how do you define who the speaker is? is that the one that is talking? What about the following example: the doctor asked me to stop COMING back. In this case who’s the speaker? the doctor or the one who is talking?”

Warren, those are excellent questions. The best answers come from rewriting your example in three different ways.

1. “The doctor told me to stop COMING back to him.”
Consider an equivalent form but with a different person being told by the doctor what to do:

(a) “The doctor told Ms. Jones to stop coming back to him.”

Statement (a) puts you as the listener/reader in the location of the doctor. From the perspective of the doctor, Ms. Jones is COMING back to him.

2. “The doctor told me to stop GOING back to him.”
Consider an equivalent form but with a different person being told by the doctor what to do:

(b) “The doctor told Ms. Jones to stop going back to him.”

Statement (b) puts you as the listener/reader in a location OTHER THAN the location of the doctor. From the perspective of someone who is NOT at the doctor’s office, Ms. Jones is GOING back to him.

So #1 and #2 are each correct, but you have to decide as the speaker/writer whether you want to put the listener/reader at the location of the doctor (#1) or at your non-doctor’s-office location (#2).

In other words, you have to decide whether you want to focus the “told me”

• on the act of the doctor (#1)
   
  -OR-
• on what the doctor is requesting from your perspective/location (#2).

But let’s change your original sentence (#1) slightly:

3. “The doctor told me that I should stop ____ back to him.”
Consider an equivalent form but with a different person being told by the doctor what to do:

(c) “The doctor told Ms. Jones that she should stop ___ back to him.”

Statement (c) is equivalent to “The doctor told Ms. Jones that ‘X’.”, where ‘X’ is a complete sentence on its own.

For example, ‘X’ could be “The sky is blue.” — giving us “The doctor told Ms. Jones that the sky is blue.”.

So what should we put in the “___” in #3?

Sentence #3 becomes “The doctor told me that ‘X’.”, where X = “I should stop ___ back to him.”.

Try replacing “___” in this X with “GOING” and with “COMING” to see which one is correct:

(d) “I should stop GOING back to him.”
(e) “I should stop COMING back to him.”

Given that you (the “I” in (d)) are NOT where he (the “him” in (d)) is, you have to GO back to him.

In other words, you, where you are, cannot COME back to him.

So the correct completion of statement #3 is always “The doctor told me that I should stop GOING back to him.”