We need to disable retries in the settings box next to the test activity. The Retires on the S1-MME tab is for no response scenarios. It will retry forever if the retires at the test activity level is enabled.