I would recommend hotkeying the 3 coordinates on your ALT + M shortcuts, it will be easier then. You could receive the "*snicker*" dialog a whole lot of times before he challenges you. Just be patient and keep walking over him, he will eventually challenge you.