Yup, lentement is the key word.
you could also use "moins vite" in case he doesn't understand

I would think he would understand what you're trying to say though - I know I would (if he's from Paris, he'll probably pretend not to understand though

how does "moins" translate? I know that "vite" is fast or hurry.