So in both cases are you giving the shutter button a half press, holding a moment to allow the IS to stabilize before making the exposure?
In my case I use BBF - press and hold - the AI Servo focus is continuous, and the IS is already running when the shutter is pressed. Maybe that's why my 5DII batteries don't last long.

Glenn