Just go.

Him: I'm leaving in about an hour.
Me: Whatever will I do without you?
Him: You'll manage.............. BARELY, but you'll manage.
Me: Hm. Are you sure you don't wanna leave RIGHT NOW instead?