The look on his face when he asks her this shows he already knows her answer.
She looks straight at him and tells him not to travel alone, but before he can respond, he looks up and to the side, blinking, and opening his mouth like he’s almost going to speak before he finally just asks her to travel with him. When he does, he looks abruptly down failing to force a smile rather than looking her in the eye because he knows she’s going to return to her life eventually like she always does. And, as he discovered at the beginning of the episode, she’s older than the last time he saw her and he doesn’t know how much longer she has left.
When he looks down after speaking, you can see how much he just opened up by asking her that. He’s not just asking her to come on fun adventures and he doesn’t want to go out and find new friends to replace Amy and Rory.
He can’t look her in the eye because he’s putting himself in a vulnerable position by asking her, specifically and only her, to travel with him.
He first asked her to travel with him a very long time ago and she’s never taken him up on it, but this time she’s all he has left and she means more to him now than she did then. If she says no to traveling with him, it’s going to hurt so much more. This is it. Once she’s gone to the Library, he falls hard.
F R I N G E is a love story about a man who loved a boy so much he broke the universe to save him, and it’s about that boy learning to love a man he grew up hating. It’s about two people drawn together by forces that transcend worlds, and falling in love. It’s a story about love strong enough to b r e a k the world and strong enough to h e a l it.
Hello, Stonehenge! Who takes the Pandorica takes the universe, but, bad news everyone, ‘cause guess who! Ha! Listen, you lot you’re all whizzing about. It’s really very distracting. Could you all just stay still a minute because I AM TALKING! Now the question of the hour is, “Who’s got the Pandorica?” Answer: I do. Next question: Who’s coming to take it from me? Come on! Look at me! No plan, no back-up, no weapons worth a damn! Oh, and something else I don’t have: anything to lose. So if you’re sitting up there in your silly, little spaceship with all your silly, little guns, and you’ve got any plans on taking the Pandorica tonight, just remember who’s standing in your way. Remember every black day I ever stopped you. And then—and then—do the smart thing: let somebody else try first.