It's not so much the 'speaking' as the 'sneaking around doing something unclear.' That's what gets his heart twisted up and painful.
For that matter, how's her Welsh/BSL these days. They should clearly work on that before he panics all over her.

He'll come around if she explains it in the greater context of her life. He just worries. He worries so much, Sophie.