He wants to hide that stone somewhere it won't be found again so because that sure does look like she's holding a love token from Changheng. But since that would probably make her sad, he's just going to fantasize about it. a lot.