In the books, he gets kidnapped by pirates, she rescues him, and his grandma (who is a stereotypical Dragon Lady but not evil) in gratitude for this agrees that Phryne can be Lin Chung's concubine and she (grandma) will arrange a marriage with a wife who will not object to this relationship, on condition that Phryne doesn't object to or interfere with the marriage.