Bodice Ripper Readers Anonymous discussion

I read this book maybe ten years ago and for the life of me I can't remember the author or title. I think it was from the 80s but I'm not entirely positive. It was about a servant girl who is seduced by her employer (she's mixed race) and is used by him and he wouldn't marry her because of her status and she ended up marrying some old guy at some point and also a gay guy who was into her brother.