I tend to think of it this way: the question isn’t did things happen this way, but could things have plausibly happened this way at that point in history? If the answer is yes, then you have written historical fiction. I am so looking forward to reading this book!