I certainly think that you should talk to your daughter's teachers about the situation. (The very fact that you've done so will hopefully help to reassure your daughter that you've genuinely got her interests at heart). However that's not the same as saying that you should demand that she's addressed as a boy. See how the school staff view the situation. (They probably see your daughter interacting with members of her peer group more often than you do, and they'll be able to stand back from the emotions that a parent feels, so they might be better placed than you to see the best way forward).
However both you and your daughter need to be aware that there's a lot of prejudice out there, so it's not going to be an easy path:
https://www.bbc.co.uk/news/world-us-canada-45199499
(I'd like to think that here in the UK, where this website is based, we're rather more liberal and enlightened than some people in Oklahoma appear to be - but I'm not entirely sure about that).