It depends on how well protected you feel the tree is by the house. If it is likely to be subjected to strong winds I think I would ere on the side of caution and remove it indoors for the winter. If you leave it outside a fleece jacket both for it and the pot,which might easily crack, would be a good idea. I used to bring mine indoors for about 5 years, but it lives happily outsidethroughout the year.
I agree with Bromsgrove.Mine is now 9 years old and too large to bring inside.It's been happy outside forever but I have had it in corners to provide a bit of protection.One year we had a serious leak and my poor old bay was underneath it covered in icicles! They are tough cookies.(I live oop north too!)