Not really. The only real risks are when you come out of a car park, petrol station or driveway onto a deserted road, and automatically drive on the side of the road you're used to: it happens to people who drive on the proper side of the road too. It also helps if you get enough sleep! Neither I (from the UK) or my wife (from the USA) has ever had much difficulty in switchiing from one side of the road to the other. The only thing Frances had a problem with is roundabouts (traffic circles) but you quite soon get used to them. I never got on with the superstitious American regard for stop signs, for that matter. DON'T treat a roundabout as a stop sign, or you're apt to get rear-ended. Even if you don't get rear-ended, it may take you forever to get onto the roundabout (advice from Frances again).
It's also worth remembering that in the biggest democracy in the world, they drive on the same side off the road as they do in Britain, Japan, New Zealand, Malta, and quite a few other islands.
I'll second the comment about the midges. My father used to live on the edge of the Highlands, outside Aberdeen. And I hope you know that B&Bs tend to be unpretentious good value and to provide excellent breakfasts, whereas in the USA they tend to be a lot more twee and expensive.
Cheers,
R.