I voted for freezer, but I keep some in the freezer and some in the refrigerator. Color film goes in the freezer, as does fast black & white. Slower black & white stays in the refrigerator section. If I know in advance that I will be using some of the film from the freezer, I move it to the refrigerator section a day or two in advance; and from the fridge to cabinet or camera bag a few hours before using it. I keep a roll or two of black & white in the cabinet to have some immediately available.
If I have to use some film from the freezer on short notice, I put it in my pants pocket for an hour before using it. That will warm it enough--or at least I have never had a problem doing this. The main issue with opening it right out of the freezer or fridge is that moisture might condense on it. So I keep the canister shut until it has warmed, before opening.