Scott, dropping liquid dairy for a few weeks looks like a clean self-experiment. Milk adds lactose carbs and calories that are easy to drink past fullness, while cheese and butter tend to be more self-limiting for many people. I’d keep the rest of your meals and training the same, note hunger, and judge by a multi-week weight trend rather than one morning’s scale. If weight keeps creeping while you otherwise feel fine, that’s useful data either way.