about 2 years now that I abstain from milk and milk products. As it has affected (positively) my wellbeing so dramatically, I strongly recommend to generalize the concept - It is worthwhile to search ones roadblocks for health, in situations where ones efforts to heal do not result in contentment.
Losing weight is my personal issue of life (also my scientific field of study), so for years I eat “right” as well as smartly exercise daily, and yet it was milk abstinence that enabled the 17kg weight loss (see the chart). In the chart (my "excess kg") you may see that in the previous year I have lost 5 kg with the same exercise & diet but with milk and its products (cottage cheese and yogurts). So milk abstinence enabled over 3 times faster weight loss. Pls note that the no-milk diet is not poorer in calories as instead I eat a lot of almonds which have higher caloric value.
It has also (even before the weight loss was manifested) balanced my morning blood sugar levels (I am diabetic II) and now my HbA1c is balanced - 5.6 (it used to be 6.8 regardless of my very low carbohydrates consumption).
Did you try to not drink milk? pls let me know how it affected you
my intuition suggests that it is especially relevant to overweight women...