Small amounts are not going to have a big effect on your greys,but if consumed in large quantites it will, Greys are lactose intolerent.This means that they lack the digestive enzyme which is called lactase, which helps digest milk sugar.
Milk sugar is called lactose. Some milk products contain no lactose, and these may be safely fed to birds, such as soya milk