Boris

Hi all, I am new on here and also new to owning an CAG, My Boris is nearly 3 years old, i had him for xmas, he has settled in really well, such a character. However i have noticed that he keeps dropping his fruit and veg to the bottom of his cage, wrapping it in newspaper and eating it..! now surly this isnt right is it? Should i take the paper away? Any advise would be greatly appreciated. Many Thanks Ginnette