Yes, put back only the things he is familliar with, if you want to introduce new toys to his cage you will have to do it more gradually, one at a time with weeks in between, also place the new toy within his sight but outside of his cage (which is his comfort zone/his home) where he can see it for a week or so before putting it in the cage. It's funny, they are always so wary of anything new, they seem to think it's gonna swallow them up.
My Beau won't come in this room right now when he is out of his cage because there is a xmas card holder on the wall beside me, it's only small but he is very wary of it.
Hope this helps.