Judy grave great advice.
You wrote: "I'm beginning to think he might die at the drop of a hat."
Not that easily, but just clear out the basics that will kill easily such as Teflon anything cookware. No more spraying air fresheners all over the house or the use of chemicals that emit dangerous fumes which are not only bad for birds, but humans also.
Regarding socializing, it's always good to have people over and let your grey become used to changing faces and realizing they are not a threat. They will even interact with those they chose from the get-go they like.
Most Greys are very cautious of new items and fearful of them. It takes distance and time to introduce new toys or other items to them.