I am so, so sorry for your loss. It sounds like you did everything right, and it is heartbreaking. As to your question, I would destroy everything (cage, toys etc.) and disinfect the area.
Maybe at some point you will want to feel ready to open your heart to another bird.
Prayers for you as your grieve.