How to check what contracts can interact with my wallet?

I was wondering if there was a way I could find and see all the contracts that I've interacted with and that have access to my wallet at one place and where I can take back the access and keep a log of contracts I've used in the past.