I don’t believe you can track changes on this out of the box, as it is actually one side of a relationship
(Rather than being a field on the Contacts module)
However, I did find an older blog post that shows how to do this exact thing by code!
It should still work nowadays, so let us know how things go!