SOLVED after about a month of reasearch.
This error does not seem to be related to duplicat objects at all. Instead, navigate to folder C:\ProgramData\Microsoft\Crypto\RSA\ and make sure Admininstrators have FULL control over it and all descendents.
You should also make sure the account that manages your SSP be in administrators group.