I'm having this problem...
If you have instances with displacement, and you change anything in the material, it will kill Arnold in GPU and CPU mode. You have to restart IPR.
Workaround is to use pack geometry. But it is slower....look like Arnold is recalculating the displacement geo on any parameter changes.
Best Regards!