MORE what?
Check the settings in the displacement shader node.
Reduce the Scale and see if that helps
Does that displacement map have an alpha channel? Maybe you need to enable Alpha is Luminance.
What's the expected result?
Did you check the Arnold log?
Is the displacement.exr set to RAW? Also, try adjusting the Scalar Zero Value.
Haven't watched it properly, but this might help you: https://www.youtube.com/watch?v=ss13J1emsvw
It's the same model + maps and while scrubbing through the video, I saw that there was a displacement connection going on. Check it out, it might help you with your issue.
As a general rule of thumb, Arvids tutorials are always a great resource on shading with The Arnold.
I do the same thing, and the result is not the same as in the video, so I am writing here because I do not know what to do.