How to solid rigid body contact need to notice?

I have do the rigid body contact. At here because the RBE2 can't constraint over 100000 nodes.

 

So at my model I modify the young's modulus.

 

Because I can do the analysis in simple model, but when I apply the instruction in the full model.

 

The model will divergent at the last step, but it still complete the analysis.

 

I have set the PCONT > STIFF > HARD and my contact group set the pattern to make it better convergence.

 

Where should I notice about the rigid boy contact?