How to Add Separable Slide Contact in Static/Modal Analysis

Hi. I want to perform modal and static analysis on parts which connected each other with bolts (bolts modeled with RBE2). I need those contacts can slide and separable but just contact when they want to penetrate. How is this possible? When I add slide contact it behaves like stick each other but slide. I hope I could explain )