In a large bowl, using wither a hand or stand mixer, beat softened butter with both granulated sugar and brown sugar until fluffy.
Add in flour, vanilla extract and milk and beat until a thick dough forms. Fold in crushed graham crackers, chocolate chips and mini marshmallows.
Form the mixture into small balls and place onto a plate. Refrigerate for at least 30 minutes. Melt candy melts in the microwave according to package directions, stirring after each interval until smooth and melted.
Dip each cookie dough bite into the chocolate, coating it fully. Set onto plates and let the chocolate set.