Preheat the oven to 350 F. Remove the tops of each nutter butter cookie, and spread peanut butter on the other half of the cookies. Place onto a large baking sheet.
Top with marshmallows and chocolate chips. Bake for 2-3 minutes. Remove from the oven, and sandwich with the top half of the cookies.