Preheat the oven to 350 F. Remove the tops of the nutter butter cookies and set aside. Spread peanut butter onto the bottom halves of the cookies. Set onto a large baking sheet.
Place kitkat candy bars and marshmallows on each cookie. Bake for 2-3 minutes. Remove from the oven and sandwich with the tops of the cookies.