Preheat the oven to 350 F. Remove the tops of the cookies, and spread peanut butter onto them. Place the tops of the cookies onto a baking sheet. Top with marshmallows and chocolate.
Bake for 2-3 minutes. Remove from the oven, and sandwich with the remaining half of cookies.