Preheat the oven to 350 F. Evenly spread peanut butter onto half of the vanilla wafers. Place them onto a large baking sheet, peanut butter side up.
Top each one with a peanut butter cup and marshmallow. Bake for 2-3 minutes. Remove from the oven and sandwich with the remaining vanilla wafer cookies.