Preheat the oven to 350 F. Place the Ritz crackers onto a large ungreased baking sheet in a single layer. Evenly spread each cracker with peanut butter.
Place one mini peanut butter cup and one mini marshmallow onto each cracker. Bake for 2-3 minutes. Remove from the oven and sandwich with more Ritz crackers.