Preheat the oven to 350 F. Remove the tops of the nutter butter cookies and set aside. Place the bottoms on a large baking sheet. Place one marshmallow and one mini milky way candy bar on each cookie.
Bake for 2-3 minutes. Remove from the oven, and sandwich with the tops of the cookies.