Preheat the oven to 350 F. Remove the tops of the Oreo cookies, and set aside. Place the bottoms on the cookies onto a large baking sheet. Place one marshmallow and one milky way candy bar on each cookie.
Bake for 2-3 minutes. Remove from the oven, and sandwich with the tops of the cookies.