Preheat the oven to 350 F. Place 12 ice cream cones onto a large baking sheet. In a large bowl, whisk together flour, sugar, salt, and baking powder. Add in milk, vegetable oil, and eggs. Mix until smooth.
Evenly divide the cupcake batter between the ice cream cones. Bake for 15-20 minutes. In a large bowl, combine butter with powdered sugar and milk until fully combined.