Place flour in a microwave safe bowl and microwave for 30-40 seconds. In a large bowl with wither a hand or stand mixer, beat softened butter with peanut butter and granulated sugar until fluffy.
Add in milk and vanilla extract, beating until smooth. Beat in flour, mixing until all of the flour is incorporated. Cover and refrigerate until serving.