In a large bowl with a mixer, beat heavy whipping cream until stiff peaks form. In another small bowl, combine sweetened condensed milk and peanut butter and mix until smooth.
Add the peanut butter mixture to the whipped cream along with vanilla extract and Reese's pieces candy. Pour the ice cream mixture into a large freezer safe container. Freeze for at least 4 hours.