Pour in vegetable broth and milk. Season with salt and pepper. Continue to simmer over medium low heat until sweet potatoes are tender. Puree soup with either an immersion blender or blend soup in batches until smooth. Return soup to saucepan and continue to cook for another 5-10 minutes to heat through.