Combine the raspberries and agave in a bowl. Macerate at room temperature for 30 minutes.
Put the macerated raspberries, peaches, 4 cups cold water, lime juice and vanilla in a blender. Blend until smooth. Strain the mixture into a pitcher and add more agave if needed. Cover the pitcher and let chill for at least 1 hour before serving.