To make the simple syrup, combine sugar, water, and pumpkin pie spice in a small saucepan; bring to a boil, reduce heat, and simmer 3 minutes. Remove from heat, strain, and set aside to cool to room temperature.
Once syrup is cooled, stir together with wine, triple sec, brandy, and juice in a large pitcher. Add fruit and chill well. Serve over ice with fruit if desired.