Peel and chop the orange and apple, peel the mandarin orange and slice the segments in half, and thinly slice the lime.
Pour the wine, brandy, orange liqueur, and orange juice into a large pitcher and stir to mix.
Add the fruit pieces and the lime slices and stir to evenly disperse the fruit.
Refrigerate the pitcher for at least 4 hours, or overnight for more flavor. After that time has passed, taste the sangria and stir in the optional simple sugar if you like it sweeter.
Add ice to 5 wine glasses.
Pour sangria into the glasses, leaving some space at the top. Include several pieces of fruit in each glass.
Top the glasses with seltzer and serve immediately.