In a large bowl, add the citrus peels to the sugar. Mix the peels and the sugar with your hands, then lightly muddle and let rest for at least 30 minutes. After 30 minutes, add the apple brandy, sherry, apple sider, ginger beer and soda water. Stir to combine. Add the apple slices and additional lemon peels as garnishes. To serve, ladle the punch into cups filled with ice.