Preheat the oven to 375 degrees F.
Mix together flour, sugars, nutmeg, and salt in a bowl. In a large bowl, beat the egg and orange juice together. Add the rhubarb, peaches, and zest. Sprinkle dry ingredients over the top and toss gently to combine.
Pour the filling into the piecrust. Sprinkle with topping and bake on the bottom 1/3 of the oven for about 1 hour, until the filling bubbles.