Line a clear medium bowl with separated ladyfingers to cover inside of the bowl completely. Gently press fingers together at seams to set. Sprinkle fingers with sherry or orange liqueur. Spread with the fruit spread.
In a second bowl, combine instant vanilla pudding mix with 1 1/2 cups milk. Pudding will be stiff. Fold in heavy cream until evenly incorporated. Fill bowl with cream pudding and top with almonds and berries.
Trifle is set enough to serve, or may be covered and chilled.