Conditional Marker Folder Roll-Up on Calculated Fields

I have been really enjoying the conditional markers on custom fields. However, I am struggling on how to make the markers work correctly for the roll-up data on a folder.

In my example above, the roll-up value says 0 instead of the 128 AVG value. Is there a setting I'm missing or is this how it is supposed to work.

Thank you,