Modify view of "More Fields"

It would be very helpful if there was a way to modify the "More Fields" view in the task view.  Maybe something that would either allow us to manually "hide" a field in this section or for there to be an option to select "View Only Populated Fields". 

Sometimes we have a lot of custom fields in our table and each task will not always have all those fields populated.  We then have to scroll through all the fields to see the data we need.  

I am aware of modifying the views within a "custom item type" - but, as mentioned above, this would not resolve this issue because some tasks with this item type may have different fields entered each time.