Sort Grouped records by values in Summary bar

Grouped records and the summary bar - functionality here is great, but the only way to sort the grouped records is by the order of the grouped by field options. I’d like to be able to sort by the numerica values in the summary bar (e.g. revenue or # of records)