The display group endpoint gives you all Display Groups, and the Display end point gives you all Displays. The fact that they are “combined” records in the data model shouldn’t really effect the way you treat them via the API.
Listing all the groups and displays would be rather confusing for most uses cases I think… ?