Part of it is also designer interest. There's no reason different sub races of dwarf and halfling couldn't have interesting abilities, many of the abilities associated with the various elven subraces of 5e didnt exist prior to this edition. The designers just like elves more.