Barbarians are supposed to fail Wisdom saves and be dangerous for their own party. This is part of the excitement of playing Barbs. :V

Real talk though, you can either be well-rounded (and not get those 18s and 20s) or you can be focused and dump other important stats. Unless you either roll very lucky for stats, or your DM is providing higher than normal, then you'll have to deal with the consequences of one or the other.
(Sympathies, though; Barbarian in 5e is a painful class that needed better design before release.)