I'm optimistic because things like graphical fidelity are finally starting to plateau. Devs won't be pushed to chase graphical increases as much as they have been in generations past, which is one of the big sources of throwing out engines and starting over.
Baldurs Gate 2 released in the year 2000 on the Infinity Engine. 2 years later, two D&D games came out - Icewind Dale 2 (also Infinity Engine) and Neverwinter Nights, on the Aurora Engine. NWN absolutely trounced IW2 in sales. That's not to say that IW2 did badly, but a publisher being interested in signing off on a a sequel project won't have to weigh such considerations if the engine is largely the same.
In chasing new engines, sometimes devs run into problems too, such as the bugginess of the Electron Engine or the massive workflow problems with Frostbite.
Well sure, but I don't need Larian near-perfection on everything. What I'd like is to experience some of the older D&D titles I missed from my childhood, without having to wrestle with obsolete editions or Dosbox.