but we can also argue that a local vol model is only as good as the stochastic vol model of which it is a conditional expectation
Except that the Dupire vol is a function of current traded option prices only, not of any particular choice of stochastic vol model. If there are no gaps, it is the risk-neutral expectation of the instantaneous vol^2 no matter *what* model you choose to fit to the current option prices.