It would make the quantum attack more expensive by N public keys used in a future transaction. Make sure not to leak the xpub, or this benefit + privacy is lost.