When the source is a SAXSource, the systemId returned by a custom resolver is not used by the ValidatorHandler. 

The following code demonstrate the issue:

Validator validator = schema.newValidator();
validator.setResourceResolver(resolver);

Where the resolver returns a LSInput instance, e.g. new LSInputImpl(null, systemId, null). The systemId then is not used by the Validator.