It may be not usual, but the spec allows the TrustManagerFactory, KeyManagerFactory and SSLContext implemented in different providers. As JDK implements them in the same SunJSSE provider, it is likely to introduce the dependency between them.
Need test cases are needed to use these classes from 2+ different providers, and make sure the provider does not introduce the implementation dependency of them.
See JDK-8207029 for the case used in practice. Test only bug, the implementation fix has been addressed in JDK-8207029.