Yes, as I said you can do it if you're very careful how you extract the key. Because leakage of information from the TDP is not *just* a theoretical concern. The RSA-TDP for example *does* leak information, specifically it leaks at least the Jacobi Symbol of the preimage.
So when Ilmari so nonchalantly says that you need to use a "suitable KDF" what that means is that you need to make damn sure that you use a good randomness extractor, that can deal with the leakage. (Of course what people are going to do is throw a hash function at it and pretend that it's a random oracle, which negates p…