@DavidCarlisle @tohecz I found it. I did document it here :
12000.org/my_notes/faq/LATEX/html_and_latex.htm (just search for the string "second method above is better" on the page, and you'll find how to do it. I wrote: "The current issue with this method though, is that there is no way to tell tex4ht to pass the display math latex code to the HTML page. Only in-line latex code can be passed as is to the HTML page" then there is an example how to do it.