Anything is possible. However, most likely not cost effective to make your own dyno.
I'm sure it has been done with varying results. Search the web.
One idea is air flow. An engine is just an air pump. The more air it moves the more hp it makes. So maybe just measuring how much air the engine can ingest would indicate hp (minus pumping losses of course).
good luck with that!