After my different attempted, finally fixed it. Seem like the problem was security keys problem that when the serveradmin starting. Just dragging the server app to trash could not resolve that because seem there is some key setting that on the computer that I am not aware of. Lucky that I found someone suggested using AppCleaner to uninstall the server. It is good that found all related file and let me delete them without me searching any. And yea, after I reinstalled the server, it can run again.
