We provide critical instructions for that in the compatibility table:
roomieremote.com/ip-compatibility/
Notably, the port must be 10002. The TV itself must also be setup correctly for IP control.
Everything was setup properly but looks like the issue was the password was too complicated, once I set up an easy password it worked right away.