This has been posted on HN a few times and seems to show that terminal.app is your best bet for most cases if you care about latency: https://danluu.com/term-latency/
Terminal app has no truecolor support, no highres mouse support, no kitty graphics protocol, no double height character support, i'm sure there is more but I now discard it from my tests.