If Kaito were letting Agito up, he would switch the eyepatch first to give himself some headstart in getting away. But that was not happening until he had his fun.
"Is that how you speak to your brother and your boyfriend?" Kaito smirked, going on to try to draw Agito's old emblem design on his forehead with more syrup.