Fuuma might have thought at first that Kamui didn't remember them, but once they talked a bit, he would know that wasn't it. From there he would probably think that something was troubling Kamui, and for some reason he wasn't reliable enough to be told about it. Maybe some raging teenage hormones too.