When Jazz spoke of the 'dark side', Glitch's first thoughts went straight to Azkadillia and the Long Coats. His actual reaction to the thoughts, put him back peddling away from Jazz in a quick attempt to get away from them. If they were with the Long Coats or Azkadillia, he needed to get as far away as he could before he was caught.
"Once was more than enough and I'm not going back! I do not need to be recaught by the Long Coats and have them remove something more than my brain." what Glitch spoke made perfect sense to him. He knew what it meant to be at the hands of Azkadillia, he had the proof right in plain sight.