You should endeavor to keep the bird contained within its cage whenever feasible. It will not follow you or listen to instruction, unless it is trained to sit on your finger or shoulder. Keeping it safe for it's continued existence means that it's home is technically the cage it is supposed to be in.
You can place all manner of "toys" into the cage and even a mirror, for the bird to have fun with.