[ Data doesn't take it as being too rude, at least, since he can understand the curiosity. For many, the concept of family is based in biology, and he clearly lacks biology. ]
While I cannot speak for all androids, I do. I was of course built rather than born, but the humans who created me did consider me to be their son.