The meaning is that the family is not interested in close social contact with him or visiting him on a regular basis.