“and if they were both outcast for the same reason, they might at least have the pleasure of each other’s society for compensation.”