The logical possibility of materialism/physicalism being true and not having consciousness or “what it's like” being something is the "heart" of the philosophical zombies argument, not (principally) modality and conceivability. This is the basic point of Nagel’s argument. The issue is how to close that gap: the gap between the subjective point of view and the objective point of view.