They don't count, only the ones that have scores are calculated into the average.
By the way, after asking around it seems Metacritic does some kind of "culmination" to get the average (not a native English speaker so not sure how to express this) but in short the lowest score drags down the...