"I mean, we are all the direct ancestor of somebody?"

No, your direct ancestors are your forebears. We are all direct ~descendants~ of a whole lot of somebodies.

Many people, past and present, are not ancestors of anyone at all, whether due to early death, choice, or other factors.