If people are a burden, sucking life out of the planet then yes, it’s possible to have too many. But if they are a promise for the future, then we need more.
The Demographic Bomb discusses these points. I wrote about that new documentary here.
(While I’m at it, I’ll recommend Fatal Misconception by Matthew Connelly. A good read, which looks at the history of population control across the globe.)