The mechanism that makes the frontier bend outward, offering something for nothing, is correlation. When two assets are less than perfectly correlated, their combined volatility is less than the weighted average of their individual volatilities, because their movements partly offset. Push that across many holdings and a portfolio can reach a given expected return with markedly less risk than any single holding carries. This is what makes diversification, in Markowitz's own framing, close to a free lunch: risk that comes from any single company (idiosyncratic risk) can be diversified away almost entirely, leaving only the market risk that moving together cannot remove. Modern portfolio theory is the formal argument for why broad diversification works, and it underlies the case for holding many assets rather than a favored few.
The theory's honest weaknesses are in its assumptions and its inputs. It assumes investors care only about the mean and variance of returns, which means it treats upside and downside volatility identically and ignores the possibility of rare, severe losses that a variance figure does not capture. It assumes those inputs, expected returns, volatilities, and the full grid of correlations between every pair of assets, are known, when in practice they must be estimated, almost always from historical data that need not repeat. Small errors in the estimated inputs can swing the "optimal" portfolio wildly, a fragility that has generated a large literature on making the outputs more robust. And the correlations the theory leans on are themselves unstable, tending to rise toward one in a crisis, so the risk reduction the model computes in calm conditions can partly vanish in a crash.
Modern portfolio theory is nonetheless the intellectual root of most of mainstream investing practice. The idea that a diversified, risk-managed portfolio beats a collection of individually chosen bets, the use of asset allocation as the central decision, and the extension into the capital asset pricing model (which adds a risk-free asset and a market portfolio to the same picture) all descend from it. Its limitations argue for humility about precise optimization, not for abandoning diversification, which is the part of the theory that has held up best.