The core idea

The connection is a scarce resource.

Opening a database connection is expensive and databases allow only so many. How your app manages connections decides its ceiling under load.