Think of PKI like a passport system.

The Certificate Authority is the government issuing passports. The digital certificate is your passport.

The public key is your visible identity.

The private key is your fingerprint - unique to you and impossible to transfer.

Border control does not know you personally. But they trust your passport because they trust the government that issued it.

That is exactly how your browser decides who to trust on the internet.