That's the official story, yes, which depends on KGB assertions that "he knew nothing." The official story also says Butterfield was never CIA either.
McMahon/Moynihan certainly took pride in the '60 downing of Powers, and the disruption of the Eisenhower-Krushchev summit, ensuring that it was recorded in the time capsule at the new building in Langley. https://www.cia.gov/readingroom/document/cia-rdp88g00186r000800950010-3
And Epstein, a close confident of Moynihan, suggested otherwise regarding Oswald:
https://content.time.com/time/subscriber/article/0,33009,919345,00.html
Epstein "weaves a skein of circumstantial evidence suggesting that Oswald learned key performance data on the CIA's U-2 plane while serving as a Marine radar controller at Atsugi, Japan, in 1957, and that he provided information to the Soviets either then or upon his defection to Russia in 1959. Oswald's information, the book suggests, enabled the Soviets to redesign their rocket-guidance systems so as to knock CIA Pilot Gary Powers out of the air over the Soviet Union on May 1, 1960."
The significance of these events is that by October 1962, CIA with NRO, had a monopoly on overhead reconnaissance, having displaced the USAF thanks to Harold Talbott (uncle of Strobe Talbott of TIME and more recently Broookings and the Steele Dossier), by which they (the CIA) could scare the bejesus out of presidents and the world with, yes, inflated threats of nuclear annihilation.
https://nypost.com/2021/11/08/turley-calls-brookings-institution-steele-dossier-nexus/