Home
>
Topics
>
OpenAI

Top 25 OpenAI articles on Substack

Latest OpenAI Articles


OpenAI Rules the Changes But Meta Changes the Rules

An analysis on Meta’s master plan and OpenAI’s masterpiece
A blog about AI that’s actually about people Meta has put the entire AI startup ecosystem against the ropes. They’ve released the two smaller versions of the Llama 3 family (8B and 70B-parameter dense models) and have given us a glimpse at the large version, a 405B dense model that although still training, is already showing
Alberto Romero ∙ 35 LIKES
Paul Toensing
Good job doing your homework, as this allows you to make some very good quality contracture. I’m personally hoping that GPT4 will eventually become free because my business model will be greatly assisted by that development. I’m not sure what the odds are, but of course, if we have the momentum of progress on our side, then it shouldn’t take forever.
Camino
Gracias. Muy interesante.

What I Read This Week...

Google's Deepmind releases a new biology prediction tool, Apple is finalizing a deal with OpenAI, and more than a third of 18-24 year-olds reported no income in 2022
Watch All-In E178 Read our latest deep dive into semiconductors Caught My Eye… Google’s DeepMind has released an improved version of its biology prediction tool AlphaFold. While Google’s previous model amazed the research community with its ability to predict protein structures, Google’s latest iteration can predict the structures and interactions of nearl…
Chamath Palihapitiya ∙ 65 LIKES
Yuri Bezmenov
Shocking stat about Gen Z. We all need to mentor them to be victors not victims. These charts show that the DEI/ESG administrative state in education and healthcare is making us all poorer, sicker, and dumber: https://yuribezmenov.substack.com/p/fire-dei-esg-hr-commissar-administrative-bloat
BMS Capital
Great list, do you think the drop in the young workforce is due to the polarisation of 'get rich quick' and the 'easy' money that can be made online?

Brace for Impact: Here Comes the "Cram Down"

Upcoming Edtech Happy Hour Events, ASU+GSV 2024 Session Overviews, US Newspapers Sue OpenAI, Coursera and Chegg Stock Down, and more!
Brace for Impact: Here Comes the “Cram Down” By Ben Kornell
Sarah Morin, Ben Kornell, and Alex Sarlin ∙ 4 LIKES
Matt Rubins
Ben - this is so insightful and so true. Twain said "history doesn't repeat itself, but it often rhymes". I've lived through three of these cycles now - the S&L crisis in '90-93, the dot com and telecom winter from '01 to '04, and then Global Financial Crisis from '08-'11. Every time we go through the same cycle. When a bubble bursts, during the first year people believe that a recovery is right around the corner. It'll be fine! The second year, they realize this may take a while longer and that they need to start cutting costs to extend the runway and avoid exposing themselves to "market pricing discovery". When they run out of moves, they reach the capitulation stage and that's when the dreaded "inside down round" happens. People start to read the deal docs and understand how weighted average anti-dilution provisions really work, what discounts on notes and SAFEs really do to founder economics, and how pay to play provisions work. It's ugly. The companies that get through this phase quickly, or even better proactively in the first two years, are well positioned to be acquirors of both market share and weaker competitors. These cycles typically last 4 years and we're about 18-24 months into this one.
I'm very optimistic about the future. We're seeing strong revenue growth in our portfolio and the long term trends underlying the digitation of education and alternative ways to upskill the workforce are very much intact. It just takes time, but anyone who's been around education for a long time knows that everything takes time in our business.

OpenAI GPT-4o: The New Best AI Model in the World. Like in the Movies. For Free

Everything you need to know (so far)
A blog about AI that’s actually about people OpenAI has delivered. In just a brief 25-minute live event they’ve changed the landscape completely. Here’s the image that best reflects why:
Alberto Romero ∙ 68 LIKES
Pascal Montjovent
Kudos for the quick turnaround on this in-depth piece about GPT-4o. It's impressive how you've captured the essence of this release, highlighting not just the technological advancements, but also the economic and societal implications, with such speed and clarity. Your ability to distill complex developments into an engaging narrative stands out. Once again.
Paul Toensing
Your crystal ball prediction from this last Saturday was fantastic Alberto! Now a couple of dumb questions: 1). Will this mean that everyone can access the GPT store via either 4 or 4o? 2) Will this multimodality change the very nature of the tools that we can create on the GPT store? The first question has great bearing on my new leaf fledgling business, which is to tap the power of custom GPTs. I always worried about perspective clients barking at the $20 a month. Is that now a done deal?

OpenAI fluffs its lines as model collapse makes a mockery of its flagship

Leadership in AI is back up for grabs as Chat GPT-4o fails to advance, sending Microsoft, Google, and Apple, scrambling to gain ground...
Before I get to the big news of the day out of OpenAI, I have a favour to ask. I publish most of my insights for free, because I believe the facts in them are important enough to need as large an audience as possible, but my work isn’t free. Future Media is a reader-supported publication. To receive new posts and support my work, consider becoming a free…
Ricky Sutton ∙ 2 LIKES

Last Week in AI #269: Better evals for multimodal AI, new OpenAI lawsuits, Meta's AI ads tool troubles, AI startups focus on enterprise, and more!

Reka AI releases Vibe-Eval, 8 US newspapers sue OpenAI, Meta's AI ads tool's overspending problem, AI startups are pivoting to enterprise customers
Top News Vibe-Eval: A new open and hard evaluation suite for measuring progress of multimodal language models Reka AI introduces Vibe-Eval, a new evaluation suite designed to measure the progress of multimodal language models. Researchers from the company have created a set of challenging prompts to test the capabilities of these models, particularly focu…
Last Week in AI ∙ 5 LIKES

Hot take on OpenAI’s new GPT-4o

GPT-4o hot take: • The speech synthesis is terrific, reminds me of Google Duplex (which never took off). but • If OpenAI had GPT-5, they have would shown it. • They don’t have GPT-5 after 14 months of trying. • The most important figure in the blogpost is attached below. And the most important thing about the figure is that 4o is not a lot different from Tur…
Gary Marcus ∙ 95 LIKES
Michelangelo D'Agostino
As someone who builds on top of these API's, I think you're underestimating how big of a deal the drastically reduced latency is. Yes the evals look like diminishing returns but the latency and cost improvements are drastic.
Gerben Wierda
Spot on. The ways in which it becomes more convincing that there is actual understanding seem to outpace actual progress on understanding.
In the meantime Sam discusses UBC when GPT-7 arrives. Which is all too much messianic prophet for my taste.
Human intelligence by the way is also amazing as well as often pretty dumb, so who are we to point fingers?

The Sam Altman Playbook

Fear, The Denial of Uncertainties, and Hype
How do you convince the world that your ideas and business might ultimately be worth $7 trillion dollars? Partly by getting some great results, partly by speculating about unlimited potential, and partly by downplaying and ignoring inconvenient truths.
Gary Marcus ∙ 149 LIKES
John Richmond
Sam is a pseudo-philosopher in a world that has forgotten how to think critically. Thanks for this. Best Gary thus far. Look forward to more.
Raul I Lopez
“all of this has happened before. all of this will happen again.”
Yep, I’ve been there. Working on AI research in 1990-1991, just before the second AI Winter.

Met Gala Not Dead, But Decaying

The Gala itself has a new theme, a new carpet design, and varied guests each year, but has become rather predictable.
Before the Met Gala Monday night, Anna Wintour apologized for “confusion” over the theme. The Costume Institute exhibition at the Metropolitan Museum of Art that the Gala opens and raises money for is Sleeping Beauties: Reawakening Fashion, but the dress code was “The Garden of Time.” Anna said on
Amy Odell ∙ 147 LIKES
Anne Hjortshøj
It all seemed so joyless.
J.W.
I wonder if part of the reason is that that the event has outgrown itself in a specific kind of way. When you compare it to the Oscars, for instance, there is a point to it all (the actual awards) that the public is part of, because they can view the entire event. The Met Gala just feels so disconnected now because you know the vast majority of attendees don't care about museums (some of them probably don't even know the difference between the Met and MoMA, I'm guessing) or even fully understand why they are there. So it all just feels kind of fake, and the public isn't allowed inside for the party, so it winds up feeling very hollow, despite the absurd star power on the red carpet.
When it was more of a society event, there was a perception of authenticity, because those attending seemed to have a true interest in the institution of the Met. It felt like more of a NYC-specific type of thing that was more closely connected to the museum. I am not sure if any of this made sense, it's kind of word salad, but tldr: the gala is too big, too corporate, and too phony-feeling now to be relevant.

Tom White
"What if this was more common? Great writing is precious enough that I wish we had multiple interpretations of most great works. It would be a great way to see the evolution of artists."
Yes! Mark Twain on Jane Austen is a good (read as: hilarious) place to start: In his extensive correspondence with fellow author and critic William Dean Howells, Mark Twain seemed to enjoy venting his literary spleen on Jane Austen precisely because he knew her to be Howells’ favorite author, In 1909 Twain wrote that “Jane Austin” [sic] was “entirely impossible” and that he could not read her prose even if paid a salary to do so. Howells notes in My Mark Twain (1910) that in fiction Twain “had certain distinct loathings; there were certain authors whose names he seemed not so much to pronounce as to spew out of his mouth...
Rather than pitying Twain when he was sick, Howells threatened to come and read Pride and Prejudice to him.
Twain marveled that Austen had been allowed to die a natural death rather than face execution for her literary crimes. “Her books madden me so that I can’t conceal my frenzy,” Twain observed, apparently viewing an Austen novel as a book which “once you put it down you simply can’t pick it up.” ... In a letter to Joseph Twichell in 1898, Twain fumed, “I have to stop every time I begin. Everytime I read “Pride and Prejudice” I want to dig her up and beat her over the skull with her own shin-bone.” From: https://www.vqronline.org/essay/barkeeper-entering-kingdom-heaven-did-mark-twain-really-hate-jane-austen


Last Week in AI #268: Gen AI for gene editing, Moderna partners with OpenAI, model releases from Microsoft and Snowflake, and more!

Gen AI used to generate new gene editors like CRISPR, Moderna's internal ChatGPTs, Microsoft releases Phi-3-mini LLM that can run on a phone, Snowflake open sources enterprise LLM
Top News Generative A.I. Arrives in the Gene Editing World of CRISPR Generative AI, which have already revolutionized areas such as art and programming, are now making significant strides in biotechnology. A new A.I. system developed by the Berkeley-based startup Profluent has been designed to create blueprints for novel gene editors by employing methods …
Last Week in AI ∙ 14 LIKES

What to Make of GPT-4o

The latest OpenAI algorithm launched with great promise. What are the impacts of the latest GPT algorithm?
Is the GPT-4o algorithm a glass half full of promise? Image created with Midjourney. OpenAI announced a new flagship algorithm GPT-4o that can “reason” across audio, vision, and text in real time. Like many OpenAI releases, yesterday’s announcement of
Geoff Livingston ∙ 1 LIKES
Paul Chaney
Thanks for the detailed insights, Geoff. I appreciate your reasonsed thinking about the improvements and new capabilities. I tried it yesterday and found it to be faster (even with heavy loads following the announcement). I'm wondering if I should continue paying for the Plus version, though.

LWiAI Podcast #165 - Sora challenger, Astribot's S1, Med-Gemini, Refusal in LLMs

China unveils Sora challenger able to produce videos from text similar to OpenAI tool, Capabilities of Gemini Models in Medicine, and more!
Our 165th episode with a summary and discussion of last week's big AI news! Email us your questions and feedback at contact@lastweekin.ai and/or hello@gladstone.ai Subscribe Apple Podcasts Spotify YouTube RSS Timestamps + links: Tools & Apps (00:01:27)
Last Week in AI ∙ 5 LIKES
Stash of Code
There's a fierce and interesting review of Github Copilot Workspace there:
Stash of Code
The link to "Better & Faster Large Language Models via Multi-token Prediction" should be:

GC, a16z Capture 44% VC fundraising💰, Massive Acquisitions in Software Startups 🛒, Network Effects🕸️

Welcome to The VC Corner, your weekly dose of Venture Capital and Startups to keep you up and running! 🚀 You can now become a premium subscriber and read the full guest posts I share on The VC Corner. Next Saturday, I will have Peter Walker, head of insights at Carta, publishing in my newsletter a deep dive into actual VC Valuations
Ruben Dominguez Ibar ∙ 17 LIKES
Money for Entrepreneurs
So valuable, as always!

OpenAI's GPT-4o and Partnership with Apple 🍎

Mira Murati was magical, not sure about all of these accessibility upgrades.
Audio Introduction 🎧 0:54 Hello Everyone, OpenAI had a Spring Update event the day before Google I/O begins, today as I write this on May 13th, 2024. It comes at an awkward time for Google, that lost market share as Apple’s talks with OpenAI have gone well to bring GPT-4o’s Voice to presumably, the upcoming iOS 18 and iPhones of 2025.
Michael Spencer ∙ 35 LIKES
Riley Tom
Definitely waiting for Siris new update, as well as integration into some big time video games and VR software. Then this takes off to a new level, albeit more niche than these general purpose model, but way more immersive
Oguz Erkan
That’s a very comprehensive take on the Michael. As you said I am not sure whether OpenAI will get the voice assistant right but I am satisfied for one reason: Ability to solve easy math problems.
This is significant because basically what differs AGI from the current models is next-token-prediction.
Current models lack this, if the question wasn’t included in their training data they simply can’t solve it. I am not telling it can’t provide an answer, it will and these answers will sometimes be true, but it won’t get that answer by applying logic predicting the outcome.
The questions illustrated were too basic so they could already be included in the training data. But if they were not included in the data as a block and the mode can solve a basic math problem like 1+2+7+3+5+12+33+17=? then AGI is basically just building on this.

☁️ Amazon: Wild Margin Expansion

AI requires billions in Capex but it looks like money well spent
Welcome to the Friday edition of How They Make Money. Over 100,000 subscribers turn to us for business and investment insights. In case you missed it: 🚖 Tesla: Robotaxi Pivot ♾ Meta: The Anti-Apple 🔎 Google: "A Positive Moment" 🍿 Netflix: Engagement Machine
App Economy Insights ∙ 58 LIKES

Microsoft and OpenAI’s increasingly complicated relationship

An AI Soap Opera in the making?
You might think that Microsoft owns 49% of OpenAI. But as far as I understand it doesn’t. It has a right to about 49% of a for-profit subsidiary of OpenAI’s profits, up until a very complex point that may require litigation to resolve, but the for-profit hasn’t made any profits, and the for-profit is owned by a non-profit. And I’ll be damned if I can ac…
Gary Marcus ∙ 61 LIKES
Gerben Wierda
Is "it's complicated" a civilised way to say 'clusterfuck'? Or might all of thus mean that OpenAI has handed Microsoft the means to fill whatever mini-'moat' OpenAI had? Did OpenAI give away whatever crown jewels they had in that Microsoft deal that got them the compute they needed? Definitely intriguing.
Ko
Relation"shop" haha is that deliberate?

Autism & the Internet will defeat the Monoculture

Or why the most original ideas in the coming decades will come from the Internet
“Is the Internet the Enemy of Progress?”, asks Ross Douthat in one of his latest columns. The answer is an emphatic Yes. For Douthat this is just a symptom of a more widespread disease: according to him, the Internet has destroyed something deeper and more important: the diversity of human thought itself. He goes on to link this rise of a
Ruxandra Teslo ∙ 85 LIKES
jseliger
"Among these strengths I count their propensity to question mainstream cultural norms: precisely what one needs in order to challenge the Monoculture"
Given my situation I think of challenges to the healthcare establishment, most notably during COVID; in Jan and Feb 2020, randoms on Twitter like Balaji were far more right than the healthcare establishment mainstream, since Twitter randoms were warning about the potential for a pandemic while public health authorities were downplaying that risk. Neurodivergent types were calling for masking when the mainstream health authorities were still (wrongly) saying masking is ineffective.
In the U.S., the FDA's slowness to approve vaccination was wrong, and led to thousands if not hundreds of thousands of extra deaths. While outsiders called for challenge trials, the FDA refused to approve them.
After mass vaccination, much of the mainstream wanted to continue policies like closing schools, which was also wrong. "Vax and relax" was the right way to go, and relatively few mainstream types got this right.
Today the FDA continues to slow treatments for fatal diseases, like the cancer I have, leading to (again) thousands if not millions of premature deaths: https://jakeseliger.com/2024/01/29/the-dead-and-dying-at-the-gates-of-oncology-clinical-trials/. I first read about ideas related to the FDA's malfeasance in Marginal Revolution, not anticipating that they'd become so germane to my own life.
While the rest of the culture plays various kinds of follow-the-leader (one can see this in the left- and right-wing reactions to e.g. COVID, or vaccines more generally), a lot of the neurodivergent people are trying to figure out what's actually true.
"it’s probably no wonder that rationalism comes with a certain skepticism of established institutions — with the good and bad that this entails"
One intellectual danger some people indulge in goes something like this: 1. public health / the FDA are wrong about some things, so therefore 2. anything public health / the FDA / the medical establishment argues for is wrong. It's important to avoid becoming a default contrarian or nihilist: http://jakeseliger.com/2024/01/11/on-not-being-a-radical-medicine-skeptic-and-the-dangers-of-doctor-by-internet. I've gotten a fair number of comments and emails from people who like what I've said about the FDA and therefore think that special diets or supplements will cure cancer, when data do not in fact support that.
"rationalism has to be understood as a movement of autistics disaffected with existing institutions who care a lot and generate content"
Almost all of that content is written, too, which probably reduces its virality in an oral-video age.
"I know Robin Hanson thinks the Internet (or anything for that matter) won’t save us from our low fertility promoting Monoculture"
The failure to allow more housing construction through zoning restrictions indicates that we are collectively not even remotely serious about fertility. If we can't even do the low-hanging fruit then the stuff with more trade-offs is way out of bounds.
Iain Lim
I'm beginning to realize that instead of trying to achieve self-understanding through popular self-help and psychology books, what I really needed was insight into the autistic brain :) I'd never drawn the dots between feeling alienated and being skeptical of established institutions and accumulated knowledge. Or that my strong resistance to trying to become a lawyer may be due to "lower price elasticity", as opposed to a neurotypical reluctance to become a corporate sellout. This probably wasn't the intention of your post, but thanks for synthesising some of these very interesting insights.

What happened in Marketing: AI Ads for X & Meta, Reddit Search + Unusual partnerships

This Week: AI marries ad creative, Retail media hooks up with new partners and marketers blame Temu.
Happy Mother’s Day to everyone. If you are not a mother, give my wishes to your mother. Be Kind because marketing isn’t. Too many updates…. Hi, writing the newsletter takes time and efforts. If you do like to support my work. You can by choosing the option below to join the paid newsletter. (It’s your decision, I’m not your boss).
Jaskaran ∙ 7 LIKES
Thomas Rolfe
Lots happening in search and AI. I wonder if SEOs need to start thinking more in terms of being “found” on multiple platforms instead of optimising for search engines. Consumer behaviour and tech are colliding to broaden the search and consideration step in the funnel.
Jen D
Suuuuuper sad about Sparks & Honey-- incredible group of people truly dedicated to understanding the signals.


May 14

AI Has Changed Learning, Why Aren't We Regulating It?

This fall, our students will have free access to OpenAI's most powerful model each time they use ChatGPT. Educati…
Marc Watkins ∙ 22 LIKES
Steve Fitzpatrick
A couple of observations / reactions to Marc's post. 1) My sense is that most teachers have indeed moved on, whether for the reasons Marc said or for other, more pressing issues; 2) I'm not sure the free upgrade to the most powerful model is going to change the needle, either for teachers or students - many have not necessarily checked out, but they may not immediately see the improvement in the more advanced models which high frequency users take for granted; 3) administrators are mostly clueless and the tech folks who may be pushing for the kinds of regulatory concerns mentioned generally don't have the power or influence to put this on their plates; 4) the horse is already out of the barn and I fear it's already too late for most teachers to catch up given the ubiquity of products and speed with which change is occurring - the changes demoed by OpenAI yesterday were likely ignored by all but the most interested and curious educators; 5) perhaps this is the saving grace, but most students are clueless as well - on the plus side, I did an informal survey (you can view a copy of the survey here - https://docs.google.com/forms/d/e/1FAIpQLSe8Bz6ui--7LEkP7L3w3QSPYoAtS4rqZI56YDiPRL2yqW4P1Q/viewform?usp=sf_link) of our HS students and over 80 percent recognized that AI can take away from their learning experience. Only 1/3 claimed they have used it and most (more than 50%) said they did not use because it was against the rules or they were ethically opposed (60/40 split on those two issues). Granted, this is one small survey from an independent school and who knows how honest they were being, but the responses align with what I have been seeing, I would love to see more data across a wider spectrum of schools and students. Bottom line is I'm not sure I see a major change in use this fall barring even more advanced models emerging but I don't think that will do it either. One teacher recently emailed me whether AI was just a fad or she had to learn it. I fear that's the norm.
David Harold Chester
The useful information and knowledge being provided by the AI probably does not cover all the matters and details that the teacher is providing, so for the present, this personal method of teaching is still important.
In future when AI is more resourceful in what it can supply, the students will need to replace their gained knowledge about the subject of their study with a greater ability to operate the AI medium itself, and to use it for getting better knowledge. This strikes me as being at least as difficult as straight cources of their subject, because of how computer management is taught and how the limited power of AI can respond.
For example, when I ask a question, the Chatbot usually replies about the subject first appearing in my question, but pays little regard to the question itself!

🔮 Can the West wean off from China?; European startups; AI war rooms; fragile societies ++ #472

Hi, I’m Azeem Azhar. In this week’s edition, we explore China’s dominance of the battery supply chain. And in the rest of today’s issue: Need to know: GenAI as a GPT Is generative AI a general-purpose technology? We’ve long believed it to be one, and mounting evidence over the past year contributes to this position.
Azeem Azhar and Nathan Warren ∙ 23 LIKES


2023 Annual Letter

Social Capital Performance Summary To the supporters and friends of Social Capital: This is the sixth of our annual letters where we share our reflections, key observations, and learnings over the past year, including how the economic and technological trends of the year have shaped our thinking and our investment portfolio.
Chamath Palihapitiya ∙ 69 LIKES
Bradley Anderson
Thank you for sharing! I Have been reading all of these for years. My favorite one is still from a few years ago!
But as usual! Well done. Let’s go 2024