>> GOOD MORNING AND WELCOME TO

DEVDAY.

THANKS FOR BEING HERE IN SAN

FRANCISCO, THE CITY WHERE OPENAI

STARTED AND WHERE WE'RE

COMMITTED TO BUILDING THE FUTURE

OF AI.

IT'S BEEN ALMOST TWO YEARS SINCE

OUR VERY FIRST DEVDAY.

WE AND MOST IMPORTANTLY ALL OF

YOU, HAVE COME A LONG WAY SINCE

THEN.

BACK IN 2023, WE HAD 2 MILLION

DEVELOPERS AND 100 MILLION

WEEKLY CHATGPT USERS.

AND WE WERE PROCESSING ABOUT 300

MILLION TOKENS PER MINUTE ON OUR

API.

THAT FELT LIKE A LOT AT THE

TIME.

TODAY, 4 MILLION DEVELOPERS HAVE

BUILT WITH OPENAI.

AND MORE THAN 800 MILLION PEOPLE

NOW USE CHATGPT EVERY WEEK.

AND WE PROCESS OVER 6 BILLION

TOKENS PER MINUTE ON THE API.

AI HAS GONE FROM

SOMETHING PEOPLE PLAY WITH TO

SOMETHING PEOPLE BUILD WITH

EVERY DAY.

NOW BEFORE WE GET INTO ALL THE

ANNOUNCEMENTS, WE WANT TO DO

SOMETHING FUN.

ON THE SCREEN BEHIND ME ARE THE

NAMES OF DEVELOPERS IN THE ROOM

TODAY WHO'VE BUILT APPS ON OUR

PLATFORM THAT HAVE CROSSED SOME

INCREDIBLE MILESTONES -- 10

BILLION, 100 BILLION, EVEN A

TRILLION TOKENS PROCESSED.

LET'S GIVE THEM A ROUND OF

APPLAUSE.

ON BEHALF OF ALL OF US AT

OPENAI, THANK YOU.

YOU'RE THE ONES PUSHING THE

FUTURE FORWARD.

AND SEEING THIS MAKES ME SO

OPTIMISTIC ABOUT WHAT COMES

NEXT.

SO WHILE IT'S EXCITING TO

CELEBRATE HOW FAR WE'VE COME

ALREADY. WE'RE STILL SO EARLY

ON THIS JOURNEY.

AND TODAY, WE'RE GOING TO FOCUS

ON WHAT MATTERS MOST TO YOU:

HOW WE'RE MAKING IT EASIER TO

BUILD WITH AI. WE'VE BEEN

LISTENING TO DEVELOPERS━HEARING

WHERE YOU'RE GETTING STUCK, AND

WHERE YOU WANT TO BUILD NEXT.

WE HAVE FOUR THINGS FOR YOU

TODAY.

WE'RE GOING TO SHOW YOU HOW

WE'RE MAKING IT POSSIBLE TO

BUILD APPS INSIDE OF CHATGPT.

AND HOW WE CAN HELP YOU GET

A LOT OF DISTRIBUTIONS.

WE'RE GOING TO SHOW YOU HOW

BUILDING AGENTS IS GOING TO BE

MUCH FASTER, AND BETTER.

YOU'LL SEE HOW WE'RE MAKING IT

EASIER TO WRITE SOFTWARE, TAKING

ON THE REPETITIVE PARTS OF

CODING SO YOU CAN FOCUS ON

SYSTEMS AND CREATIVITY.

AND UNDERNEATH ALL OF THIS,

WE'LL GIVE YOU UPDATES TO MODELS

AND APIS TO SUPPORT WHATEVER

YOU'RE BUILDING.

THIS IS THE BEST TIME IN HISTORY

TO BE A BUILDER.

IT HAS NEVER BEEN FASTER TO GO

FROM IDEA TO PRODUCT.

YOU CAN FEEL THE ACCELERATION.

TO GET US STARTED, LET'S TAKE A

LOOK AT APPS INSIDE CHATGPT.

WE'RE BUILDING CHATGPT TO HELP

PEOPLE MAKE PROGRESS.

TO BE MORE PRODUCTIVE, MORE

INVENTIVE, AND TO LEARN FASTER.

WE ARE CONTINUOUSLY AMAZED BY

THE CREATIVE WAYS PEOPLE ARE

USING IT.

AND SINCE OUR FIRST DEVDAY,

WE'VE BEEN WORKING TO OPEN UP

CHATGPT TO DEVELOPERS.

WE'VE LAUNCHED CAPABILITIES LIKE

GPTS AND ADOPTED STANDARDS LIKE

MCP, MAKING IT POSSIBLE FOR

DEVELOPERS TO CONNECT CHATGPT TO

A WIDE VARIETY OF APPLICATIONS.

SOME OF IT WORKED.

SOME OF IT DIDN'T.

BUT WE'VE LEARNED A LOT.

AND TODAY, WE'RE OPENING UP

CHATGPT FOR DEVELOPERS TO BUILD

APPS INSIDE OF CHATGPT.

THIS WILL ENABLE A NEW

GENERATION OF APPS THAT ARE

INTERACTIVE, ADAPTIVE AND

PERSONALIZED THAT YOU CAN CHAT

WITH.

TO BUILD THEM, WE'RE LAUNCHING A

NEW APPS SDK, NOW AVAILABLE IN

PREVIEW.

START BE TODAY.

WITH THE APPS SDK, YOU GET THE

FULL STACK, YOU CAN CONNECT YOUR

DATA, TRIGGER ACTIONS, AND

RENDER A FULLY INTERACTIVE UI.

AND MORE.

THE APPS SDK IS BUILT ON MCP.

YOU HAVE FULL CONTROL OVER YOUR

BACKEND LOGIC AND FRONTEND UI.

WE'VE PUBLISHED THE STANDARD SO

ANYONE CAN INTEGRATE THE APPS

SDK. WHEN YOU BUILD WITH THE

APPS SDK, YOUR APPS CAN REACH

HUNDREDS OF MILLIONS OF CHATGPT

USERS.

THIS WILL BE A BIG DEAL FOR HOW

DEVELOPERS RAPIDLY SCALE

PRODUCTS.

[ APPLAUSE ]

>> THANK YOU. YOU'RE WELCOME.

IF A USER IS ALREADY SUBSCRIBED

TO YOUR EXISTING PRODUCT THEY

CAN LOG IN, RIGHT FROM THE

CONVERSATION.

IN THE FUTURE, WE'LL SUPPORT

MULTIPLE WAYS TO MONETIZE,

INCLUDING THE NEW AGENTIC

COMMERCE PROTOCOL THAT OFFERS

INSTANT CHECKOUT RIGHT INSIDE

CHATGPT.

LET'S TAKE A LOOK AT A FEW

EXAMPLES.

WHEN SOMEONE'S USING CHATGPT,

THEY'LL BE ABLE TO FIND AN APP

BY ASKING FOR IT BY NAME.

FOR EXAMPLE, YOU COULD UPLOAD A

SKETCH OF A PRODUCT FLOW TO

CHATGPT AND SAY "FIGMA, TURN

THIS SKETCH INTO A WORKABLE

DIAGRAM." THE FIGMA APP WILL

RESPOND AND COMPLETE THE ACTION.

AND YOU'LL BE ABLE TO LAUNCH

FIGJAM FROM CHATGPT IF YOU WANT

TO ITERATE FURTHER.

WE'RE ALSO MAKING APPS

DISCOVERABLE RIGHT IN THE

CONVERSATION.

WHEN A USER ASKS FOR SOMETHING

WE CAN SURFACE A RELEVANT APP AS

A SUGGESTION.

SO WHEN A USER SAYS THEY NEED A

PLAYLIST FOR THEIR PARTY THIS

WEEKEND, CHATGPT CAN RECOMMEND

BUILDING IT IN SPOTIFY.

IT'S AN EASY WAY TO FIND THE

RIGHT APP AT THE RIGHT TIME.

AND GIVES DEVELOPERS A WHOLE NEW

WAY TO GET DISCOVERED.

NOW I WANT TO INVITE ALEXI TO

THE STAGE TO SHOW YOU A LIVE

DEMO.

[ APPLAUSE ]

>> I'M ALEXI, A SOFTWARE

ENGINEER ON CHATGPT WHO HELPED

BUILD THIS.

I'M EXCITED TO SHOWCASE SOME OF

THE FIRST APPS USERS WILL BE

ABLE TO INTERACT WITH DIRECTLY.

THE MAGIC OF THESE APPS IS

COMBINING THEIR RICH INTERACTIVE

VISUALS WITH THE POWER OF

CHATGPT.

LET'S START WITH COURSERA.

LET'S SAY I WANT TO LEARN ABOUT

UX DESIGN.

I CAN ASK THE COURSERA APP IN

CHATGPT TO HELP ME LEARN ABOUT

THIS.

COURSERA, TEACH ME SOMETHING

ABOUT MACHINE LEARNING.

SINCE THIS IS MY FIRST TIME

USING COURSERA IN CHATGPT, I'LL

NEED TO CONSENT TO CONNECT.

THE NEXT TIME I USE IT, I'LL BE

ABLE TO DIVE IN IMMEDIATELY.

YOU'LL NOTICE I ASKED CHATGPT

FOR THE COURSERA APP DIRECTLY,

BUT CHATGPT CAN ALSO SUGGEST

APPS IF RELEVANT TO THE

CONVERSATION.

APPS IN CHATGPT ARE DISPLAYED

INLINE WITH THE CONVERSATION AND

CAN SUPPORT ANYTHING THAT YOU

CAN RENDER ON THE WEB, LIKE

VIDEO SHOWN HERE.

APPS SDK ALSO SUPPORTS

PICTURE-IN-PICTURE OR EXPANDING

TO A FULLSCREEN VIDEO LAYOUT.

NOW THAT I HAVE MY COURSE UP,

LET'S PLAY THE VIDEO.

PLAYING THE VIDEO IMMEDIATELY

PINS IT TO THE TOP OF MY SCREEN

WHICH IS REALLY HELPFUL BECAUSE

YOU CAN ACCESS YOUR CONVERSATION

WHILE WATCHING THE VIDEO.

LETS SAY I WANT TO GO A LITTLE

DEEPER ON SOMETHING MENTIONED IN

THE VIDEO.

I CAN ASK CHATGPT CAN YOU

EXPLAIN MORE ABOUT WHAT THEY ARE

SAYING RIGHT NOW.

APPSSDK PROVIDES AN API TO

EXPOSE CONTEXT BACK TO CHATGPT

FROM YOUR APP, ENSURING THAT THE

MODEL ALWAYS KNOWS ABOUT EXACTLY

WHAT YOUR USER IS INTERACTING

WITH.

WE'RE CALLING IT TALKING TO APPS

AND IT'S PART OF THE MAGIC HERE.

I'M SUPER EXCITED ABOUT HOW

LEARNING WITH CHATGPT, ONE OF

OUR TOP USE CASES, IS CONTINUING

TO GET BETTER.

WITH APPS AND THE APPS SDK YOU

CAN UNLOCK RICHER EDUCATION

EXPERIENCES FOR USERS AROUND THE

WORLD.

THIS EXPLAINS THE STRUCTURE IS

TALKING ABOUT DATA PREPARATION

STEPS BEFORE TRAINING AND

MACHINE LEARNING MODEL. I DON'T

NEED TO EXPLAIN. CHATGPT SEES

IT RIGHT AWAY. I'LL BE ABLE TO

CONNECT THE COURSERA APP AND

DIRECTLY ENGAGE WITH THE VIDEO

THROUGH TEXT WITHIN MY CHATGPT

CONVERSATION.

PRETTY COOL.

USERS ALSO LOVE BEING CREATIVE

IN CHATGPT.

HERE I HAVE A CONVERSATION

WHERE I'VE BEEN BRAINSTORMING

SOME IDEAS TO HELP MY YOUNGER

SIBLING'S DOG WALKING BUSINESS.

WE'VE GONE BACK AND FORTH A FEW

TIMES.

I'M PRETTY HAPPY WITH SOME OF

BUT LET'S TAKE THIS NAME.

CANVA, MAKE ME A PORTFOLIO WITH

THIS NAME. I WANT IT TO BE

COLORFUL, WHIMSICAL AND BRIGHT

AND ASK COURSERA FOR A TYPING

COURSE, PREFER SANS SERIF FONT.

CANVA IS GREAT AT CREATING

ASSETS LIKE THIS, AND NOW YOU

CAN KICK IT OFF DIRECTLY FROM

CHATGPT.

WHETHER YOU'RE MAKING MARKETING

ASSETS FOR OPENAI OR JUST A FUN

DEMO FOR DEVDAY.

CANVA IS RIGHT THERE WITH YOU IN

THE CONVERSATION AS YOU WORK.

APPS SDK IS BUILT ON MCP, AN

OPEN STANDARD WE'VE LOVED

BUILDING ON AT OPENAI.

IF YOU HAVE AN EXISTING MCP IT'S

REALLY QUICK TO ENHANCE IT WITH

THE APPS SDK, ALL YOU HAVE TO DO

IS ADD A RESOURCE THAT RETURNS

AN HTML TEMPLATE, AND THE APP

WOULD BE ABLE TO UP EVERYWHERE

CHATGPT IS DISTRIBUTED, LIKE WEB

OR MOBILE.

AS YOU CAN SEE, THIS IS A LIVE

DEMO SO WE'RE EXPERIENCING A

LITTLE BIT OF LATENCY. WE SEE

THEM IN LINE LIKE THE VIDEO AS

WELL AS CHATGPT EXPLAINING WHAT

IT'S DONE. WE CAN EXPLORE

ANOTHER MODALITY IN APPS SDK,

FULL SCREEN.

I CAN OPEN A SPECIFIC POSTER TO

SEE IT IN MORE DETAIL, AND EVEN

FOLLOW UP IN CHATGPT TO REQUEST

CHANGES.

LIKE WITH OUR IMAGE GENERATION

EXPERIENCE.

BUT SINCE WE'RE IN SAN

FRANCISCO, AND IT'S DEVDAY,

LET'S ASK CANVA TO CONVERT THESE

INTO A PITCH DECK.

I CAN SAY CANVA PLEASE MAKE THIS

POSTER INTO A PITCH DECK, WE'RE

TRYING TO RAISE A SEED ROUND FOR

DOG WALKING.

EYE SEND THAT OFF AND NOW CANVA

WILL MAKE A SLIDE DECK. WE'LL

MOVE ON TO SHOW ONE MORE DEMO

WHILE THAT LOADS. SA

SAY THE DOG WALKING BUSINESS IS

GOING REALLY WELL, AND WE WANT

TO EXPAND TO ANOTHER CITY!

I CAN --

I CAN ASK CHATGPT WHERE WE

SHOULD EXPAND.

CHATGPT KNOWS WHAT WE'VE BEEN

TALKING ABOUT. SUPER

ENTHUSI

ENTHU

ENTHUSIASTICALLY SAYS

PITTSBURGH. I CAN INVOKE ZILLOW

TO SAY SHOW ME HOMES FOR SALE

THERE. NOW IT'S TALKING TO

ZILLOW TO FETCH THE LATEST DATA

AND GET AN INTERACTIVE MAP

EMBEDDED IN CHATGPT. WE HAVE

OUR MAP, WE'RE JUST LOADING --

BOOM, WE HAVE A BACKUP OF HOMES

HERE.

[ APPLAUSE ]

ALSO LOOKS LIKE OUR SLIDE DECKS

ARE DONE SO BACK TO THOSE IN A

MOMENT. THIS MAP IS A LITTLE

HARD TO SEE IN THE INLINE VIEW

SO I CAN CLICK A HOME AND OPEN

IT FULL SCREEN. WE HAVE MOST OF

THE ZILLOW EXPERIENCE EMBEDDED

IN CHATGPT AND REQUEST A TOUR

AND THE ACTIONS YOU EXPECT FROM

ZILLOW. WE HAVE A LOT OF

OPTIONS AND IT'S HARD TO PARSEE

SO I ASK CHATGPT FILTER THIS TO

JUST THE THREE BEDROOM HOMES

WITH A YARD. BECAUSE THE APP IS

IN FULL SCREEN IT UPDATES THE

DATA THAT'S PROVIDED TO IT

WITHOUT NEEDING TO CREATE A NEW

INSTANCE. WE SEE CHATGPT CAME

BACK, GET THE MESSAGE OVERLAYED,

I CAN VIEW MY CONVERSATION OVER

THE ZILLOW APP AND OWN IT TO THE

FULL HEIGHT. COOL. LET'S ZOOM

IN AND FIND A SPECIFIC HOME WE

MAY BE INTERESTED IN. NOW

BECAUSE THE ZILLOW APP IS

EXPOSING CONTEXT BACK TO CHATGPT

IT KNOWS WHAT I'M LOOK AT AND I

CAN ASK FOR MORE INFORMATION

ABOUT THE HOME LIKE HOW CLOSE IS

THIS TO A DOG PARK. CHATGPT IS

ABLE TO COMPOSE THE CONTEXT FROM

ZILLOW WITH OTHER TOOLS AT ITS

DISPOSAL LIKE SEARCH. IT'S ABLE

TO GIVE MORE INFORMATION ABOUT

THE HOME, FROM HERE I CAN INVOKE

OTHER TOOLS AND FIND OUT THE

AFFORDABILITY BUT IT PROVIDES

THE BEST ANSWER EVERY TIME.

THIS IS A GREAT EXAMPLE OF HOW

DYNAMIC AND EXPERIENCE WITH APPS

SDK CAN BE AND STARTED FROM AN

INLINE MAP AND WE'RE ABLE TO GO

BACK AND FORTH BETWEEN TALKING

TO THE APP AND ASKING CHATGPT

QUESTIONS OR USING THE ZILLOW

EXPERIENCE. LET'S CHECK BACK IN

ON THOSE SLIDE DECKS. SO IF I

POP OVER TO THIS CONVERSATION,

SEE CANVA GAVE US SOME OPTIONS

HERE. LIKE THE LOOK OF THIS

BLUE SO IF WE OPEN THAT UP, WE

SEE THE SLIDES IN FULL SCREEN

AND I CAN SEE ALL THE BEAUTIFUL

SLIDES THAT CANVA GENERATED FOR

ME. WHEN I'M READY I CAN --

[ APPLAUSE ]

>> JUST LIKE THE POSTERS I CAN

ASK FOR FOLLOW-UP EDITS AND WHEN

A

I'M READY I CAN OPEN THIS IN

CANVAS AND CLOSE THE SEED ROUND.

THE MAGIC OF APPS. WITH YOUR

FAVORITE PRODUCTS RESULTING IN

TRULY NOVEL EXPERIENCES. I'M SO

EXCITED TO KEEP BUILDING THIS

WITH ALL OF YOU. CAN'T WAIT TO

SEE WHAT YOU DO WITH IT.

[ APPLAUSE ]

[ CHEERS AND APPLAUSE ]

.

>> BACK TO SAM FOR MORE ON

APPS.

>> THANKS ALEXI.

IT'S HARD TO TYPE AND TALKING IN

FRONT OF A BUNCH OF PEOPLE AT

THE SAME TIME.

WE'RE EXCITED FOR YOU TO TRY OUT

THE APPS YOU SAW IN THE DEMOS

ALONG WITH A FEW MORE FOR THESE

LAUNCH PARTNERS.

THEY'LL BE AVAILABLE IN CHATGPT

TODAY.

AND WE'RE JUST GETTING STARTED.

WE'LL BE ROLLING OUT EVEN MORE

APPS FROM PARTNERS IN THE WEEKS

AHEAD.

FOR DEVELOPERS, APPS SDK IS

AVAILABLE IN PREVIEW TO START

BUILDING WITH TODAY.

OUR GOAL IS TO GET THIS IN YOUR

HANDS EARLY, HEAR YOUR FEEDBACK,

AND BUILD IT WITH YOU.

LATER THIS YEAR, DEVELOPERS WILL

BE ABLE TO SUBMIT APPS FOR

REVIEW AND PUBLICATION.

WE'LL ALSO RELEASE A DIRECTORY

USERS CAN BROWSE.

IN ADDITION TO DISCOVERY AND

CONVERSATION.

ANY APPS THAT MEETS THE

STANDARDS PROVIDED IN OUR

DEVELOPER GUIDELINES WILL BE

ELIGIBLE TO BE LISTED APPS THAT

MEET HIGHER STANDARDS FOR DESIGN

AND FUNCTIONALITY WILL BE

FEATURED MORE

PROMINENTLY-INCLUDING IN THE

DIRECTORY, AND, AS WE SHOWED,

SUGGESTED APPS IN CONVERSATIONS.

WE'VE PUBLISHED A DRAFT OF OUR

DEVELOPER GUIDELINES TODAY WITH

THE PREVIEW APPS SDK SO YOU'LL

KNOW WHAT TO EXPECT.

AND WE'LL HAVE MORE TO SHARE ON

MONETIZATION FOR APPS SOON.

AND LOVE YOUR FEEDBACK ABOUT

WHAT YOU WANT.

THIS IS GOING TO BE AN EXCITING

NEW CHAPTER FOR DEVELOPERS AND

CHATGPT USERS.

SO THAT WAS APPS. WE HOPE

EVERYONE LOVES IT.

[ APPLAUSE ]

>> OKAY.

NEXT UP, LET'S LOOK AT HOW WE'RE

MAKING IT MUCH SIMPLER TO BUILD

EFFECTIVE AGENTS.

AI HAS MOVED FROM SYSTEMS YOU

ASK, TO SYSTEMS THAT CAN DO A

LOT OF THINGS FOR YOU.

WE'RE STARTING TO SEE THIS

THROUGH AGENTS, SOFTWARE THAT

CAN TAKE ON TASKS WITH CONTEXT,

TOOLS, AND TRUST.

BUT FOR ALL THE EXCITEMENT

AROUND AGENTS, VERY FEW ACTUALLY

MAKE IT INTO PRODUCTION.

AND MAJOR USE.

IT'S HARD TO KNOW WHERE TO

START.

WHAT FRAMEWORKS TO TRUST.

AND IT'S A LOT OF WORK:

ORCHESTRATION.

EVAL LOOPS.

CONNECTING TOOLS.

BUILDING A GOOD UI. EACH OF

THESE LAYERS ADDS COMPLEXITY

BEFORE YOU EVEN KNOW IF THE IDEA

IS GOING TO WORK.

STILL, THERE'S A TON OF ENERGY,

AND THE OPPORTUNITY IS VERY

REAL.

WE'VE TALKED TO THOUSANDS OF

TEAMS WHO ARE BUILDING AGENTS TO

REIMAGINE HOW WORK GETS DONE.

WHAT WE CAN DO MAKE AGENTS

EASIER TO BUILD.

SO TODAY, WE'RE LAUNCHING

SOMETHING NEW.

SOMETHING FOR EVERY BUILDER THAT

WANTS TO GO FROM IDEA TO AGENT,

MUCH FASTER.

WE'RE EXCITED TO INTRODUCE,

AGENTKIT.

AGENTKIT IS A COMPLETE SET OF

BUILDING BLOCKS AVAILABLE IN THE

OPENAI PLATFORM DESIGNED TO HELP

YOU TAKE AGENTS FROM PROTOTYPE

TO PRODUCTION.

IT GIVES YOU EVERYTHING YOU NEED

TO BUILD, DEPLOY, AND OPTIMIZE

AGENTIC WORKFLOWS, FASTER, AND

WITH WAY LESS FRICTION.

EVERYONE FROM INDIVIDUAL

DEVELOPERS TO LARGE ENTERPRISES

WILL GET A LOT OF VALUE FROM

THIS.

WE'LL TALK ABOUT THE

CAPABILITIES NOW. AGENT BUILDER

IT A FAST VISUAL WAY TO DESIGN

THE LOGIC STEPS TEST FLOWS AND

SHIP IDEAS.

IT'S BUILT ON TOP OF THE

RESPONSES API THAT HUNDREDS OF

THOUSANDS OF DEVELOPERS ALREADY

USE.

SO IF YOU'VE USED OUR PLATFORM

BEFORE, YOU SHOULD BE FAMILIAR

WITH THE FOUNDATION.

SECOND IS CHATKIT.

WE'RE MAKING IT EASY TO BRING

GREAT CHAT EXPERIENCES RIGHT

INTO YOUR OWN APPS.

YOU GET A SIMPLE, EMBEDDABLE

CHAT INTERFACE THAT YOU CAN MAKE

YOUR OWN.

BRING YOUR BRAND, BUILD YOUR

WORKFLOWS, AND FOCUS ON WHAT

MAKES YOUR PRODUCT UNIQUE.

YOU CAN SEE IN THE VIDEO HERE

HOW CHAT CAN WORK ACROSS EACH

AGENT NODE, EVEN CALLING ON

TOOLS, TO FORM THE BEST

RESPONSE.

AND FINALLY, EVALS FOR AGENTS.

WE'RE SHIPPING NEW FEATURES

DEDICATED TO MEASURING THE

PERFORMANCE OF AGENTS.

YOU GET TRACE GRADING, TO

UNDERSTAND AGENT DECISIONS

STEP-BY-STEP.

YOU GET DATASETS, SO YOU ASSESS

INDIVIDUAL AGENT NODES.

WE'VE ADDED AUTOMATED PROMPT

OPTIMIZATION.

AND YOU CAN EVEN RUN EVALS ON

EXTERNAL MODELS DIRECTLY WITHIN

THE OPENAI EVALS PLATFORM.

IT'S EVERYTHING WE WISHED WE HAD

WHEN WE WERE FIRST BUILDING

AGENTS.

AND OF COURSE, AGENTS NEED

ACCESS TO DATA.

WITH OPENAI'S CONNECTOR

REGISTRY, YOU CAN SECURELY

CONNECT AGENTS TO YOUR INTERNAL

TOOLS AND THIRD-PARTY SYSTEMS

THROUGH AN ADMIN CONTROL PANEL

WHILE KEEPING EVERYTHING SAFE

AND UNDER YOUR CONTROL.

LET'S LOOK AT A COUPLE OF

EXAMPLES.

ALBERTSONS RUNS OVER 2,000

GROCERY STORES ACROSS THE U.S.,

WITH MORE THAN 37 MILLION PEOPLE

SHOPPING THERE EACH WEEK.

EACH STORE IS LIKE ITS OWN

LITTLE ECONOMY.

MANAGERS HAVE TO MAKE CONSTANT

DECISIONS.

PROMOTIONS, PRODUCT MIX,

DISPLAYS VENDORS.

IT'S A LOT.

SO ALBERTSONS BUILT AN AGENT

USING AGENTKIT.

NOW IMAGINE A SITUATION WHERE

SALES ARE UNEXPECTEDLY DOWN FOR

ICE CREAM.

32%.

BEFORE, THIS WOULD'VE KICKED OFF

A LONG PROCESS OF REPORTING,

SPREADSHEETS MEETINGS.

AN ASSOCIATE CAN JUST ASK THE

AGENT WHAT'S GOING ON.

THE AGENT LOOKS AT THE FULL

CONTEXT -- SEASONALITY,

HISTORICAL TRENDS, EXTERNAL

FACTORS -- AND GIVES A

RECOMMENDATION.

MAYBE IT'S TIME TO ADJUST THE

DISPLAY OR RUN A LOCAL AD.

LET'S LOOK AT ANOTHER AGENT.

HUBSPOT IS A CUSTOMER PLATFORM

USED BY HUNDREDS OF THOUSANDS OF

ORGANIZATIONS AROUND THE WORLD.

THEY USED AGENTKIT TO IMPROVE

THE RESPONSES OF BREEZE,

HUBSPOT'S AI TOOL, USING THE

CUSTOM RESPONSE WIDGET.

IN THIS EXAMPLE, A HUBSPOT

CUSTOMER, LUMA PLANTS, GETS A

QUESTION ABOUT WHY A PLANT MIGHT

NOT BE THRIVING IN ARIZONA.

IT USES THE BREEZE ASSISTANT TO

SEARCH ITS OWN KNOWLEDGE BASE,

LOOK UP LOCAL TREATMENTS FOR THE

STATE'S LOW HUMIDITY, PULLS IN

POLICY DETAILS, AND PIECES

EVERYTHING TOGETHER.

IT THEN OFFERS MULTIPLE

SOLUTIONS, INCLUDING A

RECOMMENDATION.

THIS IS INTELLIGENCE AT WORK

ACROSS DIFFERENT SOURCES, ALL

OPERATING TOGETHER TO DELIVER

SMART, USEFUL ANSWERS.

AND IT'S A GREAT EXAMPLE OF THE

KIND OF THING YOU CAN BUILD WITH

AGENTKIT.

WE HAVE A BUNCH OF GREAT LAUNCH

PARTNERS WHO HAVE ALREADY SCALED

AGENTS USING AGENTKIT.

AND IT'S AVAILABLE TO EVERYONE

STARTING TODAY.

SO LET'S SEE A DEMO OF HOW IT

WORKS.

I'LL PASS IT OFF TO CHRISTINA.

[ APPLAUSE ]

>> THANKS SAM!

HI EVERYONE, I'M CHRISTINA, AND

I WORK ON THE TEAM BUILDING

AGENTKIT.

TODAY, I WANT TO SHOW YOU HOW

AGENTKIT HELPS DEVELOPERS CREATE

AGENTS FASTER THAN EVER BEFORE.

YOU MAY HAVE ALREADY SEEN OUR

DEVDAY WEBSITE - THE SITE THAT

ALL OF YOU HAVE ACCESS TO AND

WHICH SHOWS EVERYTHING ABOUT

TODAY'S SCHEDULE.

BUT RIGHT NOW, IT'S JUST A

STATIC PAGE.

WHAT IF IT COULD ACTUALLY HELP

YOU NAVIGATE THE DAY AND POINT

YOU TO THE SESSIONS MOST

RELEVANT TO YOU?

WE'RE OPENAI, WE NEED TO HAVE AI

IN OUR DEVDAY SITE.

SO THAT'S WHAT WE'RE GOING TO

BUILD TOGETHER ━ AN AGENT,

POWERED BY AGENTKIT, DEPLOYED

RIGHT INSIDE THIS SITE.

TO MAKE THIS INTERESTING, I'M

GOING TO GIVE MYSELF 8 MINUTES

TO BUILD AND SHIP AN AGENT RIGHT

HERE IN FRONT OF YOU.

[ CHEERS AND APPLAUSE ]

YOU JUST HEARD HOW HARD IT IS TO

BUILD AN AGENT, SO THIS WILL BE

A CHALLENGE.

AND I'M GOING TO START THE CLOCK

TO KEEP ME HONEST.

WE HAVE A CLOCK GOING.

I'M STARTING IN THE WORKFLOW

BUILDER IN THE OPENAI PLATFORM.

INSTEAD OF STARTING WITH CODE,

WE CAN WIRE NODES UP VISUALLY.

AGENT BUILDER HELPS YOU MODEL

COMPLEX WORKFLOWS IN AN EASY AND

VISUAL WAY, USING COMMON

PATTERNS THAT WE'VE LEARNED FROM

BUILDING AGENTS.

HERE ON THE LEFT, WE'VE ALREADY

EXTRACTED THE COMMON BUILDING

BLOCKS.

FOR EXAMPLE TOOLS, HUMAN IN THE

LOOP, GUARDRAILS, AND LOGICAL

NODES.

I'M PLANNING ON BUILDING A

WORKFLOW THAT USES A SPECIALIZED

SESSION AGENT, AS WELL AS A MORE

GENERIC DEVDAY INFORMATION

AGENT.

I'M STARTING WITH AN AGENT TO

CATEGORIZE THE TYPE OF MESSAGE

COMING IN, WHETHER IT'S ASKING

ABOUT SESSION INFO OR SOMETHING

MORE GENERIC ABOUT DEVDAY.

I'VE ADDED AN IF/ELSE NODE TO

ROUTE BEHAVIOR BASED ON THAT

CLASSIFIER.

NEXT, I'LL CREATE THE SESSION

AGENT.

I'LL CALL THIS SESSION AGENT.

GIVE IT CONTEXT ABOUT GRABBING

INFORMATION ABOUT A SESSION.

AND THEN I CAN ADD IN VARIOUS

TOOLS, TODAY I ALREADY HAVE A

DOC WITH THE INFORMATION ABOUT

SESSION SO I'LL DROP THAT IN.

CALL THIS SESSION. AND ATTACH

IT. THIS HAS ALL THE

INFORMATION NEEDED TO ANSWER MY

QUESTIONS.

SHOWING THE SCHEDULES SHOULD BE

FUN AND VISUALLY INTERESTING -

NOT JUST PLAIN TEXT - SO I'LL

ALSO CREATE A WIDGET FOR THEM!

I'LL HEAD OVER TO OUR WIDGET

BUILDER, WHERE I'VE ALREADY

DESIGNED A SESSIONS WIDGET, IN

THIS CASE FOR A FROGE 101 CLASS.

I JUST NEED TO DOWNLOAD THE

THE WIDGET AND HEAD TO THE AGENT

AND ATTACH IT IN AS A -- LET ME

GO BACK AND CLICK THE BUTTON.

DOWNLOAD. THERE WE GO. HEAD

OVER AND ATTACH IT AS AN OUTPUT

FORMAT FOR THE SESSION AGENT WE

CREATED DROP THAT IN AND PREVIEW

TO MAKE SURE WE ADDED THE HIT

WIDGET. THIS IS NOW DONE. ONCE

AGAIN I'LL DRAG IN AN AGENT NODE

CALL THIS THE DEV DAY AGENTS.

GIVE IT CONTEXT ABOUT WHAT IT'S

DOING AND MAKE IS SPEAK IN THE

STYLE OF FROGE TO MAKE IT ON

BRAND WITH THE DAY. ADD A FILE,

WE HAVE A FILE WITH ALL THE

INFORMATION ABOUT THE DAY. CALL

THIS DEVDAY. ATTACH IT. THIS

AGENT IS READY TO GO. AND WE'LL

ATTACH THAT HERE.

NOW IT LOOKS LIKE I HAVE A FEW

MORE MINUTES, SO LET'S ADD SOME

ADDITIONAL SECURITY WITH ONE OF

THE PREBUILT GUARDRAILS.

ONE OF THE MOST IMPORTANT THINGS

WHEN BUILDING AGENTS IS TRUST,

AND GUARDRAILS HELP YOU HAVE

THAT CONFIDENCE, PROTECTING

AGAINST HALLUCINATIONS, ADDING

MODERATIONS, AND MASKING PII.

WE HAVE A COUPLE PRE-BUILT

GUARDRAILS. I'LL TURN ONE ON

FOR A PII AND INCLUDE NAME SO I

CAN EASILY VERIFY BEHAVIOR AND

TAP THIS TO THE BEGINNING OF THE

WORKFLOW TO MAKE SURE FROGE IS

PROTECTED AGAINST.THE PII AND

ADD AN ADDITIONAL AGENT TO CANAL

ADD ADDITIONAL CASES. I'LL MAKE

IT SPEAK IN THE STYLE OF FROGE.

AND REMOVE THE CONTEXT. I THINK

THIS WORKFLOW IS READY TO GO AND

I CAN CONFIGURE THE OUTPUT TO

DETERMINE WHAT SHOWS UP TOP THE

END USER. IN THIS CASE I CAN

TURN OFF FILE SEARCH SOURCES IF

THAT'S MORE INTERNAL. AND I

THINK THAT'S T I CAN PREVIEW

FROM AGENT BUILDER. OF I CAN

ASK WHAT SESSION TO ATTEND TO

LEARN MORE ABOUT THE BUILDING

AGENTS?

IT'S CHECKING GUARDRAILS AND

PULLING INFORMATION FROM THE

FILE OF SESSIONS I JUST ADDED IN

AND FINDING THE RIGHT SESSION

USING THE WIDGET I ADDED AND

DETERMINING ORCHESTRATING AGENTS

AT SCALE AT 11:15 IS THE BEST

SESSION FOR ME.

I SEE IT THROWING IN SOME

RIBBITS.

I THINK THIS AGENT LOOKS GOOD.

WATCH THE TIME. WE JUST --

SO WE JUST BUILT A FEW

SPECIALIZED AGENTS USING TOOLS,

ADDED GUARDRAILS, CUSTOMIZED

THEM WITH SOME WIDGETS, AND

TESTED OUT OUR WORKFLOW IN

PREVIEW.

NOW, THE ONE THING WE HAVEN'T

YET DONE IS A FULL SET OF EVALS,

AND I CAN ALSO DO THAT DIRECTLY

IN OUR PLATFORM TO MAKE SURE IT

BEHAVES AS EXPECTED BEFORE GOING

LIVE.

BUT RIGHT NOW, I'VE GOT A GIANT

CLOCK CHASING ME, AND DEVDAY IS

WAITING.

SO LET'S PUBLISH THIS AND CALL

THIS ASK FROGE AND HIT PUBLISH

AND I HAVE A FULLY DEPLOYED

PUBLISHED AGENT IN PRODUCTION

WITH A WORKFLOW ID I CAN USE TO

RUN DIRECTLY.

[ APPLAUSE ]

ON THE RIGHT WE HAVE CODEX IN

CASE I WANT TO RUN IN MY OWN

ENVIRONMENT AND SERVERS BUT YOU

CAN SEE THIS IS QUITE A BIT OF

CODE TO WRITE AND SO I'M GOING

TO STICK WITH USING THE WORKFLOW

ID WE CREATED AND HEAD OVER TO

MY SITE. HERE IN MY DEVDAY SITE

I'M GOING TO CREATE A SESSION

USING THE WORKFLOW WE JUST

CREATED. DROP THAT IN.

THEN I'LL DROP IN THE CHATKIT

REACT COMPONENT, HAND IT THE

SESSION KEY, AND ADD IN SOME

VISUAL CUSTOMIZATION WITH THE

FROGE ACCENT COLOR.

IT WILL BE CALLED ASK FROGE AND

CONTINUE TO RIBBIT IN THE

PLACEHOLDER AND HAVE FROGE

SPECIFIC COLORS AND STARTUP

PROMPTS. I'LL ADD THIS FROGE

CHAT AND COME UP FROM THE BOTTOM

OF THE PAGE AND THEN FINALLY

I'LL ADD IN A LINK TO ASK FROGE

AT THE TOP OF THE SITE SO IT'S

FRONT AND CENTER CENTER ON THE

WEBSITE. LET'S GO BACK TO THE

SITE. THERE IT IS. LET'S TRY

IT OUT. WHAT SESSION TO ATTEND

TO LEARN ABOUT BUILDING AGENTS.

THIS IS RUNNING THROUGH THE SAME

WORKFLOW WE JUST CREATED

CHECKING FOR GUARDRAILS,

CATEGORIZING THE MESSAGE,

PULLING FROM TOOLS FROM FILE

SEARCH, USING THE WIDGET WE

DESIGNED AND THEN DECIDING

ORCHESTRATING AGENTS AT SCALE IS

THE RIGHT SESSION FOR ME TO GO

TO AND CONTINUING TO RIBBIT IN

THE STYLE OF FROGE. WE'VE DONE

IT. !

[ APPLAUSE ]

THE AGENT IS READY WITH 49

SECONDS TO SPARE. I CAN KEEP

ITERATING DIRECTLY ON THE VISUAL

BUILDER AND DEPLOY CHANGES TO MY

SITE WITHOUT MAKING ANY CODE

CHANGES. THIS INCLUDES ADDING

NEW TOOLS, ADDING NEW WIDGETS

FOR OTHER USE CASES AND

GUARDRAILS AND I CAN EVEN WIRE

I CAN EVEN WIRE IT UP TO CLIENT

SIDE TOOLS TO TAKE ACTIONS

DIRECTLY IN THE SITE.

SO IN JUST A FEW MINUTES, WE'VE

DESIGNED AN AGENT WORKFLOW

VISUALLY, WE ADDED SOME TOOLS

AND WIDGETS, WE PREVIEWED IT,

DEPLOYED IT, AND NOW YOU ALL CAN

USE IT.

IT'S ACTUALLY LIVE NOW IN YOUR

DEVDAY SITE!

YOU CAN SEE IT AND USE IT AND

FIND SESSIONS THAT ARE BEST FOR

YOU.

WE'RE LOOKING FORWARD TO YOU

USING IT, AND ALSO SEEING THE

NEW EXPERIENCES YOU'LL BUILD

WITH AGENTKIT..

THANKS, AND BACK TO SAM.

[ CHEERS AND APPLAUSE ]

>> THANK YOU, CHRISTINA!

THAT'S SO COOL. I CAN'T WAIT TO

SEE WHAT YOU'LL BUILD WITH IT.

SO WE LOOKED AT AI APPS, AGENTS,

BUT NOW LET'S SHIFT TO SOMETHING

JUST AS IMPORTANT.

HOW WE WRITE SOFTWARE.

ONE OF THE MOST EXCITING THINGS

HAPPENING WITH AI IS THAT WE'RE

ENTERING A NEW ERA CHANGING HOW

SOFTWARE GETS WRITTEN.

ANYONE WITH AN IDEA CAN BUILD

APPS FOR THEMSELVES, THEIR

FAMILIES, OR THEIR COMMUNITIES.

WE WANT TO SHOW YOU A FEW

EXAMPLES. IN JAPAN

AN 89-YEAR-OLD RETIREE TAUGHT

HIMSELF TO CODE WITH HELP FROM

CHATGPT.

HE'S NOW BUILT ELEVEN IPHONE

APPS FOR ELDERLY USERS.

HE'S TURNING A LIFETIME OF

WISDOM INTO TOOLS THAT HELP

OTHERS LIVE MORE INDEPENDENTLY.

IN SPAIN, PAU GARCIA AND MEMBERS

OF DOMESTIC DATA STREAMERS HELP

PEOPLE RECONNECT WITH MEMORIES,

USING CHATGPT, IMAGE GENERATION,

AND SORA.

AT ASU, MED STUDENTS NEEDED A

BETTER WAY TO PRACTICE THE KINDS

OF TOUGH, HUMAN CONVERSATIONS

THEY'LL HAVE AS DOCTORS.

SO THEY BUILT A VIRTUAL PATIENT

APP WITH OUR MODELS WHERE THEY

CAN TRY, FAIL, AND GET BETTER

BEFORE THEY STEP INTO A REAL

EXAM ROOM.

AND AT VERSAILLE IN FRANCE,

VISITORS CAN NOW WALK THE PALACE

AND TALK TO IT.

THEY BUILT AN EXPERIENCE WHERE

YOU HAVE A LIVE DISCUSSION WITH

ART AND SCULPTURES WITH OUR

REAL-TIME API.

HISTORY BECOMES A CONVERSATION.

IT'S AWESOME TO SEE WHAT PEOPLE

ARE BUILDING.

THIS IS WHY WE ARE EXCITED TO

GIVE DEVELOPERS MORE TOOLS TO

BUILD FASTER.

EARLIER THIS YEAR, WE LAUNCHED A

RESEARCH PREVIEW OF CODEX,

OPENAI'S SOFTWARE ENGINEERING

AGENT, BUILT TO WORK ALONGSIDE

DEVELOPERS AND SPEED UP HOW

SOFTWARE GETS CREATED.

SINCE THEN, CODEX HAS GROWN INTO

A MUCH MORE CAPABLE

COLLABORATOR.

IT WORKS EVERYWHERE YOU CODE.

YOUR IDE, TERMINAL, GITHUB, AND

IN THE CLOUD.

YOUR CHATGPT ACCOUNT CONNECTS IT

ALL, SO YOU CAN MOVE WORK

SEAMLESSLY BETWEEN THESE TOOLS.

WE'VE RELEASED A TON OF NEW

FEATURES FOR CODEX.

AND IT'S NOW RUNNING ON THE NEW

GPT5-CODEX MODEL, A VERSION OF

GPT5 THAT WE PURPOSELY TRAINED

FOR CODEX AND AGENTIC CODING.

THIS MODEL IS BETTER AT TASKS

LIKE CODE REFACTORING AND CODE

REVIEW, AND CAN DYNAMICALLY

ADJUST HOW LONG IT THINKS TO THE

COMPLEXITY OF THE TASK.

DEVELOPERS LOVE THE NEW MODEL.

AND CODEX USAGE HAS GONE UP

REALLY FAST.

ONE OF OUR KEY METRICS FOR THIS

IS DAILY MESSAGES, THE NUMBER OF

TASKS AND CONVERSATIONS

DEVELOPERS HAVE WITH CODEX EACH

DAY.

SINCE EARLY AUGUST, DAILY

MESSAGES ARE UP 10X ACROSS

CODEX.

THIS RAPID USAGE HAS ALSO HELPED

GPT5-CODEX BECOME ONE OF OUR

FASTEST GROWING MODELS EVER.

SINCE ITS RELEASE, WE'VE SERVED

OVER 40 TRILLION TOKENS.

INTERNALLY, CODEX IS EVERYWHERE

WE BUILD.

ALMOST ALL NEW CODE WRITTEN AT

OPENAI TODAY IS FROM CODEX

USERS.

OUR ENGINEERS THAT USE CODEX

COMPLETE 70% MORE PULL REQUESTS

EACH WEEK.

AND NEARLY EVERY OPENAI PR GOES

THROUGH A CODEX REVIEW ━WITH

MORE DEPTH THAN YOU'D EXPECT

EVEN FROM A VERY SENIOR

ENGINEER.

STARTING TODAY, CODEX IS OUT OF

RESEARCH PREVIEW ━ AND

OFFICIALLY GA.

[ APPLAUSE ]

>> THANK YOU.

AND WHILE CODEX ALREADY HAS A

LOT OF TRACTION WITH INDIVIDUAL

DEVELOPERS, WE'RE INTRODUCING A

NEW SET OF FEATURES TO MAKE

CODEX EVEN MORE HELPFUL FOR

ENGINEERING TEAMS.

FIRST, A SLACK INTEGRATION.

THIS HAS BEEN VERY MUCH

REQUESTED.

SO YOU CAN ASK CODEX TO WRITE

CODE OR ANSWER QUESTIONS,

DIRECTLY FROM TEAM CONVERSATIONS

IN SLACK.

SECOND, A NEW CODEX SDK TO HELP

YOU EXTEND AND AUTOMATE CODEX IN

YOUR TEAM'S OWN WORKFLOWS.

THIRD, NEW ADMIN TOOLS AND

REPORTING, INCLUDING ENVIRONMENT

CONTROLS, MONITORING, AND

ANALYTICS DASHBOARDS, AND MORE

SO ENTERPRISES CAN BETTER MANAGE

CODEX.

EXPECT TO SEE A LOT MORE CODEX

IMPROVEMENTS COMING SOON.

ONE OF THE THINGS THAT'S BEEN

REALLY INSPIRING TO SEE IS THE

BREADTH OF PEOPLE USING CODEX.

FROM DEVELOPERS BUILDING SIDE

PROJECTS ON WEEKENDS, TO

HIGH-GROWTH STARTUPS, ALL THE

WAY TO GLOBAL ENTERPRISES.

CISCO ROLLED OUT CODEX ACROSS

ITS WHOLE ENGINEERING ORG.

THEY'RE NOW ABLE TO GET THROUGH

CODE REVIEWS 50% FASTER AND HAVE

REDUCED THE AVERAGE PROJECT

TIMELINE FROM WEEKS TO DAYS.

SO FOR OUR NEXT DEMO, WE WANT TO

DO SOMETHING FUN.

WE WANT TO SHOW YOU HOW YOU CAN

USE CODEX AND OUR APIS TO TURN

ANYTHING AROUND YOU INTO

WORKABLE SOFTWARE.

PLEASE WELCOME ROMAIN TO THE

STAGE.

[ APPLAUSE ]

>> THANK YOU SAM!

GOOD MORNING, EVERYONE!

LAST YEAR, WE BUILT AN IPHONE

APP FROM SCRATCH AND PROGRAMMED

THIS MINI DRONE, LIVE ON STAGE,

USING O1.

OUR FIRST REASONING MODEL.

IT WAS KINDA VIBE-CODING BEFORE

WE EVEN HAD A NAME FOR IT.

THE PROGRESS SINCE THEN HAS BEEN

INCREDIBLE.

CODEX IS NOW A TEAMMATE THAT

UNDERSTANDS YOUR CONTEXT, WORKS

ALONGSIDE YOU, AND RELIABLY

TAKES ON WORK FOR YOUR TEAM.

WE THOUGHT ABOUT HOW BEST TO

SHOW YOU ALL THE COOL THINGS

CODEX CAN DO.

WE HAD A LOT OF IDEAS!

BUT ONE WE KEPT COMING BACK TO

IS, WHAT ABOUT BUILDING

SOMETHING WE COULD ALL SEE AND

EXPERIENCE TOGETHER RIGHT HERE,

RIGHT NOW, IN THIS ROOM?

SO THAT'S OUR CHALLENGE!

IF YOU LOOK UP, YOU MIGHT NOTICE

THERE'S A CAMERA MOUNTED ABOVE

US:

I THOUGHT MAYBE WE COULD START

THERE SO

EARLIER, I ASKED CODEX CLI TO

CREATE A SIMPLE CONTROL PANEL

INTERFACE WITH A CAMERA FEED AND

SOME CONTROLS, BASED ON THIS

QUICK SKETCH I MADE.

THEN I ADDED FIGMA BRANDING TO

RENDER IT PERFECTLY MATCHING OUR

DESIGN. THAT'S OUR PLACE TO GET

STARTED. LET'S SEE WHAT WE CAN

DO ON TOP OF THAT.

NOW, SWITCHING OVER TO MY

TERMINAL, YOU CAN SEE CODEX CLI,

POWERED BY GPT5-CODEX AND LOGGED

INTO MY CHATGPT ACCOUNT.

LET'S START WITH SOMETHING YOU

PROBABLY HAVEN'T ASKED YOUR

CODING AGENT BEFORE:

CAN YOU QUICKLY LAY OUT A PLAN

TO CONTROL A SONY FR7 CAMERA?

I HONESTLY DIDN'T KNOW HOW TO

GET STARTED.

I JUST SAW THERE'S A C++ SDK FOR

THE CAMERA AND I THOUGHT, CODEX

WILL PROBABLY TRY TO TRANSLATE

THAT INTO JAVASCRIPT.

AND YOU CAN SEE HOW GPT5-CODEX

CAN RESPOND FAST TO QUESTIONS

LIKE THIS.

OKAY, SO TO SAVE TIME, I ASKED

CODEX TO IMPLEMENT THE VISCA

PROTOCOL AND WIRE IT UP TO OUR

CONTROL PANEL.

CODEX IS BECOMING HARDER AND

HARDER TO DEMO BY THE WAY,

BECAUSE IT CAN TRULY WORK

TIRELESSLY ON YOUR TASKS:

I'VE SEEN IT WORK FOR MORE THAN

7 HOURS STRAIGHT ON BIG

REFACTORINGS.

AND GET IT RIGHT. IF I SWITCH

OVER, THIS WAS THE FINAL RESULT.

IT WORKED FOR OVER 13 MINUTES ON

THAT ONE TASK AND EVERYTHING I

WANTED IT TO DO. IF I JUMP TO

VS CODE

WHERE WE ALSO HAVE OUR CODEX

INTEGRATION.

NIECE ARE THE FILES THE CODEX

CLI CAME UP WITH.

CODEX BUILT A NODE SERVER

IMAGINE THE TIME IT WOULD HAVE

TAKEN TO LEARN THIS PROTOCOL

OVER 30 YEARS OLD. CODEX

FIGURED OUT THERE WAS SOME VERY

SPECIFIC HEADERS TO SENSE FOR

THIS CAMERA. SO WITH THIS UI

COMPONENT WIRED UP BECK TRY

THIS. HERE IF I TURN ON THE

CAMERA, AND LET'S TRY THE

CONTROLS. I CAN CONTROL THE

CAMERA NOW FROM THIS INTERFACE.

COOL. I THINK WE CAN DO

SOMETHING BETTER. I'M GOING TO

TRY TO SEND ANOTHER TASK LIVE

INSIDE OUR IDE EXTENSION. WIRE

UP A WIRELESS CONTROLLER TO

CONTROL THE CAMERA. I'M GOING

TO SEND THIS NOW. BACK STAGE

EARLIER I FOUND THIS XBOX

CONTROLLER AND THOUGHT THIS

COULD BE SOMETHING TO TRY. AS

YOU CAN SEE NOW, CODEX MADE A

PLAN, IT'S NOW EXPLORING THE

FILE, FIGURING OUT HOW TO WIRE

UP THIS GAME PAD AND WHAT'S

INTERESTING HERE IS YOU CAN SEE

IN THE IDE WE HAVE THIS CONCEPT

OF CONTEXT. YOUR PROMPTS CAN BE

SHORT BECAUSE CODEX WILL

UNDERSTAND YOUR INTENT AND SEE

THE RECENTLY FILES YOU'VE USED

AND ADJUST ACCORDINGLY. AS YOU

CAN SEE IT'S TASK 2 WILL TAKE

ANOTHER MINUTE SO WE'LL LEAVE IT

IN THE BACKGROUND. WHAT ELSE

CAN WE DO? I THOUGHT ONE

EXCITING INTERFACE IS VOICE. SO

TO SAVE US SOME TIME I ASKED

CODEX TO INTEGRATE WITH OUR

REALTIME API AND OUR AGENT SDK

WHAT WIRE UP INTO THE APP ON

THIS DOT AT THE BOTTOM OF THE

SCREEN. WHAT'S GREAT IS IT

BRINGS NATURAL SPEECH TO SPEECH

INTO YOUR APP BUT ALSO CONNECTS

TO ANY SERVER IN THE CONTEXT OF

THAT CONVERSATION THAT GOT ME

THINKING WHAT ELSE CAN WE SHOW

YOU AND TURN INTO A MCP SERVER.

I THOUGHT WE HAVE A LIGHTING

SYSTEM. SO YOU CAN SEE HERE MY

PROMPT I ASK CODEX TO WIRE UP

THIS MCP SERVER FOR THIS MODEL

OF LIGHTING SYSTEM, I GIVE IT

THE REFERENCE DOCS AND THE EXACT

INTERFACE I WANT IT TO HAVE FOR

MY UI TO WORK. THAT'S RIM THE

MAGIC OF THE AGENTIC BEHAVIOR OF

CODEX, I COULDN'T ASK A TEAMMATE

TO DO THAT BUT BECAUSE THE TASK

WAS VERY SPECIFIC CODEX IS MY

TEAMMATE AND IF YOU LOOK AT HOW

IT WENT THROUGH THE PROCESS, IT

FIGURED AT SOME POINT IT NEEDED

TO FIND NEW INFORMATION ABOUT

COMMAND 8 TO MOVE FORWARD AND

WENT TO FETCH THE GITHUB DOCS

AND REALLY OPERATE AND CODE

TOOLS ON THE WAY AND THAT'S THE

MAGIC OF GPT FIVE CODEX. AFTER

THAT, I DID ONE MORE TURN TO ASK

CODEX TO INCLUDE THE INFORMATION

SO I CAN UNDERSTAND HOW TO RUN

IT AND THERE'S MY MCP SERVER.

GOING BACK TO VS CODE, WHAT'S

INTERESTING, THE XBOX TASK,

WE'LL SEE THAT IN A MOMENT. AND

GOING BACK HERE, YOU CAN SEE

THAT YOU HAVE ALL YOUR LOW CODE

AND CLOUD TASKS HERE INSIDE THE

VS CODE EXTENSION SO IF I CLICK

ON BUILD MCP SERVER THIS IS THE

TASK I JUST SHOWED YOU ON CODEX

CLOUD AND HERE I CAN APPLY ALL

THE CHANGES LOCALLY IF I WANT TO

TEST AND CLICK APPLY AND ALL THE

CHANGES WITH THIS MCP SERVER ARE

NOW LOCALLY. I STARTED TO

INSTALL ALL THE DEPENDENCIES AND

LET'S PUT THAT TO THE TEST. BUT

FIRST IF WE GO BACK TO OUR APP

HERE, LET'S SEE IF WE CAN

CONTROL THIS CAMERA WITH THIS

XBOX CONTROLLER. IT WORKS!

[ APPLAUSE ]

THAT'S PRETTY AWESOME. WHAT'S

FUNNY IS I CAN SPECIFY TO CODEX

WHICH BUTTONS SHOULD DO WHAT BUT

IT FIGURED A JOYSTICK WAS A GOOD

IDEA. LET'S DO THE REAL TEST

NOW AND ENTER VOICE MODE AND SEE

WHAT HAPPENS. WE'LL TRY TO SEE

IF CODEX FIGURED THIS OUT TO

CONTROL THE LIGHTS.

>> HELLO.

>> HI, THERE, I CAN HEAR YOU

LOUD AND CLEAR LET ME KNOW WHAT

YOU NEED.

>> WHAT DO YOU SEE ON CAMERA?

>> I SEE A LARGE AUDIENCE IN

FRONT OF YOU WITH ROWS OF

ATTENDEES SEATED AND READY. THE

ROOM IS WELL LIT AND THE CROWD

FILLS THE SPACE.

>> COULD YOU SHINE THE LIGHTS

TOWARDS THE AUDIENCE?

>> I'VE JUST LIT UP THE

AUDIENCE WITH A NICE BRIGHT

LIGHT TO BE PERFECTLY

HIGHLIGHTED NOW.

[ APPLAUSE ]

>> CAN YOU GREET EVERYONE HERE

IN THE ROOM NOW?

>> ABSOLUTELY. THE AUDIENCE

LIGHTS ARE UP. LET'S WELCOME

THIS FANTASTIC CROWD. HELLO,

AMAZING DEVELOPERS AT FORT

MASON, WE'RE SO EXCITED TO HAVE

YOU HERE FOR AN INCREDIBLE DAY.

>> AWESOME. COULD YOU NOW DO

SOMETHING FUN WITH THE LIGHTS

AND SAY HI TO PEOPLE TUNING IN

ON THE LIVESTREAM.

>> WE'VE GOT THE FUN LIGHTS

ROLLING. SOME DYNAMIC COLORFUL

EFFECTS IN MOTION. AND TO

EVERYONE WATCHING OF THE

LIVESTREAM, THANKS FOR JOINING

US. THIS IS GOING TO BE AN

AMAZING EXPERIENCE.

>> COOL. ALL RIGHT. LET'S GO

BACK TO NORMAL NOW. AWESOME. I

STILL HAVE NOT WRITTEN ANY CODE

TO MAKE THIS HAPPEN. BUT

THERE'S ONE MORE THING I WANT TO

SHOW YOU. LAST BUT NOT LEAST

SAM MENTIONED WE'RE LAUNCHING

THE CODEX SDK AND I WANTED TO

FINISH WITH A GLIMPSE OF WHAT

MIGHT BE THE FUTURE OF SOFTWARE

ENGINEERING. LET'S GO BACK TO

VOICE MODE. COULD YOU ASK CODEX

TO SHOW A CREDITS OVERLAY LIKE

AT THE END OF A MOVIE BUT THE

CAST IS THE ATTENDEES?

>> I'M RUNNING THAT WITH CODEX

NOW. I'LL LET YOU KNOW WHEN

IT'S READY.

>> GREAT. IN THE MEANTIME,

COULD YOU START A COUNT DOWN AND

TAKE A PHOTO OF ALL OF US?

THERE WE GO!

[ CHEERS AND APPLAUSE ]

.

>> WHEN I SENT A TASK TO THE

VOICE AGENT IT ALSO ADDED CODEX

SDK AS A TOOL AND WHAT THAT

MEANS IS NOW ON THE FLY I CAN

REPROGRAM THIS APP IN REALTIME

AND ADAPT IT TO USER NEEDS OR

ANY FEEDBACK THEY HAVE SO IN

THIS CASE WHEN I ASKED TO CREATE

A CREDITS OVERLAY IT ENTERED THE

CODE INSIDE THIS REACT AND FIND

WHAT IT NEEDED TO COMPLETE AND

THE CREDITS ARE ROLLING.

WE TOOK VOICE, WE TOOK DEVICES

WE TOOK VOICE, A SKETCH, DEVICES

AROUND US AND TURNED ALL OF THIS

INTO

WORKABLE SOFTWARE.

ALL THAT, WITHOUT HAVING TO

WRITE ANY CODE BY HAND.

GIVE CODEX YOUR MOST AMBITIOUS

IDEAS, YOUR MOST COMPLEX CODING

PROBLEMS.

SEE WHAT HAPPENS.

I THINK YOU'LL BE AS AMAZED AS

WE ARE.

EVERY DAY.

THE ONLY LIMIT IS YOUR

IMAGINATION.

THANK YOU!

BACK TO YOU, SAM.

[ CHEERS AND APPLAUSE ]

>> THANKS, ROMAIN.

THIS IS THE BIGGEST CHANGE HOW

SOFTWARE LET'S CREATED WE'VE

SEEN.

SO WE'VE COVERED A LOT TODAY,

BUT OBVIOUSLY MODELS MATTER A

LOT TOO, SO I WANT TO SHARE A

FEW MODEL UPDATES.

BACK IN AUGUST, WE LAUNCHED

GPT5.

WE TRAINED IT TO BE REALLY GOOD

AT STEERING AGENTS AND

END-TO-END CODING.

AND GPT5 HAS DELIVERED.

LEADING CODING STARTUPS LIKE

CURSOR, WINDSURF, AND VERCEL ARE

USING GPT5 TO CHANGE HOW

SOFTWARE GETS WRITTEN AND

SHIPPED IN THEIR APPS.

WE RECENTLY RELEASED GPT5 PRO,

THE MOST INTELLIGENT MODEL WE'VE

EVER SHIPPED.

TODAY

WE'RE LAUNCHING GPT5 PRO IN THE

API.

IT'S NOW AVAILABLE TO ALL

DEVELOPERS.

WE HOPE YOU ENJOY.

[ APPLAUSE ]

GPT5 PRO WILL BE GREAT FOR

ASSISTING DEVELOPERS WITH REALLY

HARD TASKS IN DOMAINS LIKE

FINANCE, LEGAL, OR HEALTHCARE,

WHERE YOU NEED HIGH ACCURACY AND

DEPTH OF REASONING.

WE'RE ALSO RELEASING A SMALLER

VOICE MODEL IN THE API WITH

GPT-REALTIME-MINI.

IT'S A SMALLER, CHEAPER VERSION

OF THE ADVANCED VOICE MODEL WE

SHIPPED TWO MONTHS AGO━WITH THE

SAME VOICE QUALITY AND

EXPRESSIVENESS, 70% CHEAPER.

PERSONALLY, I THINK VOICE IS

GOING TO BECOME ONE OF THE

PRIMARY WAYS PEOPLE INTERACT

WITH AI, AND GPT-REALTIME IS A

BIG LEAP TOWARDS THAT REALITY.

NOW I WANT TO SHIFT GEARS, AND

TALK ABOUT WHAT'S NEW FOR

CREATORS.

THIS HAS BEEN HOTLY REQUESTED.

WE'RE SEEING INCREDIBLE WORK

FROM FILMMAKERS, DESIGNERS, GAME

DEVELOPERS, EDUCATORS USING AI

AS PART OF THE CREATIVE PROCESS.

TODAY, WE'RE RELEASING A PREVIEW

OF SORA 2 IN THE API.

[ CHEERS AND APPLAUSE ]

YOU NOW HAVE ACCESS TO THE SAME

MODEL THAT POWERS SORA 2'S

STUNNING VIDEO OUTPUTS, RIGHT IN

YOUR OWN APP.

ONE OF THE BIGGEST JUMPS WE'VE

MADE WITH THE MODEL IS IN HOW

CONTROLLABLE IT IS.

YOU CAN GIVE IT DETAILED

INSTRUCTIONS AND IT HOLDS ON TO

THE STATE WHILE DELIVERING

RESULTS THAT FEEL STYLIZED,

ACCURATE COMPOSED.

AND YOU CAN TAKE THE IPHONE VIEW

AND PROMPT SORA TO EXPAND IT

INTO A SWEEPING, CINEMATIC WIDE

SHOT.

ONE OF THE MOST EXCITING THINGS

WE'VE BEEN WORKING ON IS HOW

WELL THE MODEL CAN PAIR SOUND

WITH VISUALS.

NOT JUST SPEECH, BUT RICH

SOUNDSCAPES, AMBIENT AUDIO, AND

SYNCHRONIZED EFFECTS THAT FEEL

GROUNDED IN WHAT YOU'RE SEEING.

YOU CAN HEAR IT IN THIS KAYAK

VIDEO.

YOU CAN ALSO BRING PIECES OF THE

REAL WORLD INTO SORA 2.

FOR EXAMPLE, YOU CAN TAKE A

STILL IMAGE OF YOUR DOG, AND

GIVE YOUR FAVORITE PUP SOME NEW

FRIENDS.

.

>> LOOK WHO'S COMING, BUDDY.

HERE THEY ARE. COME ON!

EVERYBODY TO GO. HAPPY DOGS!

SORA 2 IS ALSO GREAT FOR CONCEPT

DEVELOPMENT.

YOU CAN JUST DESCRIBE A VIBE OR

PRODUCT, AND SORA GIVES YOU A

VISUAL STARTING POINT.

WE'RE USING IT HERE TO GENERATE

CONCEPTS FOR AN E-COMMERCE AD.

.

>> WHEN PLACE FEELS LIKE A

BLANK CANVAS, BROWSE, CUSTOMIZE

AND CHECK OUT IN MINUTES

DELIVERED FAST TO YOUR DOOR.

PEOPLE SEEM TO REALLY LOVE SORA

2.

IT HAS BEEN ON TOP OF THE APP

STORE SINCE WE LAUNCHED.

NOW WITH THE SORA 2 PREVIEW IN

THE API, YOU CAN NOW GENERATE

THE SAME HIGH-QUALITY VIDEOS

DIRECTLY INSIDE YOUR PRODUCTS,

COMPLETE WITH SYNCHRONIZED,

REALISTIC SOUND.

AND JUST LIKE OUR OTHER

MODALITIES, IT'S BUILT FOR

FLEXIBILITY.

YOU CAN CONTROL: VIDEO LENGTH,

ASPECT RATIO AND RESOLUTION AND

EASILY REMIX VIDEOS.

MATTEL HAS BEEN A GREAT PARTNER,

WORKING WITH US TO TEST SORA 2

IN THE API TO BRING PRODUCT

IDEAS TO LIFE MORE QUICKLY.

ONE OF THEIR DESIGNERS CAN START

WITH A SKETCH AND TURN EARLY

CONCEPTS INTO SOMETHING YOU CAN

ACTUALLY SEE AND SHARE.

LET'S TAKE A LOOK AT THE VIDEO.

[ APPLAUSE ]

THAT IS A VERY COOL WAY TO BUILD

TOYS.

IT'S INCREDIBLE TO WATCH HOW

FAST IDEAS CAN TURN INTO

SHAREABLE, WORKING DESIGNS.

WE'RE EXCITED TO SEE HOW YOU'LL

USE SORA 2 IN YOUR OWN PRODUCTS.

>> WE HOPE TODAY GAVE YOU A FEW

IDEAS OF NEW THINGS TO GO BUILD.

WE WANT OPENAI TO BE A GREAT

PLATFORM FOR THIS NEW ERA OF

BUILDING.

THINGS ARE GOING TO TO GET

PRETTY INCREDIBLE PRETTY SOON.

AND ALL OUR ANNOUNCEMENTS TODAY

AIMED TO SUPPORT THAT:

THE APPS SDK FOR BUILDING NATIVE

APPS IN CHATGPT.

AGENTKIT, SO YOU CAN DEPLOY

AGENTS WITH CONFIDENCE.

A MORE POWERFUL CODEX, HELPING

YOU AND YOUR TEAM SHIP FASTER.

AND NEW MODELS IN THE API, LIKE

GPT5 PRO, SORA 2, AND REALTIME

MINI, THAT MASSIVELY EXPAND

WHAT'S POSSIBLE.

WE'RE WATCHING SOMETHING

SIGNIFICANT HAPPEN.

SOFTWARE USED TO TAKE MONTHS OR

YEARS TO BUILD.

YOU SAW TODAY.

IT TAKES MINUTES NOW.

AND TO BUILD WITH AI YOU

DON'T NEED A HUGE TEAM.

YOU DON'T NEED A BUNCH OF

INFRASTRUCTURE.

YOU JUST NEED A GOOD IDEA.

THANK YOU ALL FOR BEING HERE.

THANK YOU FOR BUILDING. I'M

ALMOST DONE. ONE SECOND.

OUR GOAL IS TO MAKE AI USEFUL

FOR EVERYONE, AND WE COULDN'T DO

IT WITHOUT YOU.

WE'RE GRATEFUL YOU'RE BUILDING

WITH US.

ALSO

AND A HUGE THANKS TO THE TEAM

THAT MADE TODAY POSSIBLE.

THERE'S A LOT MORE HAPPENING

THROUGHOUT THE DAY, SO ENJOY THE

SESSIONS, AND WE'LL SEE YOU

LATER.

THANK YOU VERY MUCH.

[ APPLAUSE ]

[ CHEERS AND APPLAUSE ]