ChatGPT Plugins - iPhone moment for AI

Advertise | Jobs | Community |
Investor + Founders | Maker-in-Residence

Hey folks, we got GPT-4 last week and were like, oh, it’s pretty big. None of us thought to say the same again too soon. Today we have Open AI introducing ChatGPT plugins. Looks like a new developer ecosystem starts now.

Let’s get to it.

PS: I’m hosting a ChatGPT plugin hackathon with ‘Dan Shipper’ from Every. RSVP here.

From our sponsor:

Metaview leverages GPT-4 to create automated, AI-generated interview notes.

Notes are purpose-built for interviewing so accuracy and relevance is 10x better than generic summarization tools. Companies like Replit, Scale, and Brex use Metaview to save time from manually typing interview notes and focus on high-quality interactions with candidates.

They’ve just launched on Product Hunt - check it out

🤌 Our Picks

Highlights if you've only got 2 minutes

1/ OpenAI’s Plugin Protocol and Zapier gives everyone a personal AI assistant

Twitter is aliiiive with the latest big step towards AI accessibility - if you know, you know, and if you don’t, then get to know. OpenAI have started rolling out their Plugin Protocol, aka third-party apps with ChatGPT.

Soon enough, you’re gonna be able to control literally thousands of apps from within the ChatGPT interface - insane! Combined with Zapier, it’s like AI is a flower in full blossom. The Plugin Protocol connects ChatGPT to designated APIs, plus Zapier provides access to 5000+ apps meaning that the combination of the two provides anyone with their own personal AI assistant.

You could ask it to read your Slack chat and send a response; you could ask it to pull a specific email, generate a response, and send it; you could even search a Notion database for something you’ve been on the hunt for; you could do almost anything you can think of!

For the developers out there, there’s a tool-building protocol; you’ll be able to execute Python code in limited sandboxes, set up data retrieval processes, and more. OpenAI’s Greg Brockman has a bunch of good examples on his Twitter of using ChatGPT plugins. For example, this tweet about processing a video clip. Check them out.

2/ OpenAI’s Code Interpreter is taking LLM coding to the next level with the Plugin

So the Plugin Protocol is incredible for everyone - techy or not - but let’s go for a deeper dive into the OpenAI’s Code Interpreter (CI) and its power alongside the Plugin. According to this post the combination is magic, and it sure looks that way, with a load of wicked first-off-the-pass examples. One of the most powerful things is its ability to chain different blocks of code from different APIs together to produce an output - this guy got ChatGPT to build a full-on Pac-Man game and convert it to a usable Gif. On top of this, he showed us how it can use an OCR tool to extract contents of an image and save it to a txt file; how it can generate funky sounds and save them to a wav file for you; and for you hackers who wanna insert creepy ASCII images into things, it seems to be able to create them from anything too… Read the blog post, have a play yourself, and get stuck in!

3/ Tome launch the first live document-to-presentation tool

Since you’re all so lovely to me I’ll be honest, I’m getting mildly bored of the same-but-different business productivity tools popping up all over the place. But Tome really impressed me when I first came across their $43m Series B, so I’m pretty stoked to see they’ve actually launched the first document-to-presentation AI tool. Built on GPT-4, it’s able to take a document and turn it into presentations, narratives, and stories using generative text and images. With their own innovative tile system, this isn’t just another generative PowerPoint tool, and I genuinely think it provides a strong competitor to Microsoft in this space - it just looks so damn slick!

🛠️ Cool Tools

Product launches, updates and demos

• Bubble Buddy - Ask any Bubble related question, and you'll get the answer you need. (link)

• Milo AI announces ChatGPT plugin to help parents make their minutes meaningful. (link)

• Codium AI - Generating meaningful tests for busy devs. (link)

• Train Engine - Train Dream Booth models to generate unlimited AI assets. (link)

• Dailybot - Daily standups, kudos, virtual coffees, and more. (link)

• Gist for combining Langchain with Open AI’s chatGPT retrieval plugin. (link)

• Klarna’s plugin for ChatGPT. (link)Tweets on how easy it is to setup these plugins. (link)

• Cody from Sourcegraph - Your intelligent, code-aware, enterprise-ready programmer’s assistant. (link)

🤓 Miscellaneous

News, podcasts, videos, blogs etc

• An interview with Nvidia CEO Jensen Huang about AI’s iPhone moment. (link)

• 7 days of new AI technologies shows us that everything is happening very fast. (list)

• A16Z investor Sarah Wang on investing in Character AI. (link)

• How one tweet changed the life of HustleGPT’s creator. (link)

• Cheating is all you need. (link)

• Visual language maps for robot navigation. (link)

• ChatGPT gets its Wolfram superpowers. (link)

• The coming of local LLMs. (link)

• ChatGPT + code interpreter = magic. (link)

• Sequoia's latest map of AI in the software development life cycle. (link)

• DreamBooth3D - Personalized 3D models from just a few casual photos, with text-driven modifications. (link)

• Capabilities of GPT-4 on medical challenge problems. (link)

🎓 Learn

How-to’s and resources

• GPT-4 built a Shopify app in an hour, and it works! (link)

👋 Too many links?! I created a database for all links mentioned in these emails. Refer 1 friend using this link and I'll send over the link database.

📰 Unclassifieds

Short, sponsored links 

• Cerebral is hiring a senior machine learning engineer. (link)

• Stripe is hiring a machine learning engineer for payment optimizations. (link)

Have a product, service, job, event, newsletter, app, book, movie, tool, or anything you'd like to share with over 50k subscribers? 
Advertise | Jobs | Community |
Investor + Founders | Maker-in-Residence

🖼 AI Images of the day

Funny memes and pics from around the web

Send this to 1 AI-curious friend and receive my AI project tracker database! Use this link.