• Lore
  • Posts
  • Lore Issue #25: Autonomous GPT-4 + Real-time NeRFs

Lore Issue #25: Autonomous GPT-4 + Real-time NeRFs

Good morning.

On the surface, this week's news was slow compared to the flood of the last few weeks. However, some of the most exciting experiments to improve GPT-4 have happened and haven't gained enough attention yet.

Lucky for us, we had the opportunity to chat with Yohei Nakajima, the brilliant mind behind babyAGI, delving into the process of its creation. To our surprise, he's a Venture Capitalist that can't code...

Let's get started.


Reminder that we released our

about Generative AI for Enterprise! We're working on the 2nd edition, which will be translated into Korean & Japanese. Any feedback is appreciated!‌

In today's issue:

  • INSIGHTS: Autonomous GPT-4

  • COOLEST THING: Luma Unreal Engine alpha


  • INDUSTRY UPDATES: Midjourney censorship, Italy bans ChatGPT, and LangChain raised $10M seed round led by Benchmark

  • FURTHER STUDY: Mike Solana says we shouldn't bomb data centers


Boost Your Productivity: Weekly Generative AI Insights for Work

This week several experiments in Autonomous GPT-4 popped up that caught our attention, which we discussed in a tweet thread today.

 Thought Q1 was crazy? It's about to get even crazier with "AutoGPTs"! 🤯

Google is in big trouble. Here's why:— Nathan Lands (@NathanLands) April 5, 2023 

These projects, most notably babyagi and Auto-GPT, help you to create "AI founders" capable of collaborating with other GPT-4s, managing tasks, and having memory. You can set them on a mission, and they'll set out to try to make it happen.

We had a chance to talk with Yohei Nakajima, the creator of babyAGI, via voice chat to learn more about his project. He has an incredible story.

Here's a short summary of what we learned:

  • Yohei's journey in creating babyAGI was rapid, going from idea -> code -> paper -> tweet thread, all within three days. Remarkably, it was all created by AI without Yohei knowing how to code!

  • Yohei used GPT-4 to discuss the idea, then fed it relevant documentation, such as how to use LangChain and Pinecone, and GPT-4 created the code for him. He then put the code into a Replit. There were a few bugs, but GPT-4 helped him debug it.

  • Yohei is considering using babyAGI as a VC associate for his fund. He believes it's already capable of performing very basic tasks on its own, potentially even automating entire functions of a small business.

Diagram showing how babyagi works. Created with AI.

It's possible that these experiments could lead to a significant expansion of what is possible with GPT-4. Andrej Karpathy, former head of AI at Tesla, stated that "AutoGPTs" might be the next frontier in prompt engineering.

 Next frontier of prompt engineering imo: "AutoGPTs" . 1 GPT call is just like 1 instruction on a computer. They can be strung together into programs. Use prompt to define I/O device and tool specs, define the cognitive loop, page data in and out of context window, .run(). https://t.co/EKy84pa5bB— Andrej Karpathy (@karpathy) April 2, 2023 

This has significant implications for Google and others in tech hoping to catch up. OpenAI now has a very active developer community that is starting to create a flywheel of daily improvements to what you can do with LLMs.

If you combine that with the fact that OpenAI is already working on GPT-5 + rolling out plugins, it's hard to see how Google catches up.

It's possible that in the next 5-10 years, Google Search will become irrelevant. And OpenAI becomes the leading technology company in the world.

So, what does this mean for your business? Here are our insights.

Insight #1: Embrace Autonomous GPT-4

The emergence of Autonomous GPT-4 experiments like babyagi and Auto-GPT presents an opportunity to possibly automate parts of your business. In the future, it might even lead to entirely automated businesses. You should understand this as much as possible and be prepared.

Test these technologies out to see what's possible and better understand the limitations. By embracing them, you can identify new avenues for innovation and productivity enhancement in your organization.


Be careful

when running them on automatic mode. You can run up a huge bill. If possible, use Replit's free tier to experiment. 

Insight #2: Plan For An OpenAI Future

If our prediction holds true and OpenAI emerges as the winner of the AI race, it's crucial to consider what this means for your business.

Are you well-positioned for a future where SEO might matter less, and the effectiveness of your integration with OpenAI matters more? Reflect on your current strategies and explore ways to adapt and thrive in an environment where OpenAI is the leader in tech.

Insight #3: Rethink Creative Processes with AI

Yohei went from idea to popular project in 3 days. And, the AI created everything from code to the paper to diagrams, and even the tweet thread. What does this mean for open-source projects and how we should all be thinking about creating?

We're personally thinking through ideas that we have that we've assumed would be hard to build, but perhaps could be created + promoted in a matter of days using Yohei's approach.

What's Next?

Over the next few weeks, we plan to experiment heavily with babyagi and Auto-GPT to grow our business. We'll be sharing what works and doesn't along the way with all of you.

GPT-4 Automation Resources


Want daily updates? Follow

on Twitter.


The Generative AI Application That Wowed Us

‌Luma continues to be one of our favorite companies in AI.

This week, they unveiled their latest innovation: an Unreal Engine plugin capable of real-time, fully volumetric NeRFs (Neural Radiance Fields) generation. This groundbreaking development is poised to revolutionize the way we create and interact with 3D environments.

 Introducing the Luma✨Unreal Engine alpha! Fully volumetric Luma NeRFs running realtime on Windows in UE 5 for incredible cinematic shots and experiences, starting today!

Try now: https://t.co/mdyGTWhhgN pic.twitter.com/Lj1Lm3F2P4— Luma AI (@LumaLabsAI) April 3, 2023 

This innovation paves the way for entirely new types of video games and entertainment experiences.

People are already making awesome demos with it.

 Created a really cool cinematic test with Luma real-time NeRFs

You can see how the gundam dynamically interacting with the lighting in the background. #NeRFs viewer in Unreal is insane!!

- Combining NeRFs content in virtual production and traditional game

- It support PC VR!!!… pic.twitter.com/2rH10Y3wN8— Kiralキラ(EN🇨🇦, JP🇯🇵), Gugenka CTO 🇯🇵日本 (@kiradragonp) April 4, 2023 

Other things we found

Midjourney V5 Niji looks incredible for Anime. Just add --niji 5 to your prompt.

 🚨 #Midjourney is testing a new version of #Niji, a model specifically tuned on anime aesthetics.

Early results are fantastic! It's finally V5 time for anime! 🤯

☝️ To start exploring, add "--niji 5" to your prompts.

🤩 Additionally, Niji 5 now supports "--stylize"… pic.twitter.com/R7nhWnQPl9— Trist (@tristwolff) April 4, 2023 

Matt Wolfe was able to make a video game demo with zero coding knowledge.

 This video took me forever to make. I edited about 10-hours worth of footage down to just the TLDR of the process and it's still 26-minutes long. LOL.

Here's the breakdown of how I used GPT-4 to make a video game...

🔗https://t.co/ZEuiZFknDY pic.twitter.com/xIOVsJdKAr— Matt Wolfe (@mreflow) April 2, 2023 

The "first conversational holographic ai" by Looking Glass.

 "any sufficiently advanced technology is indistinguishable from magic" ✨ p sure i've never said this about anything we've made.

meet uncle rabbit—the first conversational holographic ai being powered by #ChatGPT @OpenAI powered by @LKGGlass 

(hey @DBtodomundo 👋🏼) pic.twitter.com/WuIAsZm3Ef— nikki ◕ ᴗ ◕ (@nikkiccccc) March 29, 2023 


The Most Useful Generative AI Tool We Discovered This Week

We've tried a few AI presentation tools before, like Beautiful.ai. But unfortunately, we didn't find them to be that useful.

This week we finally found one we like, Gamma.

Gamma offers an innovative way to create engaging, visually appealing content without the need for design or formatting work. Start writing and let Gamma's AI generator turn your notes into polished presentations.

There is room for improvement, but it's a great start. Try it out.

Other Tools We Found

  • EnhanceAI - Add AI autocomplete to our website in 2 minutes

  • Glasp - A social web highlighter with AI features


News, Investments, and Acquisitions Shaping the Generative AI Landscape

Midjourney Censoring For China

A story about Midjourney censorship came out this week that caused a bit of backlash in the AI community when it was noticed that Midjourney allows you to create images of Joe Biden and Donald Trump – but you can't say Xi Jinping. Or China President. Or even Xi.

Several notable people in the AI community, including hardmaru from Stable Diffusion, responded by tweeting AI-generated photos of President Xi.

 Prompt: “Xi Jinping visiting Walt Disney World and meeting Winnie the Pooh” with the new #SDXL model pic.twitter.com/NUUg6sHRVz— hardmaru (@hardmaru) April 4, 2023 

Italy Banned ChatGPT

In an unexpected move this week, Italy banned ChatGPT, the popular AI tool created by OpenAI.

‌An Italian minister has responded by calling the ban excessive.

We're also hearing rumors that Germany might move to do the same. It feels like things will keep getting more intense with regulation and geopolitics as the AI era begins.  

Funding Roundup

  • AI-powered search engine Perplexity AI lands $26M, launches iOS app - Read article

  • Blockchain startup Fetch.ai grabs $40M to provide monetization and other tooling for AI-generated information - Read article

  • AI startup Fourthline locks down $54M to bring better ID checks and compliance tools to the finance sector - Read article

  • Covariant’s robotic picking AI nabs another $75M - Read article


Expand Your Knowledge with Key Generative AI Papers, Articles, and Resources

In this article, Mike Solana discusses the rise of AI doomsayers—particularly those within the tech industry.

He criticizes Eliezer Yudkowsky's recent TIME magazine piece, which argued that the risk of nuclear war is preferable to the release of OpenAI's latest chatbot.

Other things to study

  • JARVIS, a system to connect LLMs with ML community - View GitHub

  • ‌The AI Index Report by Stanford - View Report



See you next week!

-Nathan Lands

If you ❤️ Lore:

  1. Share this newsletter 🥰

  2. Follow us on Twitter @NathanLands & LoreAiNews.

  3. Join our Generative AI community on LinkedIn.