• Lore
  • Posts
  • Lore Issue #43: NVIDIA Reveals GH200 Chip That Will Help AI Scale

Lore Issue #43: NVIDIA Reveals GH200 Chip That Will Help AI Scale

Good morning.

Exciting news out of SIGGRAPH this week with NVIDIA revealing their new GH200 chip.

Speaking of NVIDIA, today we’re releasing the eBook I wrote in collaboration with my friend Bojan Tunguz who works at NVIDIA.

The eBook is titled Generative AI: Revolutionizing the Way Enterprises Work - Practical Applications of Gen AI in Business and Thoughts for the Future.

Bojan and I plan to continue developing this eBook as an ongoing project that we update every few months with the latest examples and updates in Generative AI technology. So, any feedback is greatly appreciated to help us improve the next version.

  • Inflection raised $1.3B investment to build more ‘personal’ AI (Link)

  • AI chip startup Tenstorrent raised $100M investment from Hyundai and Samsung (Link)

  • Inworld AI raises $50M round at $500M valuation for AI game characters (Link)

  • Vienna-based GoStudent raised €86.7M to integrate a new AI virtual reality learning experience (Link)

  • Ivix raised $12.5M to help combat tax evasion with AI (Link)

  • MindsDB raised funding from Nvidia to democratize AI application development, bringing total seed funding to $46.5M (Link)

  • Parcha AI raised $5 million for new, pre-revenue AI agent to help fintech teams scale (Link)

  • Nigerian insurtech startup MyCover.ai raised $1.25M pre-seed funding (Link)

  • Dropzone AI raised $3.5M, launches autonomous AI agent to investigate security alerts (Link)

Harness the Power of Generative AI with Alpha

Navigating the new era of AI? Alpha is here to guide your journey. As a leading product design agency, Alpha specializes in unlocking generative AI's potential, transforming it into actionable solutions for your business.

Here's what Alpha brings to the table:

  • Interface Design: Alpha merges aesthetics with functionality, crafting user-centric interfaces that make AI intuitive.

    Model Selection: Alpha chooses the ideal AI models for your needs, optimizing performance and efficiency.

    Prompt Engineering: They're masters at designing prompts that produce precise, desired outputs.

    Fine Tuning: Alpha ensures AI models are perfectly trained and tuned for new domains and custom use-cases.

    Configuring API Usage: With Alpha, frequent changes in AI models don't disrupt your product operations.

    Data Protection: Alpha prioritizes your privacy, securing personal and sensitive data.

    With Alpha's three-step process - understand, build, unleash - you'll not only get innovative AI products, but also continual optimization to improve results over time.

    Due to high demand, they’ve got a waitlist. Your future with AI, empowered by Alpha, starts here. Join the waitlist today!

NVIDIA Announces GH200 Chip That Will Reduce LLM Costs

Nvidia has released a powerful new chip designed to run AI models. It has the same GPU as the company’s current highest-end AI chip, the H100. But the GH200 pairs that GPU with 141GB memory and a 72-core ARM central processor.

“You can take pretty much any large language model you want and put it in this and it will inference like crazy,” said CEO Jensen Huang. “The inference cost of large language models will drop significantly.”

As it stands, Nvidia leads the AI chip market with over 80% marketshare — but rivals are racing to catch up. AMD recently released its own AI-oriented chip (MI300X), while Google and Amazon are working on similar products.

Alibaba open-sources Tongyi Qianwen AI model

Alibaba has opted to open-source its AI model to third-party developers in an effort to increase the use of its product and capture a larger role in the AI technology space.

The move puts the company in competition with Meta, which recently took a similar decision (Llama), and could have implications for OpenAI’s GPT.

ElevenLabs releases input streaming

ElevenLabs, a voice AI research & deployment company, released input streaming on Monday. This allows you to stream LLM responses and generate speech in real-time — and it’s all possible with sub-1-second latency.

More information is available on Github. (Link)

Huge leaps in medical AI technology

TextFX by Google

The progression of GenAI video

  • Taylor AI: Train & own open-source LLMs (Link)

  • Voiceling: Chrome extension for dubbing/translating videos (Link)

  • The Drive AI: Ask AI questions based on your uploaded files (Link)

  • Decorify: Redesign rooms in seconds using AI (Link)

Find more tools at FutureTools.io.

  • The Economic Case for Generative AI and Foundation Models — A16Z (Link)

  • Google's New AI Search Engine (Link)

  • Tool Documentation Enables Zero-Shot Tool-Usage with Large Language Models (Link)

  • Introducing AudioCraft: A Generative AI Tool For Audio and Music by Meta (Link)

  • MetaGPT: The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo (Link)

  • Huge set of ChatGPT updates are rolling out over the next week (Link)

That's it!

See you next week!

If you want to support Lore, please:

  1. Share this newsletter 

  2. Follow us on Twitter @NathanLands & LoreAiNews.

  3. Join our Generative AI community on LinkedIn