- Lore
- Posts
- Lore #79: Adobe To Integrate Sora, Pika, and Runway Into Premiere Pro
Lore #79: Adobe To Integrate Sora, Pika, and Runway Into Premiere Pro
Good morning,
Another crazy week in AI with Adobe announcing they will be adding AI video-creation tools to Adobe Premiere Pro, OpenAI launching a new LLM model optimized for Japanese, and much more.
Before we begin, I’d like to thank everyone who supported the launch of The Next Wave, a HubSpot original podcast I am co-hosting with my friend Matt Wolfe! We’ve already reached over 4.2k subscribers on YouTube, 12,000 views, and even trended on Spotify in the news & politics section.
We just released a new episode with Greg Isenberg, in which he provides a step-by-step blueprint for using AI in your business. I hope you’ll check it out!
NEWS
Google has expanded the availability of its advanced Gemini 1.5 Pro model to over 180 countries, introducing significant enhancements including native audio understanding and system instructions. This latest iteration, accessible via the Gemini API in public preview, also features a new File API and JSON mode for more precise control over outputs. Additionally, Gemini 1.5 Pro now supports audio and video modalities, allowing for complex reasoning across multiple formats. Developers can access these new capabilities and more through Google AI Studio, where they can also utilize the newly improved text embedding model that surpasses previous versions in performance.
Grok-1.5V, a first-generation multimodal model from Grok, is set to be released soon to early testers and existing users. This model enhances the processing of visual data such as documents, diagrams, and photographs, and stands out in the new RealWorldQA benchmark for real-world spatial understanding.
Adobe has unveiled a suite of generative AI tools designed to transform video creation within Adobe Premiere Pro. These tools, which include capabilities for extending clips, adding or removing objects, and integrating video and audio edits, are set to streamline workflows and expand creative possibilities for professional editors. Additionally, Adobe is enhancing its platform by integrating third-party AI models from companies like OpenAI, Pika Labs, and Runway.
Microsoft announced a significant investment of $2.9 billion over two years to expand its cloud computing and AI infrastructure in Japan. This investment will enhance Japan's digital capabilities and includes plans to train over 3 million people in AI technologies, open the first Microsoft Research Asia lab in Tokyo, and strengthen cybersecurity in collaboration with the Japanese government. The announcement coincides with Japanese Prime Minister Fumio Kishida's state visit to the US, emphasizing the deepening partnership between the two nations in technology and security.
Other news
Unleash the Power of AI with Graydient
Step into the future of AI with Graydient, your ultimate destination for unlimited Stable Diffusion and unfiltered language models on all your devices.
What Graydient AI offers:
Unlimited Credits: Enjoy endless AI creations without worrying about running out of credits.
Preloaded Models: Access 8 terabytes of the best AI models, ready to use without any boot time.
Multi-Device Compatibility: Experience lightning-fast performance on your PC, Mac, tablet, or laptop.
Diverse Applications: Explore a wide range of AI-powered tools for image generation, chatbots, and more.
Community Engagement: Connect with like-minded AI enthusiasts in our vibrant interest groups.
Flexible Plans: Choose from Starter, Pro, and Plus plans to suit your needs and budget.
As an exclusive offer, sign up now and get 2 months free, plus save 15% off your subscription. Don't miss out on this opportunity to join the AI revolution with Graydient.
Join Graydient today and embark on a journey of limitless AI possibilities. Plus by signing up, you help support this newsletter which we work hard on. Thank you!
INSPIRING PROGRESS
Marc Andreessen explains how AI will amplify productivity
First impressions of Gemini 1.5 Pro
Is it just me or was today the first time OpenAI was unable to overshadow a Google AI announcement?
Gemini 1.5 Pro is pretty wild. Just dropped in an audio file + hour long video interview, and now it's helping me package it up for YouTube.
Multimodality + 1M context window… twitter.com/i/web/status/1…
— Bilawal Sidhu (@bilawalsidhu)
2:35 AM • Apr 10, 2024
Realistic speech-to-motion is coming
Realistic speech-to-motion is coming!
ProbTalk is a method for generating lifelike holistic co-speech motions for 3D avatars.
Spoiler alert, it's convincing.
feifeifeiliu.github.io/probtalk/
— Dreaming Tulpa 🥓👑 (@dreamingtulpa)
11:54 AM • Apr 11, 2024
Limitless: a personalized AI powered by what you’ve seen, said, or heard
Introducing Limitless: a personalized AI powered by what you’ve seen, said, or heard.
It’s a web app, Mac app, Windows app, and a wearable.
0:06 Reveal
0:48 Why Limitless?
1:39 Demo
3:05 Pendant
4:27 Privacy
5:23 Confidential Cloud
6:36 Rewind
7:12 Roadmap
9:25 Vision— Dan Siroker (@dsiroker)
1:02 PM • Apr 15, 2024
FURTHER STUDY
movies are going to become video games and video games are going to become something unimaginably better
— Sam Altman (@sama)
3:06 AM • Apr 5, 2024
Introducing the Batch API: save costs and get higher rate limits on async tasks (such as summarization, translation, and image classification).
Just upload a file of bulk requests, receive results within 24 hours, and get 50% off API prices: platform.openai.com/docs/api-refer…
— OpenAI Developers (@OpenAIDevs)
5:19 PM • Apr 15, 2024
VENTURE DEALS
Microsoft invests $1.5B in UAE-based G42 (Link)
Upstage raised $72M to develop LLMs (Link)
Arcadia raised $50M to propel community solar and AI-driven energy solutions (Link)
Bridgewise raised $21M for AI-based analysis platform for global securities (Link)
DeepCure raised $24M to advance programs in immunology and inflammation (Link)
Neysa raised $20M for its AI cloud and platform as a service (Link)
Dot Compliance raised $17.5M for AI-enabled Quality Management System (QMS) solutions (Link)
Udio raised $10M for AI music generation (Link)
Lawhive raised £9.5M for ‘AI lawyer’ that completes admin tasks (Link)
Qureight raised €8M to accelerate drug development in lung and heart disease (Link)
Spines raised $6.5M to upend hundred-year-old publishing process (Link)
HumanX raised $6M to launch the premier community for AI (Link)
Sapien raised $5M for AI-driven data labeling (Link)
Patlytics raised $4.5M to transform patent intelligence with AI (Link)
Sortium raised $4M for video game development (Link)
Inference Labs raised $2.3M to revolutionize AI with Proof of Inference (Link)
Coming up:
Elon Musk’s xAI Takes on OpenAI: $4 Billion Funding Goal Set (Link)
That's it!
See you next week!
If you want to support Lore, please:
Share this newsletter
Follow us on Twitter @NathanLands & Lore.