- Lore
- Posts
- 🧙🏼♂️ Lore AI Newsletter #7
🧙🏼♂️ Lore AI Newsletter #7
Cover Art by Ben Kanizay
GM.
We hit 1,000 subscribers this week! More is on the way, with our new website expected to be done in ~2 weeks.
If you're interested in sponsoring Lore, let us know. Our readers include people from AMEX, TikTok, Spotify, Tesla, a16z, Nvidia, Fujitsu, Airbnb, Google, IBM, Cloudflare, Amazon, SoftBank, USV, Samsung, Oracle, Riot Games, Lightspeed Ventures, Wizards of the Coast, and Toyota, among others.
Okay, let's get to it.
In today's issue:
💡MOST INNOVATIVE PRODUCT: Stable Diffusion 2.0
📰 AI NEWS: Google licenses cancer-screening algorithm, Meta AI has been super busy with MultiRay and CICERO, NVIDIA wins two NeurIPS awards for Generative AI research
🤯 COOLEST THING: AI Virtual World
🧠THINGS WE LEARNED: Stable Diffusion has insane developer adoption, large language models are running out of data, OpenAI explores imitation learning, and people are pretty scared of AI
✨FEATURED ARTISTS: Ben Kanizay, Nico, Ai Machina, Eroteme Art
Stable Diffusion 2.0
💡MOST INNOVATIVE PRODUCT
The biggest buzz in Generative AI this week is the release of Stable Diffusion 2.0 by Stability.ai, which includes some major updates that have so far received mixed reviews.
Stable Diffusion 2.0 has officially been released!
- image quality improved
- base 512x512 and 768x768 image generation
- up to 4x upscaling for 2048x2048+ images
- depth->image model released as well
blogpost: https://t.co/9oCVvwUfbK
HF: https://t.co/ej9JmDJOUA pic.twitter.com/FKIumbCaMY— nearcyan (@nearcyan) November 24, 2022
Key features of the 2.0 release
New text-to-image diffusion models using a brand new text encoder (OpenCLIP). Result: improved image quality, although not everyone likes the style.
Super-resolution upscaler diffusion models which enhance the resolution of images by a factor of 4.
Depth-to-image diffusion model which infers the depth of an input image and then generates new images using both the text and depth information.
Updated inpainting diffusion model which makes it possible to switch out parts of an image.
That was a nice, long Thanksgiving weekend!
And yes, I also think that Stable Diffusion 1.5 is actually better than Stable Diffusion 2.0 pic.twitter.com/LldadPPWCW— Sebastian Raschka 📚 (@rasbt) November 28, 2022
Tried Stable Diffusion 2.0's inpainting, it's still unusable or maybe I'm doing smth wrong pic.twitter.com/Z6ODkB6FU4— @levelsio (@levelsio) November 29, 2022
Additional notes on Stable Diffusion 2.0
Some users are unhappy that the update has made it more difficult to generate images in the styles of specific artists, or create NSFW artworks.
Individual interests aside, this update is good for the Generative AI space and preserves the integrity of the model. There's less controversy over potential copyright infringements, and more protection against child pornography.
It does mean that more effort is required to generate specific results, and we expect this will boost personality-refined styles among AI artists.
He who has ears to hear, let him hear.#StableDiffusion2 #depth2img #AI #3D pic.twitter.com/mogIU2K02k— Emm (@emmanuel_2m) November 24, 2022
How does AI text-to-image actually work?
Posted on r/StableDiffusion by u/MicahBurke (thanks Dylan for sharing!)
(Psst. Still writing every word by hand? You're a little behind the curve. Check out Jasper for some AI-powered speed writing👇)
Jasper.ai
❤️ We've partnered with Jasper to offer you 10,000 free credits if you signup using our affiliate link. Bonus: it helps support our newsletter and community.
📰AI NEWS
Google licenses cancer-screening algorithm, Meta AI has been super busy with MultiRay and CICERO, NVIDIA wins two NeurIPS awards for Generative AI research
Google licenses cancer-screening algorithm
Google Health announced that its AI algorithm for breast cancer screening will now be part of commercial mammograms after licensing its technology to iCAD, a med-tech company that provides global breast cancer detection services to healthcare facilities.
Meta AI has been super busy
Last week, the company launched MultiRay, a new platform which executes cutting-edge AI models at a large scale to make AI systems more productive. MultiRay effectively allows countless AI models to share the same input.
Meta AI also announced an AI called CICERO that successfully beat humans at ‘Diplomacy' [here's the research paper], a big advancement since Google's AI beat a human at 'Go' in 2016.
NVIDIA wins two NeurIPS awards for Generative AI research
Two NVIDIA research papers have been honored with NeurIPS 2022 Awards for their contributions to the field of AI and machine learning. The first paper explores diffusion-based generative AI models, while the other addresses training generalist AI agents.
Who got funding this week
RedBrick AI raised $4.6M to accelerate AI in clinical settings, through rapid data annotation on medical imagery.
V7 Labs raised $33M to automate training data for computer vision AI models.
Sapia.ai raised $17M to solve for diversity and inclusion using AI.
Advanced Navigation raised $68M for AI robotics and navigation technology.
Deepomatic raised $10.5M for its AI-based computer vision companion for field workers.
The Applied AI Company raised $42M to build products for pharmaceutical, healthcare, safety and government sectors.
Silverpush raised $12M for cookieless solutions through its proprietary AI platform.
Harvey.ai raised $5M led by OpenAI for its AI legal assistant product.
🤯 COOLEST THING
AI Virtual World
Thanks to community member AP for suggesting this!
It is now possible to combine AI images with cinematic projection to create AI-generated virtual worlds.
Collaboration with @HODLFrance
AI Image -> Cinematic Projection#AIart #touchdesigner #deforum pic.twitter.com/l1XiaohDUy— ScottieFox (@ScottieFoxTTV) November 28, 2022
The implications of this for virtual reality could be significant. We immediately think about video games and entertainment, architecture/urban/industrial design, education and training, engineering, restorative nature experiences... it could be all of this, and possibly more.
What else we found this week
You can now generate 3D models of animals from a single image, given a training data set
It's now possible to generate 3D models of animals from as single image(!), given a training data set 🤯 #ai pic.twitter.com/1FlvSiiMMN— Nick (@fryingneurons) November 24, 2022
AI is doing incredible things for product design
+200 #AI-generated sneakers in less than 2h.
(I'd wear many of them ✨)
More examples below.🧵
What should I create next?#stablediffusion #AIart #fashion #fashiondesign pic.twitter.com/hbXWIntnoU— javierjrueda (@javierjrueda) November 24, 2022
The potential is also huge for interior design
Exploring #midjourney for interior design.#AIart #digitalart pic.twitter.com/gFoeWjrjzG— The Brauhaus (Braulio Baltazar) (@brauliobaltazar) November 25, 2022
AI avatars are still all the rage, with early movers growing fast
✨ Just launched the next phase of Avatar AI:
🙂 -> 📸 Pivoting from just avatars to entire photo shoots!
1) make 120+ avatars
2) select your favorite(s)
3) expand them into photo shoot-style pics w/ AI
📸 IRL Photo shoot: $300 - $3000
🤖 This: $99https://t.co/tiRwTS25CN pic.twitter.com/dSJNLakVvO— @levelsio (@levelsio) November 25, 2022
AI also happens to be revolutionizing warfare
I'm publishing a call to action: The AI War and How to Win It.
AI for national security will define the future of our world. Either the USA wins, or our authoritarian adversaries do.
I walk through The AI War, The China Threat, and How to Win It.
🧵https://t.co/7by2iroWWD— Alexandr Wang (@alexandr_wang) November 27, 2022
🧠THINGS WE LEARNED
Stable Diffusion has insane developer adoption, large language models are running out of data, OpenAI explores imitation learning, and people are pretty scared of AI
🥋 Prompt Tip of the Week: "Try the prompt "split screen" or "two shot" to get two #midjourney widescreen compositions in a single image. Great for telling stories!" - Davis Taylor Brown
Quick tip: Try the prompt "split screen" or "two shot" to get two #midjourney widescreen compositions in a single image. Great for telling stories! pic.twitter.com/t8AnhhYl70— Davis Taylor Brown (@Davistaylorbro) November 28, 2022
Stable Diffusion has insane developer adoption
Source: Art Isn’t Dead, It’s Just Machine-Generated
Most people miss the almost-vertical line to the left of the graph — which should indicate just how radical developer adoption of Stable Diffusion has been since day one.
Generative AI is growing at a rate unlike anything we have seen in our lifetimes, a clear sign that the technology is quickly revolutionizing the world as we know it.
We could soon run out of data to train AI models on
According to a paper published this week by AI research and forecasting organization Epoch, we could soon run out of the types of data typically used for training large language models (think Wikipedia, news articles, scientific papers, and books). Excerpt:
Our analysis indicates that the stock of high-quality language data will be exhausted soon; likely before 2026. By contrast, the stock of low- quality language data and image data will be exhausted only much later; between 2030 and 2050 (for low-quality language) and between 2030 and 2060 (for images).
This looming problem might cause a few headaches for programs like GPT-3 that can write coherent articles and computer code.
OpenAI explores imitation learning with a bot that watched 70,000 hours of Minecraft...
...and then proceeded to play the game better than any AI had before.
Imitation learning could be used to train machines to carry out a wide range of tasks by watching humans do them first — which highlights the potential of sites like YouTube as a vast and untapped source of training data.
Technophobia. AI-phobia. Algorithmophobia?
This isn't new, but people are actually pretty scared of AI and its implications.
We dug up some old texts on the topic.
A reassuring article titled Fear No AI by Wired in 1995 said:
Computers may evolve, but their evolution isn't shaped by natural selection … So, to ask what computers will become is to ask what we want from them. […] Instead of replacing us, computers will become a secondary, symbiotic species, enhancing our lives in specialized but powerful ways. In the process, they will transform what it means to be human.
20 years later (2015), the MIT Technology Review wrote:
A superintelligence would be godlike, but would it be animated by wrath or by love? It’s up to us (that is, the engineers). Like any parent, we must give our child a set of values. And not just any values, but those that are in the best interest of humanity. We’re basically telling a god how we’d like to be treated. How to proceed?
Then on Monday this week, The Highlight by Vox published an article called AI experts are increasingly afraid of what they’re creating. Here's what it said:
Handing over huge sectors of our society to black-box algorithms that we barely understand creates a lot of problems, which has already begun to help spark a regulatory response around the current challenges of AI discrimination and bias. But given the speed of development in the field, it’s long past time to move beyond a reactive mode, one where we only address AI’s downsides once they’re clear and present. We can’t only think about today’s systems, but where the entire enterprise is headed.
Creating something smarter than us, which may have the ability to deceive and mislead us — and then just hoping it doesn’t want to hurt us — is a terrible plan. We need to design systems whose internals we understand and whose goals we are able to shape to be safe ones. However, we currently don’t understand the systems we’re building well enough to know if we’ve designed them safely before it’s too late.
Further reading on the topic:
Fear of Autonomous Robots and Artificial Intelligence: Evidence from National Representative Data with Probability Sampling (2017) — read article
Dimensions of artificial intelligence anxiety based on the integrated fear acquisition theory (2020) — read article
Further Study 📖
AI in healthcare (this industry is exploding right now) —
Artificial Intelligence (AI) in Drug Discovery Market to Grow at a CAGR of 28.34% over the forecast period 2023 to 2032: Quince Market Insights — read article
GE Healthcare unveils AI program bundle for simplified MRI scans — read article
Big Data analytics and artificial intelligence in mental health — read article
University of Southern California Launches Center on AI Research for Health — read article
Have Your Cake And Eat It, Too: How AI Can Help Ensure Health Care Organizations Don’t Have To Sacrifice Quality, Time Or Cost — read article
AI-Powered Algorithm May Enhance CT Assessment of Aortic Dissection — read article
Aidoc nets FDA clearances for AI detection of aortic tears, medium-vessel strokes — read article
Philips Launches AI-Enabled 'Visualization Workspace' at RSNA — read article
Other segments —
AI affecting jobs: Could Amazon Be Replacing Recruiters With Artificial Intelligence Software? — read article
AI in academia: Now AI can write students’ essays for them, will everyone become a cheat? — read article
AI in finance: Tom Van Horn of Magnifi discusses the first AI-powered tool for DIY investors — listen to podcast
AI in engineering: AI Is Automating Defect Inspection — read article | Bosch uses AI to design new e-motors — read article (paywall)
AI in gambling: From customer service to tailored game choices — AI will be huge in the online casino industry — read article
AI in sport: Golfing robot uses physics-based model to train its AI system — read article
AI in government: End-to-End Artificial Intelligence Supports Federal Mission Sets — read article
AI in science: AI invents millions of materials that don’t yet exist — read article
AI in mining: AI can help mining companies keep up with modern demands — read article
AI bias: How New AI Technology Helps People With Disabilities but Introduces Discrimination — read article
Technical: 5 risks of AI and machine learning that modelops remediates — read article | Why the future of AI is flexible, reusable foundation models — read article | Heres a plain C/C++ implementation of AI speech recognition so get hackin' — read article
+ For those looking to build a career in AI, read this article.
✨FEATURED ARTISTS
Ben Kanizay, Nico, Ai Machina, Eroteme Art
This week's contest theme was retrofuturism.
Winner: Ben Kanizay
Runner Ups:
Created by Nico
Created by Ai Machina
Created by Eroteme Art
Closing
Glad to have you along for the journey, and thanks for helping us to grow to over 1,055 subscribers in 7 weeks.
See you next week!
-Nathan Lands & Michele du Toit
💌
Support the Newsletter
Share this newsletter. 🥰
Follow us on Twitter @NathanLands & @LunaMageAI.
Sign-up for one of our affiliate partner's services. We get paid a commission which might be able to support this newsletter long-term!