|
Author |
Topic Options
|
Sunnyways
Forum Super Elite
Posts: 2221
Posted: Mon Jan 27, 2025 10:23 am
This seems to be a significant development? It’s affecting stock markets today. $1: A jolt of panic hit big technology stocks on Monday, with investors rattled by fears that advances in artificial intelligence by Chinese upstarts could threaten the moneymaking power of tech giants in the United States, Europe and beyond.
The Chinese A.I. company DeepSeek has made waves by matching the abilities of cutting-edge chatbots while using a fraction of the specialized computer chips that leading A.I. companies rely on. That has prompted investors to rethink the large returns they are expecting on the heady valuations of chipmakers like Nvidia, whose equipment powers the most advanced A.I. systems, as well as the enormous investments that companies like Google, Meta and OpenAI are making to build their A.I. businesses.
https://www.nytimes.com/2025/01/27/busi ... ticleShareMore info here: https://www.cnbc.com/2025/01/24/how-chi ... nance.html
|
Posts: 35276
Posted: Mon Jan 27, 2025 1:34 pm
TLDR OpenAI, Anthropic, etc. spend $100M+ just on compute DeepSeek just showed up and said "LOL what if we did this for $5M instead?" How? They rethought everything from the ground up. Traditional AI is like writing every number with 32 decimal places. DeepSeek was like "what if we just used 8? It's still accurate enough!" Boom - 75% less memory needed.
They built an "expert system." Instead of one massive AI trying to know everything (like having one person be a doctor, lawyer, AND engineer), they have specialized experts that only wake up when needed.Traditional models? All 1.8 trillion parameters active ALL THE TIME. DeepSeek? 671B total but only 37B active at once. It's like having a huge team but only calling in the experts you actually need for each task.
The results are mind-blowing: - Training cost: $100M → $5M - GPUs needed: 100,000 → 2,000 - API costs: 95% cheaper - Can run on gaming GPUs instead of data center hardware
Why does this matter? Because it breaks the model of "only huge tech companies can play in AI." You don't need a billion-dollar data center anymore. A few good GPUs might do it.
|
Posts: 53006
Posted: Mon Jan 27, 2025 4:23 pm
AI has always been a bubble, just like 'Quantum' is. But at least it isn't the con job that Crypto is.
|
Posts: 53006
Posted: Mon Jan 27, 2025 4:24 pm
Gonna buy me some more NVDA at 17% off too!
|
Sunnyways
Forum Super Elite
Posts: 2221
Posted: Mon Jan 27, 2025 5:23 pm
DrCaleb DrCaleb: Gonna buy me some more NVDA at 17% off too! I was thinking that myself. However, my complete ignorance of why Nvidia chips are special held me back.
|
Posts: 53006
Posted: Tue Jan 28, 2025 9:55 am
Think of AI as basically a vector calculation. A book is taken, each word is assigned a real (decimal) number, and put into an array on order and frequency of use. Every new paper, book, etc. that is added is made into a new layer of that array.
AI is the vector through all the arrays that gives the most likely outcome of words in order.
Video games are also vector math. Everything you see is basically a triangle at a given size and angle and colour. NVidia makes chips that are amazing at drawing these vectors. AMD is good, NVidia is awesome.
So NVidia chips are also good at the vector math needed for AI. A very simplified explanation, but hopefully it helps. What the Chinese have done is write the code that builds these vector calcualtions to be super fast, where OpenAI and others relied on the brute force of NVidia silicon to do the same thing.
So it seems that ChatGPT was the first one to lose it's job to AI.
And perhaps you also know why large language model AI is inherently stupid.
|
Posts: 35276
Posted: Tue Jan 28, 2025 3:22 pm
|
Posts: 53006
Posted: Fri Jan 31, 2025 7:40 am
How one YouTuber is trying to poison the AI bots stealing her content$1: YouTuber F4mi, who creates some excellent deep dives on obscure technology, recently detailed her efforts "to poison any AI summarizers that were trying to steal my content to make slop." The key to F4mi's method is the .ass subtitle format, created decades ago as part of fansubbing software Advanced SubStation Alpha. Unlike simpler and more popular subtitle formats, .ass supports fancy features like fonts, colors, positioning, bold, italic, underline, and more.
It's these fancy features that let F4mi hide AI-confounding garbage in her YouTube transcripts without impacting the subtitle experience for her human viewers. For each chunk of actual text in her subtitle file, she also inserted "two chunks of text out of bounds using the positioning feature of the .ass format, with their size and transparency set to zero so they are completely invisible."
In those "invisible" subtitle boxes, F4mi added text from public domain works (with certain words replaced with synonyms to avoid detection) or her own LLM-generated scripts full of completely made-up facts. When those transcript files were fed into popular AI summarizer sites, that junk text ended up overwhelming the actual content, creating a totally unrelated script that would be useless to any faceless channel trying to exploit it.
|
Posts: 53006
Posted: Fri Feb 07, 2025 7:26 am
|
Posts: 53006
Posted: Mon Feb 10, 2025 9:07 am
Bought an Orin Nano. For those that don't know, it uses an NVidia AI processor, and is fantastic for setting up your own personal AI. I got the development board, so there are pins I can use to interface it to things like cameras and sensors like a RaspberryPI.
Now I just have to figure out how to use it for World Domination.
|
Posts: 53006
Posted: Wed Feb 12, 2025 3:57 pm
So, the company I bought the Nano from just sent me a merchant message through Newegg just to assure me that the delivery was proceeding normally.
Embedded in the message was a 1X1 pixel blank image. Just to let them know who I am.
But I load emails as plain text. Checkmate!
|
Posts: 53006
Posted: Wed Feb 19, 2025 7:44 am
|
Posts: 53006
Posted: Wed Mar 05, 2025 7:21 am
|
|
Page 15 of 15
|
[ 223 posts ] |
Who is online |
Users browsing this forum: No registered users and 2 guests |
|
|