Google’s TurboQuant has the internet joking about Pied Piper from HBO's "Silicon Valley." The compression algorithm promises to shrink AI’s “working memory” by up to 6x, but it’s still just a lab experiment for now.
Training is constant. None of these models by any of these providers are static. You’ll notice that they are releasing new models and new model versions regularly.
This means that training is happening constantly. It never stops. There’s always new shit being trained.
Yeah—but in theory you only need to train once, while inference costs are ongoing and scale up with usage.
I guess it’s ultimately a business decision by AI companies to weigh how often retraining is worth the cost.
Training is constant. None of these models by any of these providers are static. You’ll notice that they are releasing new models and new model versions regularly.
This means that training is happening constantly. It never stops. There’s always new shit being trained.