Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
blackbear_
on July 16, 2024
|
parent
|
context
|
favorite
| on:
Exo: Run your own AI cluster at home with everyday...
It's not the parameters that are sent, it's the layer outputs. That makes for a few thousands floats per token
mg
on July 16, 2024
[–]
Woops! I would have thought the number of neurons roughly equals the number of parameters, but you are right. The number of parameters is much higher.
tama_sala
on July 16, 2024
|
parent
[–]
The embedding size is only 8k so while the parameters are 70B. So it's a huge difference
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
