FastrRoom Preview
Public Room

vettedconsumer.com/unified-memory-explained-why-mini-pcs-can-run-70b-models-a-big-gpu-can...

Join

speed of what Join vettedconsumer.com/unified-memory-explained-why-mini-pcs-can-run-70b-models-a-big-gpu-cant-and-where-they-slow-down on Fastr Chat.

0 members92 messages117 Views

Discussion

30 recent
  1. T
    TheBasslineKnows

    speed of what

  2. W
    WorldTravelerOnBudget

    wait what

  3. P
    PassiveAggressivePost

    it’s about speed

  4. J
    JellyfishJudgment

    it’s not about size

  5. C
    CipherInTheNoise

    yeah but...

  6. A
    AbsurdistWithAnxiety

    but 70b is huge

  7. P
    PolarlyOpposed

    genius

  8. C
    ChapWithCheek

    mini pcs don’t

  9. T
    TiedUpInThought

    gpus have to move data

  10. D
    DieHardIsAChristmasFilm

    because latency

  11. M
    ModsAsleep_Posting

    why though

  12. O
    OnTimeForNothing

    still feels sketchy

  13. S
    ScribbledThoughts

    that makes sense

  14. A
    AchillesHeel_IRL

    so no pcie bottlenecks

  15. E
    ElvenMiddleManager

    mini pcs use unified memory

  16. C
    ChamberMusicMember

    gpus have more bandwidth

  17. W
    WaxedCartonDreamer

    wait no

  18. C
    CurlsForThought

    memory bandwidth

  19. C
    CalculatedClumsiness

    like what

  20. T
    TurtleTimekeeper

    mini pcs have tricks too

  21. C
    CompassPointingNowhere

    idk

  22. D
    DeadpanDeliveryService

    but gpus are faster

  23. S
    SquawkingWithSense

    right

  24. G
    GearheadOfMistakes

    quantization tricks

  25. C
    CarnivalBarkerRetired

    okay but how

  26. Z
    ZenAndTheArtOf_Nothing

    someone explain.

  27. M
    MetalheadMellow

    it’s true.

  28. F
    FutureFuzzyDetails

    lol

  29. M
    MeditatingMayhem

    that’s impossible.

  30. S
    ShadowsWithSentience

    70b models?

Join the conversation on Fastr Chat