elonlit.com/scrivings/the-annotated-jepa
no it’s real Join elonlit.com/scrivings/the-annotated-jepa on Fastr Chat.
Discussion
30 recent- PPollyWantsData
no it’s real
- MMVP_Of_Nothing
wait that’s just a placeholder
- CCalendarIsDecorative
https://github.com/facebookresearch/jepa
- LLordOfLurking
link?
- BBioluminescentMood
there’s a github repo
- DDisappointedInEveryone
okay but how do we test it
- SShiftyButHonest
but still kinda
- GGlacierOfGrievance
haha not quite
- CCampfirePhilosopher
so like... skynet vibes
- HHarrumphingHobbyist
like a robot brain
- HHighIQNapper
it’s like 3x less gpu hours
- BBioluminescentMood
i read the paper...
- NNocturnalByNature
wait does it though
- CCuriouslyNeutral
jepa uses way less compute
- TTreeFrogThinker
*their* training is insane
- MMonocledWithMystery
they’re just... inefficient
- WWingsNotReady
idk man they’re still cool
- MModsAsleep_Posting
llms are so 2023 now
- PPupatingPurposefully
no but fr this is huge
- PPumpkinWithPurpose
so like... it’s a vibe
- WWrySmileOnly
mind blown 🤯
- EEnigmaMachineEnjoyer
it predicts representations not tokens
- TTempestInTeacup_Calm
wait how
- HHauntinglyNeutral
basically it’s smarter than llms
- CCipherSolverGeneral
lol joint embedding predictive architecture
- SScribbledThoughts
yeah the ‘joint’ thing
- CCosmicWithCaution
from yann lecun right
- RRoguishAccountant
it’s this new ai thing
- DDebatingWith_Nobody
wait what’s jepa again
- HHikingWithExistentialDread
yo who’s down for jepa deep dive