可视化注意力,变形金刚的心脏[视频]
Visualizing Attention, a Transformer's Heart [video]

原始链接: https://www.3blue1brown.com/lessons/attention

本文感谢支持之前视频和当前对正在进行的项目的赞助的个人。 名字包括:chance、Ada Cohen、Adam Cedrone、Alan Stein、Arunkulshreshtha、Andrew Busey、Andrew Villagran、Anthonie Eufemio、Aravind CV、Arthur Zey、Barry McLaurin、Beccat Madden-Woods、Benjamin Bailey、Bigyan Bhar、Blake Byers、Boris Veselinovich , 布伦·布莱恩·克劳蒂尔, 布莱恩·金, 布里特·赛尔维泰尔, 布鲁斯·奥伯格, 卡洛斯·伊里亚特, 卡洛勒斯·雷内克, 查尔斯·萨瑟兰, 克里斯·阿莱克修克, 克里斯·康奈特, 克里斯·西比, 克里斯蒂安·布罗, 库珀·琼斯, 科里·奥格本, 克雷格·施万特, 克里斯蒂·科布扎伦科, 克里斯蒂安·阿米特罗伊, Cy 'kkm' Nelson、D. Sivakumar、Dallas DeAtley、Dan Davison、Dan Herbatschek、Dan Kinch、Daniel Badgio、Daniel Rolandsgard Kjellevold、Dave Kester、Dave Nicponski、David Bar-On、David Barker、David Gow、David J Wu、 David Johnston、Deep Kalra、Deepak Devjani、Delton Ding、Dominik Wagner、Donal Botkin、Eddy Lazzari、Eduardo M Chumbes、emptymachine、Evan Miyazono、Filip Rolenec、Frank R. Brown Jr.、Gabriele Siino、Garbanarba、George Maged Botros、Gerardo Ubaghsgooney、戈登·古尔德、格雷戈里·霍珀、gregostras、Guillaume Sartoretiti、Harris Hoke、Henrique Reich、Hitoshi Yamauchi、Holger Flier、Igor Bogetic、Infinite Flite、IvanJ。 德米特里·盖洛、雅各布·哈蒙、郑在元、詹姆斯·戈拉布、杰米·温特顿、简-亨德里克·普林茨、贾纳克·拉马克里希南、贾森·阿肯斯、贾森·希斯、让-曼努尔·伊扎雷特、杰德·耶瑟、杰夫·巴特沃斯、杰夫·林斯、杰夫·斯特拉托菲尔、杰罗姆·约翰逊、杰里 史密斯、杰里斯·希顿、吉米·杨、jml、乔·克拉

一位具有量子化学和机器学习背景的用户将 Transformer 模型与量子力学进行了比较,因为它们具有共同的高维性质和时间演化方面。 Transformer 模型根据先前的标记确定序列中的下一个标记,通过应用于高维向量的线性状态函数计算。 这让用户想起了物理学中的哈密顿系统,它通过时间演化算子描述了封闭系统的能量动力学。 然而,考虑到线性系统和量子力学系统之间的差异,人们对这种比较是否合适提出了怀疑。 争论仍在各个方面继续进行,包括统计学习模型的局限性、模型的潜在发现以及统计在自然语言建模与物理建模中的作用。 最终,讨论强调了这两个领域涉及的复杂性和细微差别,并强调了正确的数学定义和理解在区分看似相似的概念时的重要性。
相关文章

原文

Special thanks to those below for supporting the original video behind this post, and to current patrons for funding ongoing projects. If you find these lessons valuable, consider joining.

.chanceA ZookAaron BinnsAda CohenAdam CedroneAdam Dřínekaeroeng15Alan SteinAlbin EgasseAlex Alex HackmanAlexandru IrimieaAlexis OlsonAli YahyaAljoscha SchulzeAlon AmitAlvin KhaledAman KarunakaranAndrea Di BiagioAndrew BuseyAndrew PoelstraAndrew VillagranAndrew WyldAndrey ChursinAnthony EufemioAravind C VArkajyoti MisraArthur ZeyArto BendikenArun KulshreshthaAvi BryantAxel EricssonBarry FamBarry McLaurinBeckett Madden-WoodsBen DeloBenjamin BaileyBigyan BharBlake ByersBoris VeselinovichBpendragon Bradley PirtleBren Brian CloutierBrian KingBrian StaroselskyBritt Selvitellebruce obergBurt HumburgCarlos IriarteCarolus ReineckeCharles SoutherlandChris AlexiukChris ConnettChris MabeeChris SeabyChristian BroßConstantine GoltsevCooper JonesCorey OgburnCraig SchwandtCristi CobzarencoCristian AmitroaieCy 'kkm' K'NelsonD. Sivakumard5bDallas De AtleyDan DavisonDan Herbatschek Dan KinchDan LawrenceDan MartinDaniel BadgioDaniel Rolandsgard KjellevoldDave Kesterdave nicponskiDavid Bar-OnDavid BarkerDavid GowDavid J WuDavid JohnstonDeep KalraDeepak DevjaniDelton DingDominik WagnerDonal BotkinEddy LazzarinEduardo M ChumbesemptymachineEric KoslowEric YoungeEro CarreraEryq OuithaqueueEugene PakhomovEvan MiyazonoFilip RolenecFrank R. Brown, Jr.Gabriele SiinoGarbanarbaGeorge Maged BotrosGerardo UbaghsgonezoomyGordon GouldGregory HoppergregostrasGuillaume SartorettiHarris HokeHenry ReichHitoshi YamauchiHolger FlierIgor BogetićInfinite FliteIvanJ. Dmitri GallowJacob HarmonJaewon JungJames GolabJamie WintertonJan-Hendrik PrinzJanak RamakrishnanJason ArkensJason HiseJean-Manuel IzaretJed YeiserJeff ButterworthJeff LinseJeff RJeff StraathofJeremy Jeremy ColeJeremy SmithJerris HeatonJimmy YangjmlJoe krausJoe PregrackeJohnJohn C. VeseyJohn CampJohn HaleyJohn LeJohn LuttigJohn McClaskeyJon AdamsJonathan Jonathan M.Jonathan WhitmoreJonathan WilsonJonathon KrallJosé BreijoJoseph John CoxJosephGJosh WileyJoshua OuelletteJuan BenetJulian ParmarJulien DuboisJustin ChandlerKarim SafinKarma ShiKeith TysonKenneth LarsenKevin Kieryn Killian McGuinnessKonstantin BelotserkovetsKrishanu SankarLambda GPU WorkstationslardysoftleafyleafLee BurnetteLee ReddenLinda XieLukas BiewaldMajid AlfifiMaksim StepanenkoMano PrimeMara Cating-SubramanianMarcoMarek GluszczukMark SteitzMarkMMarshall McQuillenMartin MauersbergMatt ParlmerMatthew BouchardMatthew PiziakMauricio Sánchez-BellaMax AndersonMax LiMax WelzMaxim KuzmichMaxim NitscheMeni RosenfeldMerlMichael DunworthMichael KokosenskiMichael LiuzziMike Mike DourMike DussaultMohammad HosseiniMohsen HejratiMolly MackinlayMR. FANTASTICMukul RamMutual Informationnamewithheld Nate GlissmeyerNate PinskyNickNick RubinoNick ValverdeNikhil AbrahamNipun RamakrishnannonamenothingsOctavian VoicuOleksandr KuvshynovOliver SteeleOrb Liotavio goodPatch KesslerPatrick LucasPaul PluzhnikovPaul WolfgangPavel DubovPāvils JurjānsPersonPeter FreesePeter McinerneyPhilipp LegnerPierre LancienPradeep GollakotaPrathap SridharanRami MaaloufRandy C. WillRandy TrueRaymond FowkesRebecca Linrehmi postRipta PasayRobRob GranieriRod SRon CapelliRonnie ChengRonnyRoy VelichRuslan AbdikeevRussel SimmonsRyan AtallahRyan MahuronScott GorlickScott GraySean ChittendenSergey OvchinnikovSeth KaufmanShardul HedaSiddhesh VichareSinan TaifourSmarter Every DayStefan KorntreffStephen PalazolaSteve HuynhSteve MuenchSteven SiddalsTal EinavTanmayan PandeTaras BobrovytskyTerry HayesThe 1111 CodeThomas Peter BerntsenTimothy ChklovskiTodd Wangtril zerobyteTristan SaldanhaTyler HerrmannTyler ParcellTyler VenessUbiquity VenturesVai-Lam MuiVignan VelivelaVignesh ValliappanVijay Vikram ParalkarVince GaborXierumeng Yana ChernobilskyYoon Suk Ohyou say long names are tricky but all I hear is sempai noticed meYurii MonastyrshynYushi WangZachariah RosenbergZachary WaltonАнтон КочковОлександр Горленко昊 陈

联系我们 contact @ memedata.com