doi.bio/edward_j_hu
Edward J. Hu
Early Life and Education
Edward J. Hu received a BS/MS in Computer Science from the University of Southern California, where he worked with Joseph J. Lim. He is currently a Ph.D. student at the University of Pennsylvania, advised by Dinesh Jayaraman.
Career
Edward J. Hu is currently building his own company. Previously, he was a researcher at OpenAI, where he invented LoRA and μTransfer. LoRA is a popular method for customising AI models, and μTransfer underpins the largest AI models being developed today. Before graduate school, he was a researcher at Microsoft.
Publications
Edward J. Hu has several publications to his name, including:
- Amortizing Intractable Inference in Large Language Models (ICLR 2024)
- GFlowNet-EM for Learning Compositional Latent Variable Models (ICML 2023)
- μTransfer: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer (NeurIPS 2021)
- LoRA: Low-Rank Adaptation of Large Language Models (ICLR 2022)
- GFlowNet Foundations (JMLR 2023)
- μP: Feature Learning in Infinite-Width Neural Networks (ICML 2021)
- Improved Image Wasserstein Attacks and Defenses (Best Paper at ICLR Trustworthy ML Workshop 2020)
- Randomized smoothing of all shapes and sizes (ICML 2020)
Awards and Recognition
Edward J. Hu's work has been recognised by the scientific community, with awards such as the Best Paper Award at the ICLR Trustworthy ML Workshop in 2020 and the Best Paper Award at CORL 2022.
Edward J. Hu
Biography
Edward J. Hu is a researcher and computer scientist specialising in artificial intelligence, with a focus on large language models and neural networks. Hu is currently building his own company, having previously worked as a researcher at OpenAI and Microsoft.
Hu received his research training as a Ph.D. student advised by Yoshua Bengio, recipient of the 2018 A.M. Turing Award. Before graduate school, he worked at Microsoft, where he invented LoRA and μTransfer. LoRA (Low-Rank Adaptation) is now a popular method for customising AI models, and μTransfer underpins the development of the largest AI models currently being created.
Education
- BS/MS in Computer Science, University of Southern California
- Ph.D., University of Pennsylvania (current)
Selected Publications
- Amortizing Intractable Inference in Large Language Models ICLR 2024 (oral presentation)
- GFlowNet-EM for Learning Compositional Latent Variable Models ICML 2023
- μTransfer: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer NeurIPS 2021
- LoRA: Low-Rank Adaptation of Large Language Models ICLR 2022
- GFlowNet Foundations JMLR 2023
- μP: Feature Learning in Infinite-Width Neural Networks ICML 2021
- Improved Image Wasserstein Attacks and Defenses Best Paper at ICLR Trustworthy ML Workshop 2020
- Randomized smoothing of all shapes and sizes ICML 2020
Awards
- Best Paper Award, CORL 2022
- Best Paper Award, CoRL22 Roboadapt Workshop, ICLR 2023
Youtube Videos
Youtube Title: Robotics Summer School 2022 - Interview with Edward Hu
Youtube Link: link
Youtube Channel Name: AheadIO
Youtube Channel Link: https://www.youtube.com/@aheadio
Robotics Summer School 2022 - Interview with Edward Hu
Youtube Title: Best Moment of Edward Hu on Instagram
Youtube Link: link
Youtube Channel Name: Edward Hu
Youtube Channel Link: https://www.youtube.com/@edward_huu
Best Moment of Edward Hu on Instagram
Youtube Title: μTransfer: Tuning GPT-3 hyperparameters on one GPU | Explained by the inventor
Youtube Link: link
Youtube Channel Name: Edward Hu
Youtube Channel Link: https://www.youtube.com/@edwardjhu
μTransfer: Tuning GPT-3 hyperparameters on one GPU | Explained by the inventor
Youtube Title: Running an AI Startup is BRUTAL.
Youtube Link: link
Youtube Channel Name: David Ondrej
Youtube Channel Link: https://www.youtube.com/@DavidOndrej
Running an AI Startup is BRUTAL.
Youtube Title: Fireside Interview With Edward Hu - Vext Founder
Youtube Link: link
Youtube Channel Name: Fahd Mirza
Youtube Channel Link: https://www.youtube.com/@fahdmirza
Fireside Interview With Edward Hu - Vext Founder
Youtube Title: Edward Hu Piano Practice 25 07 21
Youtube Link: link
Youtube Channel Name: Yang Liu
Youtube Channel Link: https://www.youtube.com/@cocoxiaoran
Edward Hu Piano Practice 25 07 21
Youtube Title: Support trans kids 🏳️⚧️🏳️🌈❤️ #shorts #trans #pride
Youtube Link: link
Youtube Channel Name: Jonathan Joly
Youtube Channel Link: https://www.youtube.com/@jonathanjoly
Support trans kids 🏳️⚧️🏳️🌈❤️ #shorts #trans #pride
Youtube Title: Skin Deep: The Battle Over Morgellons Q&A April 2, 2020 Edward Hu, Marianne Middelveen, Cindy Casey
Youtube Link: link
Youtube Channel Name: Skin Deep: The Battle Over Morgellons
Youtube Channel Link: https://www.youtube.com/@skindeepthebattleovermorge3634
Skin Deep: The Battle Over Morgellons Q&A April 2, 2020 Edward Hu, Marianne Middelveen, Cindy Casey
Youtube Title: Putin flirts, Putin sigma rule, Putin body language #sigma #confidence #bodylanguage #putin #shorts
Youtube Link: link
Youtube Channel Name: Leadership and Confidence.
Youtube Channel Link: https://www.youtube.com/@here
Putin flirts, Putin sigma rule, Putin body language #sigma #confidence #bodylanguage #putin #shorts
Youtube Title: Waking up in Dan Bilzerian’s house lol
Youtube Link: link
Youtube Channel Name: Blondes Building Equity
Youtube Channel Link: https://www.youtube.com/@blondesbuildingequity
Waking up in Dan Bilzerian’s house lol
Youtube Title: Edward Maya ft. Vika Jigulina - This Is My Life
Youtube Link: link
Youtube Channel Name: Ultra Records
Youtube Channel Link: https://www.youtube.com/@ultrarecords
Edward Maya ft. Vika Jigulina - This Is My Life
Youtube Title: LoRA: allow a high school student to train Large Language Model (GPT-3) with a gaming graphics card
Youtube Link: link
Youtube Channel Name: Olewave
Youtube Channel Link: https://www.youtube.com/@olewave
LoRA: allow a high school student to train Large Language Model (GPT-3) with a gaming graphics card
Youtube Title: Alan Yuille - 2022 Edward J. McCluskey Technical Achievement Award
Youtube Link: link
Youtube Channel Name: IEEEComputerSociety
Youtube Channel Link: https://www.youtube.com/@IEEEComputerSociety
Alan Yuille - 2022 Edward J. McCluskey Technical Achievement Award
Youtube Title: Water 2018 | Lecture 8 Groundwater remediation and dual-biofilm barrier for… | Edward Bouwer (JHU)
Youtube Link: link
Youtube Channel Name: International Institute for Environmental Studies
Youtube Channel Link: https://www.youtube.com/@IIEScom
Water 2018 | Lecture 8 Groundwater remediation and dual-biofilm barrier for... | Edward Bouwer (JHU)
Youtube Title: Edward Luttwak, Author of "The Rise of China vs the Logic of Strategy"
Youtube Link: link
Youtube Channel Name: FRANCE 24 English
Youtube Channel Link: https://www.youtube.com/@France24_en
Edward Luttwak, Author of "The Rise of China vs the Logic of Strategy"
Youtube Title: E21: LoRA
Youtube Link: link
Youtube Channel Name: argmaxfm
Youtube Channel Link: https://www.youtube.com/@argmaxfm
E21: LoRA
Youtube Title: Love Stereo Again (Lyrical Video)| Edward Maya, Tiger J Shroff, Zahrah S Khan, Tanishk B | Bhushan K
Youtube Link: link
Youtube Channel Name: T-Series
Youtube Channel Link: https://www.youtube.com/@tseries
Love Stereo Again (Lyrical Video)| Edward Maya, Tiger J Shroff, Zahrah S Khan, Tanishk B | Bhushan K
Youtube Title: Andrew Tate's Chest Looks TERRIBLE 💀😂
Youtube Link: link
Youtube Channel Name: Mario Rios
Youtube Channel Link: https://www.youtube.com/@Coach_MarioRios
Andrew Tate's Chest Looks TERRIBLE 💀😂
Youtube Title: Is Jeff Bezos Really That Approachable #wealth #jeffbezos #celebrity #entrepreneur #ceo
Youtube Link: link
Youtube Channel Name: 10g Colin
Youtube Channel Link: https://www.youtube.com/@10gColin
Is Jeff Bezos Really That Approachable #wealth #jeffbezos #celebrity #entrepreneur #ceo
Youtube Title: Hun To Bolish: Bring laws like Arab countries..replace the old laws of independence
Youtube Link: link
Youtube Channel Name: ABP Asmita
Youtube Channel Link: https://www.youtube.com/@ABPAsmitaTV
Hun To Bolish: Bring laws like Arab countries..replace the old laws of independence
Youtube Title: 'Wo jaha se laad rahe hai waha unki jamanat bacha le… Leave the matter to the government.' Raghu Sharma's Jesus donation
Youtube Link: link
Youtube Channel Name: ABP Asmita
Youtube Channel Link: https://www.youtube.com/@ABPAsmitaTV
'Wo jaha se laad rahe hai waha unki jamanat bacha le... Leave the matter to the government.' Raghu Sharma's Jesus donation