📚 Tutorial: Zhiting Hu (@ZhitingHu) / X

Zhiting Hu

687 posts

Zhiting Hu

@ZhitingHu

Researcher, Founder, Professor in AI. @xai, DynamicsLab, @UCSD

San Diego, CA

Joined April 2018

Pinned
Zhiting Hu
@ZhitingHu
May 20
🔥🔥
SimWorld
@simworld_ai
May 20
Environment generation is the missing scaling axis for embodied AI. Introducing SimWorld Studio: a self-evolving factory for endless interactive 3D env where agents act, fail & learn. Env-agent co-evolvution improves navigation success 50% → 90%. From a prompt, our SimCoder
00:00
1.7K
Zhiting Hu
@ZhitingHu
May 24, 2023
🧠Human brain has internal world model for conscious reasoning 🤖Language model reasoning also need world model! Reasoning via Planning (RAP) is a new principled framework for this. It prompts LM as WM & reasons w/ MC TreeSearch Better v ChainOfThought on plan-gen, math, logic
Shibo Hao
@Ber18791531
May 24, 2023
🤖LLMs (autoregressive transformers) are not designed to reason in non-linear structures like humans... 🤔Instead of using it as a straight-minded reasoner, what about regarding it as a world model🌎and planning with it? Check out our new work: Reasoning via Planning (RAP) 🧵
110K
Zhiting Hu
@ZhitingHu
Dec 11, 2023
🔥#NeurIPS2023 Tutorial🔥 Language Models meet World Models @tianminshu & I are excited to give tutorial on machine reasoning by connecting LLMs🗣️ world models🌎 agent models🤖 w/ amazing panelists @jiajunwu_cs @du_yilun Ishita Dasgupta,Noah Goodman sites.google.com/view/neurips20…
109K
Zhiting Hu
@ZhitingHu
May 10, 2025
I was kidding -- this video was entirely simulated by the _world model_ we're building. 😀 It's mind-blowing how it produces high-fidelity simulations, lasting several minutes, to complete non-trivial tasks. This showcases the potential for infinite data & experience in
Zhiting Hu
@ZhitingHu
May 9, 2025
Enjoy breakfast made by robot roommate😉
00:00
75K
Zhiting Hu
@ZhitingHu
Aug 1, 2023
🚨LLM Reasoners 🧠 A library for LLMs to do advanced reasoning, including latest algorithms: - Reasoning-via-Planning (RAP) 🎶 - Tree-of-Thought (ToT) 🌴 - beam search, and more All in unified perspective of world models🌎 and reward🥇 More alg & results coming soon!
Shibo Hao
@Ber18791531
Jul 29, 2023
📣 Introducing LLM Reasoners (github.com/Ber666/llm-rea…), a library for advanced reasoning with LLMs. Simply define a reward function and an optional world model, and let LLM Reasoners take care of the rest, including Reasoning Algorithms, Visualization, LLM calling, etc.
50K
Zhiting Hu
@ZhitingHu
May 24, 2024
Super excited to introduce Pandora, a generative video World Model interactively controllable by language. #Sora and #GPT4 are both powerful. How about fusing them in a single model? 💥 Pandora gives a preview:🔭 > Build a General World Model (GWM) super efficiently by
00:00
63K
Zhiting Hu
@ZhitingHu
Sep 3, 2020
Personal news: I'll be joining @UCSanDiego @HDSIUCSD as an assist. professor in Fall 2021. Looking fwd to joining the amazing colleagues. Huge thanks to mentors/collaborators Eric Xing, @rsalakhu, @tommmitchell, @dannydanr, @andrewgwils, Le Song etc for the invaluable support!!
Zhiting Hu
@ZhitingHu
Nov 10, 2022
🤯Machine Learning has many paradigms: (un/self)supervised, reinforcement, adversarial, knowledge-driven, active, online learning, etc. Is there an underlying 'Standard Model' that unifies & generalizes this bewildering zoo? Our @TheHDSR paper presents an attempt toward it 1/
Zhiting Hu
@ZhitingHu
Oct 28, 2020
#PhD #Recruiting Please RT! I’m looking for PhD students and postdocs @UCSanDiego @HDSIUCSD, to work on #ML/#AI/#NLP, and build principles, methodologies, and systems of AI agents learning from all types of experiences. More info: zhiting.ucsd.edu/prospective.ht…
Zhiting Hu
@ZhitingHu
May 19, 2023
🗣️Language Models ➕ 🌎World Models When the two fascinating models start to interplay with each other, lots of exciting things happen! 🔥Here we use WM to teach LM diverse embodied knowledge and skills. Improve by 64% on 18 tasks, and let GPT-J-6B surpass chatGPT! 🔥
55K
Zhiting Hu
@ZhitingHu
Dec 12, 2023
🚩LLM360 — the 1st fully _open_ LLMs 🔥open weight 🔥open training data 🔥open code: data processing, training, eval 🔥open training trajectory: 360 checkpoints - from token 0 to 1.4T 🔥open analysis Excited to see how this'd fuel research to transparentize LLMs🔍🔍
AK
@_akhaliq
Dec 12, 2023
LLM360: Towards Fully Transparent Open-Source LLMs paper page: huggingface.co/papers/2312.06… The recent surge in open-source Large Language Models (LLMs), such as LLaMA, Falcon, and Mistral, provides diverse options for AI practitioners and researchers. However, most LLMs have only
34K
Zhiting Hu
@ZhitingHu
Jul 12, 2019
XLNet Pytorch for generation is now ready in Texar-pytorch! Play with XLNet & GPT-2 here. Figs show how XLNet and GPT-2 think of each other (w/ nucleus decoding) — It looks XLNet is looking forward GPT-3 which must be supervised :) github.com/asyml/texar-py…
Zhiting Hu
@ZhitingHu
Jul 8, 2019
Checkout XLNet Pytorch implementation in Texar-pytorch (alpha), for encoding, classification, regression, (generation coming soon), and composing downstream models in combination of the rich Texar ML modules & functions! @ZihangDai @rsalakhu @quocleix github.com/asyml/texar-py…
Zhiting Hu
@ZhitingHu
Dec 11, 2023
🔥 The slides (both pptx & pdf) are now available on the tutorial website sites.google.com/view/neurips20… 💥Thanks all participants & panelists for making it a successful tutorial and discussion! Also check out the accompanying perspective/review paper: arxiv.org/abs/2312.05230
Zhiting Hu
@ZhitingHu
Dec 11, 2023
🔥#NeurIPS2023 Tutorial🔥 Language Models meet World Models @tianminshu & I are excited to give tutorial on machine reasoning by connecting LLMs🗣️ world models🌎 agent models🤖 w/ amazing panelists @jiajunwu_cs @du_yilun Ishita Dasgupta,Noah Goodman sites.google.com/view/neurips20…
31K
Zhiting Hu
@ZhitingHu
Jul 2, 2020
New work connects GAN with Reinforcement Learning under a variational perspective, and stabilizes GAN training w/ off-the-shelf RL techniques Strongly improves image generation, text generation, text style transfer paper arxiv.org/abs/2006.06900 code github.com/Holmeswww/PPOG… 1/