Ruotong Liao | LMU Munich & Munich Center of Machine Learning

About Me

I am a Ph.D. student at LMU Munich supervised by Prof. Volker Tresp. I am an enthusiastic AI researcher in the field of Generative AI, foundational multi-modal models, and large language models, with a special focus on reasoning on temporal data such as videos, dynamic graphs, etc. Prior to my PhD, I finished my Bachelor’s at Beijing Institute of Technology (BIT) and my Master’s at Technical University of Munich (TUM) in Electrical Engineering. After that, I started my PhD program fully funded by Munich Center of Machine Learning (MCML), the German permanent AI center. I am awarded additional personal funding of 130,000 Euro from the German Ministry of Education and Research (BMBF) and German Aerospace Center (DLR), in collaboration with Huawei Munich Research Center aiming for supporting my research and cultivating me as the future tech lead.

Please reach out if you are interested in collaborations, master thesis, and research assistants!

Large Language Models: reasoning with LLMs, evaluation, retrieval-augmented generation
Structured Graph Data: (temporal) knowledge graphs, dynamic graphs, scene graphs
Multi-modal Reasoning: foundation models, visual-language models, video understanding

[Jul. 2024] I finished the BOSCH Innovation & Entrepreneurship training.
[Jul. 2024] 🎉One paper accepted to ECCV 2024!
[Jul. 2024] 🎉Accepted to ELLIS Summer School of Collaborative and Generative AI (CoGenAI). See you in Helsinki!
[Jun. 2024] Yoshua Bengio is the speaker! We organized the ELLIS Workshop of Semantic, Symbolic and Interpretable Machine Learning (SSIML@ELLIS) together with ELISE Wrap Up Conference & ELLIS Community Event in Helsinki.
[Jun. 2024] Happy to be in Mexico and present our work at NAACL2024.
[Apr. 2024] Joint project with Huawei Munich Research Center kicked off.
[Mar. 2024] 🎉Two papers accepted to NAACL2024!
[Feb. 2024] Invited Talk of Foundation Models on Temporal Graphs at Semantic, Symbolic and Interpretable Machine Learning workshop hosted at the Oberwolfach Research Institute for Mathematics (MFO), Germany.
[Dec. 2023] Invited Spotlight Talk of Generative Forcasting on Temporal Knowlege Graph at TGL@NeurIPS2023. See you in New Orleans!
[Jul. 2023] 🎉Awarded with personal funding of 130,000 euro by BMBF and DLR to support my research and aim for future tech lead!
[May. 2023] 🎉One paper accepted as Finding of ACL 2023!

2023 Funding Award of 130,000 euro by BMBF(German Federal Ministry of Education and Research) and DLR (German Aerospace Center).
2019 Full Scholarship for KSOP Master Programm at Karlsruhe Institute of Technology (KIT).
2019 Full Scholarship for Master Programm in Optics at Friedrich Schiller University Jena.
2018 Outstanding Student Leader as Vice Student President at Beijing Institute of Technology.
2018 Chinese National third Prize in the 6th National Photo-electric Design Competition.
2017 Funding Award for National College Students Innovation and Entrepreneurship Programm.
2016 Outstanding Student for Undergraduates.
2015 Scholarship for First Prize of Excellent Students for Undergraduates.

Prompt Tuning for LLM-based Multi-Agent Systems . Master Thesis @ LMU Munich & MSG systems AG, WiSe2024
Invstigating Temporal Reasoning on Large Language Models. Master Thesis @ Technical University of Munich (TUM), SoSe2023
Video Understanding with Large Language Models (I). Research Intern @ Universit of Edingburgh, SoSe2023
Video Understanding with Large Language Models (II). Master Thesis @ LMU Munich, WiSe2023
Cross-domain and In-domain Generalizibility of Large Language Models on Temporal Data. Research Intern @ Technical University of Munich (TUM), WiSe2023
Knowledge Graphs for Question Answering with Language Models. Master Thesis @ LMU Munich & Inovex GmbH, SoSe2023
Knowledge Augmented Generation for Large Language Models. Master Thesis @ TUM, WiSe2022
Temporal Knowledge Graph for Temporal Question Answering. Master Thesis @ LMU Munich & TUM, WiSe2022

I served as a coach for the National Olympiad in Informatics Programming for three years and was the co-founder of a startup for computer science education.
I once led an organization committee for a concert for more than 3,000 people.
I won the Fifth Prize in a video-making competition on Bilibili (Chinese YouTube).