Tianshi Zheng 郑天石 Stone


Bibliography

Hello there!
I’m a Ph.D. candidate in Computer Science at the Hong Kong University of Science and Technology (HKUST) starting from 2024, advised by Prof. Yangqiu Song. I’m also a research intern at NVIDIA AI Technology Center. Prior to that, I obtained two bachelor’s degrees in Computer Science and General Business Management from the Dual Degree Program at the same institution with the highest distinction.

News

Research Interests

I am generally interested in Machine Learning and Natural Language Processing.

RI1. Logical Inference Towards Explanatory Hypothesis from Observations.
It naturally bridges:

RI2. AI-Driven Autonomous Scientific Discovery and Research [LLM-SD Survey].
My focus is on accelerating the autonomy of AI agents, in tasks ranging from general scientific discovery to machine learning research.

  • Self-Improving / Self-Evolving Optimization for Autonomous R&D
  • Interactive Environments for Generalizable Scientific Discovery with LLM Agents (NewtonBench)

I’ve been also working on complex logical reasoning under diverse modalities and scenarios (SQE, CLR-Fact, KnowShiftQA).

Selected Papers

  • NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agents.
    Tianshi Zheng*, Kelvin Tam*, Newt Nguyen*, Baixuan Xu, Zhaowei Wang, Jiayang Cheng, Hong Ting Tsang, Weiqi Wang, Jiaxin Bai, Tianqing Fang, Yangqiu Song, Ginny Y Wong, Simon See.
    ArXiv Preprint [pdf], [code]

  • The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning.
    Tianshi Zheng*, Yixiang Chen*, Chengxi Li*, Chunyang Li, Qing Zong, Haochen Shi, Baixuan Xu, Yangqiu Song, Ginny Y Wong, Simon See.
    TMLR 2025 [pdf], [code]

  • From Automation to Autonomy: A Survey on Large Language Models in Scientific Discovery.
    Tianshi Zheng, Zheye Deng, Hong Ting Tsang, Weiqi Wang, Jiaxin Bai, Zihao Wang, Yangqiu Song.
    EMNLP 2025 Main Conference [pdf], [code]

  • LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning.
    Tianshi Zheng, Jiayang Cheng, Chunyang Li, Haochen Shi, Zihao Wang, Jiaxin Bai, Yangqiu Song, Ginny Y Wong, Simon See.
    EMNLP 2025 Main Conference [pdf], [code]

  • Enhancing Transformers for Generalizable First-Order Logical Entailment.
    Tianshi Zheng*, Jiazheng Wang*, Zihao Wang, Jiaxin Bai, Hang Yin, Zheye Deng, Yangqiu Song, Jianxin Li.
    ACL 2025 Main Conference [pdf], [code]

  • KnowShiftQA: How Robust are RAG Systems when Textbook Knowledge Shifts in K-12 Education?
    Tianshi Zheng*, Weihan Li*, Jiaxin Bai, Weiqi Wang, Yangqiu Song.
    ACL 2025 Main Conference [pdf], [code]

Awards

  • Hong Kong PhD Fellowship 2024
  • HKUST RedBird PhD Scholarship 2024
  • HKUST Academic Achievement Medal (~top 1% graduate)
  • HKUST Dean's Lists (7 semesters)

Academic Service

Conference Reviewer: ACL Rolling Review (2023, 2024, 2025), EMNLP 2023, KDD 2024, NLPCC 2024, ICLR 2025, COLM 2025