Hi! I am Dongchan Shin, a first-year PhD Student at the University of Waterloo, advised by Prof. Victor Zhong. Previously, I was a research intern at Mila - Quebec AI Institute, advised by Prof. Siva Reddy. I obtained my bachelor’s degree from the University of Hong Kong, working with Prof. Tao Yu.

My research interests lie at the intersection of language agents and AI for Scientific Discovery. In particular, I’m interested in building AI systems that can become reliable and effective research partners for scientists.

Please feel free to reach out!

Publications

• AdaptArena: Evaluating Test-Time Personalization of Web Agents
  Under Review
  Dongchan Shin, Xing Han Lù, Jiaqi Deng, Jay Gala, Tomás Vergara Browne, Jaewon Moon, Fengyuan Liu, Alexandre Drouin, Siva Reddy*, Alexandre Lacoste*

• Spider2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows
  ICLR 2025 Oral
  Fangyu Lei*, Jixuan Chen*, Yuxiao Ye, Ruisheng Cao, Dongchan Shin, Hongjin Su, Zhaoqing Suo, Hongcheng Gao, Wenjing Hu, Pengcheng Yin, Victor Zhong, Caiming Xiong, Ruoxi Sun, Qian Liu, Sida I. Wang, Tao Yu

• AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  COLM 2025
  Xing Han Lù, Amirhossein Kazemnejad, Nicholas Meade, Arkil Patel, Dongchan Shin, Alejandra Zambrano, Karolina Stanczak, Peter Shaw, Christopher J.Pal, Siva Reddy

• OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
  NeurIPS 2024 Dataset & Benchmark Track
  Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, Tao Yu

• OpenCUA: Open Foundations for Computer-Use Agents
  NeurIPS 2025 Spotlight
  Xinyuan Wang*, Bowen Wang*, Dunjie Lu*, Junlin Yang*, Tianbao Xie*, Junli Wang*, …, Dongchan Shin, …, Diyi Yang, Victor Zhong, Flood Sung, Y Charles, Zhilin Yang, Tao Yu

• DeepSeek-R1 Thoughtology: Let’s think about LLM Reasoning
  TMLR
  Sara Vera Marjanović*, Arkil Patel*, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, …, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stańczak, Siva Reddy

• OpenAgents: An Open Platform For Language Agents In The Wild
  COLM 2024
  Tianbao Xie*, Fan Zhou*, Zhoujun Cheng*, Peng Shi*, Luoxuan Weng*, Yitao Liu*, Toh Jing Hua, Junning Zhao, Qian Liu, Che Liu, Leo Z. Liu, Yiheng Xu, Hongjin Su, Dongchan Shin, Caiming Xiong, Tao Yu

News

• [Oct. 2025] Attending COLM 2025 at Montreal, Canada!

Service

• Reviewer
  ACL Demo (2025, 2026), EMNLP Demo (2026)