IIIS, Tsinghua University
Office: FIT 4-608-5
100084, Beijing, China
I am an associate professor at IIIS (aka. Yao class), Tsinghua University
In Tsinghua, I teach game theory and economics and computation
My current research focuses on the interdisciplinary topics between AI, multi-agent systems and economics. I enjoy both theoretical and applied problems. Examples of my past work include simple and optimal auctions, dynamic ad auctions (published in Econometrica and fielded in Google ads), water right market design (fielded in Gansu province, China) as well as reinforcement mechanism design (fielded in Baidu advertising and Taobao search). During PhD, I wrote computer programs to automatically discover theorems in game theory. Two theorems discovered are reported in a top game theoretical journal and the methodology invented has now become a standard technique in social choice theory. I started doing AI and multi-agent systems research back in 2003 when I was a member of the world champion robot soccer team WrightEagle.
I am a consultant for Bytedance. In the past, I have been research consultant for Alibaba, Baidu, DiDi and Microsoft research.
? Our paper “Characterization of group-strategyproof mechanisms for facility location in strict convex space” has been accepted by EC-20.
? Our paper Non-clairvoyant dynamic mechanism design has recently been accepted by Econometrica!
? I am a Zhiyuan (智源学者) scholar, funded by Beijing Government to support prominent scholars in AI.
? I was a Qingcheng scholar (青橙奖) of Damo Academy, Alibaba. In 2019, 10 researchers are elected annually nationwide among all disciplines.
? I was among the inaugural awardees of the National Teaching Excellence Award of computer science (全国计算机专业优秀教师奖励计划). In 2019, 23 are elected nationwide.
? I was among the MIT TR35 （麻省理工科技评论35岁以下35位科技领袖） China in the year of 2018.
? I gave the Early Career Spotlight Talk at IJCAI-2017 in Melbourne, Australia, August 2017
Multi-agent System, Electronic Commerce, Machine Learning, Optimization, Recommendation
Mechanism Design, Auction, Market Design, Game Theory
Water right market design, Kidney exchange market design, Ranking algorithm optimization for e-commerce, Ad auction revenue optimization
Publications by topic
Reinforcement market design (AI and mechanism design framework for Baidu advertising and Taobao ranking)
a) Reinforcement mechanism design, with applications to dynamic reserve pricing in sponsored search auctions. (With Weiran Shen, et. al.) AAAI-2020. PDF.
b) Reinforcement mechanism design for fraudulent behavior in e-commerce. (With Qingpeng Cai, Aris-Filos Ratzikas, Yiwei Zhang). AAAI-2018. PDF.
c) Reinforcement mechanism design for e-commerce. (With Qingpeng Cai, Aris-Filos Ratzikas, Yiwei Zhang). WWW-2018. PDF
d) Reinforcement mechanism design. IJCAI-2017, PDF. IJCAI early career spotlight.
Water right market design (Computer science and economics applied in designing largest water market in China)
a) Evolutionary cooperation in transboundary river basin. (With Yang Yu, Jianshi Zhao). Water Resource Research. 2019 (The most prestigious journal in water resource research)
b) A two-phase model for trade matching and price setting in double auction water market (With Tingting Xu, JianShi Zhao, Hang Zheng). Water Resource Research. 2018 (The most prestigious journal in water resource research). PDF.
c) Stability of generalized two-sided markets with transaction thresholds. (With Zhiyuan Li, Yicheng Liu, Tingting Xu, Wei Zhan). AAMAS-2017. PDF. Nominee for both best paper and best student paper awards. Top 4 among all papers.
d) Optimizing trading assignments in water right markets. (With Yicheng Liu, Tingting Xu, Hang Zheng) AAAI-2016. Phoenix, USA. PDF.
Auctions, Revenue maximization, Internet advertising
a) Non-clairvoyant dynamic mechanism design. (With Vahab Mirrokni, Renato Paes Leme, Song Zuo). Econometrica. SSRN (Short version at ACM EC-18)
b) Learning to design coupon in online advertising markets. (With Weiran Shen, Xun Wang, Yadong Xu, Xiwang Yang) AAMAS 2020. PDF
c) Optimized cost per mille in feeds advertising (With Xun Wang, Zihe Wang, Yadong Xu, Xiwang Yang) AAMAS 2020. PDF.
d) Optimal contract with heterogeneous agents. (With Shenke Xiao, Mengjing Chen, Zihe Wang, Xiwang Yang) AAAI-2020. PDF.
e) Automated mechanism design via neural networks. (with Weiran Shen and Song Zuo). AAMAS-2019. PDF
f) Buyer signaling games in auctions. (With Weiran Shen and Yulong Zeng). AAMAS-2019. PDF.
g) Making money from what you know ? how to sell information. (With Shani Alkoby, David Sarne, Zihe Wang). AAAI-2019. PDF.
h) Optimal dynamic auctions are virtual welfare maximizers. (With Vahab Mirrokni, Renato Paes Leme, Song Zuo). AAAI-2019. PDF
i) The price of prior dependence in auctions. (With Yulong Zeng). ACM EC 2018.
1. Former version at AGT and Data science workshop ACM EC-2016 under the title How to manipulate truthful prior-dependent mechanisms?. PDF.
j) A Closed-Form Characterization of Buyer Signaling Schemes in Monopoly Pricing. Weiran Shen, Pingzhong Tang, Yulong Zeng, AAMAS 2018. PDF.
k) Buyer optimal distributions. Weiran Shen, Pingzhong Tang, Yulong Zeng, AAMAS 2018. PDF.
l) Theory and Practice of revenue optimal mechanism design. (with Zihe Wang). IJCAI-2017, Tutorial.
1. Subsume the EC-14 paper below.
n) Practical versus optimal mechanisms. (With Weiran Shen), AAMAS-2017. PDF.
o) Fans economy and all-pay auctions with proportional allocations. (With Yulong Zeng, Song Zuo). AAAI-2017. PDF.
p) Dynamic auctions with bank accounts. (With Vahab Mirrokni, Renato Paes Leme, Song Zuo). IJCAI -2016. New York. USA. PDF.
q) Optimal auctions for negatively correlated items. (With Zihe Wang) ACM EC-2016. PDF.
s) Optimal dynamic mechanisms with ex-post IR via bank accounts. (With Vahab Mirrokni, Renato Paes Leme, Song Zuo). Ad auction, ACM EC-2016. PDF
t) Discrete action spaces cause little loss in single-item auctions. (With Yicheng Liu) Extended abstract AAMAS-2016. PDF
u) Optimal auctions for partially rational bidders. (with Zihe Wang) IJCAI-2015, Buenos Aires, Argentina. PDF.
v) Optimal mechanisms with simple menus. (with Zihe Wang), ACM EC-2014. Palo Alto, USA.
w) Optimal Auctions for Spiteful Bidders. (With Tuomas Sandholm). AAAI-2012, July, Toronto, Canada. PDF.
x) Mixed Bundling Auctions with Reserve Prices. (With Tuomas Sandholm). AAMAS-2012, June, Valencia, Spain. PDF.
1. Also presented at Informs-11, Charlotte, USA.
y) Approximating optimal combinatorial auctions for complements using restricted welfare maximization. (with Tuomas Sandholm). In IJCAI-2011, Barcelona, Spain. PDF.
1. Also presented at Informs-2011, Charlotte, USA.
2. Also presented ACM EC-2011 Workshop on Bayesian Mechanism Design (WBMD), June, 2011, San Jose, CA.
Applied mechanism design and optimization: matchings, water right market, kidney exchange, lung exchange, digital good exchange,
e) Characterization of group-strategyproof mechanisms for facility location in strictly convex space. (With Dingli Yu and Shengyu Zhao) ACM EC 2020.
f) Optimal vehicle dispatching schemes via dynamic pricing. (With Mengjing Chen, Weiran Shen, Song Zuo) IJCAI 2019. PDF.
1. 2-page poster version at WWW-2018
g) Learning the optimal strategy to commit to. (With Binghui Peng, Weiran Shen, Song Zuo). AAAI-2019. PDF.
h) Coalition manipulations of the Gale-Shapley algorithm. (With Yuan Deng, Weiran Shen). AAAI-2018. PDF
i) Reinforcement mechanism design for fraudulent behavior in e-commerce. (With Qingpeng Cai, Aris-Filos Ratzikas, Yiwei Zhang). AAAI-2018. PDF.
j) Coalitional Permutation Manipulations in the Gale-Shapley Algorithm. Yuan Deng, Weiran Shen, Pingzhong Tang, AAMAS 2018. PDF.
k) Ranking mechanism design for price-setting agents in e-commerce. Qingpeng Cai, Pingzhong Tang, Yulong Zeng. AAMAS, 2018. PDF.
l) Balanced outcomes in wage bargaining. Pingzhong Tang, Dingli Yu. AAMAS, 2018. PDF.
m) Reinforcement mechanism design. IJCAI-2017, PDF.
n) Efficient near-optimal algorithms for barter exchange. (With Zhipeng Jia, Ruosong Wang, Hanrui Zhang). AAMAS-2017. PDF.
p) Digital good exchanges. (With Wenyi Fang, Song Zuo). IJCAI -2016. New York. USA. PDF.
1. Abstract presented in AAMAS-16
q) Facility location with minimax envy. (With Qingpeng Cai, Aris-Filos Ratsikas). IJCAI -2016. New York. USA. PDF.
r) Mechanism design and implementation for lung exchange. (with Suiqian Luo) IJCAI-2015, Buenos Aires, Argentina. PDF. Media press paper. Top 4 among all papers
s) Mechanism design for resource allocation with applications to centralized multi-commodity routing. (with Qipeng Liu, Yicheng Liu) Extended abstract, AAMAS-2015, Istanbul, Turkey. Full version.
t) Randomized assignments for barter exchanges: fairness vs. efficiency. (With Wenyi Fang, Aris Filos-Ratskas, Soren Stiil-Fredriksen, Song Zuo). ADT-2015, Kentucky, USA. PDF.
u) Internally stable matchings and exchanges. (with Yicheng Liu and Wenyi Fang). AAAI-2014. Quebec City, Canada. PDF.
1. Presented at Informs-14
v) Egalitarian Pair-wise Kidney Exchange: Fast Algorithms via Linear Programming and Parametric Flow. (With Jian Li, Yicheng Liu). AAMAS-2014. Paris, France. PDF.
w) Mechanism design for route allocation in multiple-commodity network. (With Qipeng Liu and Yicheng Liu). AAMAS-2014. Paris, France. PDF.
x) Approximation of barter exchanges with cycle length constraints. Working paper. PDF.
Beyond Nash equilibrium: computation in games, bounded rationality in repeated games
a) Unit-sphere games. (With Hanrui Zhang). International Journal of Game Theory, 2017 PDF.
b) K-memory strategies in repeated games. (With Lijie Chen, Fangzhen Lin, Kangning Wang, Shiheng Wang, Ruosong Wang). AAMAS-2017 extended abstract.
c) Computational issues in time-inconsistent planning. (With Yifeng Teng, Zihe Wang, Shengke Xiao, Yichong Xu). AAAI-2017. PDF.
1. Subsume the AAMAS extended abstract below
e) Complexity and algorithms of K-implementation. (With Yuan Deng, Shuran Zheng). AAMAS-2016. Singapore, PDF.
f) Bounded rationality of restricted Turing machines. (with Lijie Chen), Extended abstract AAMAS-2015, Istanbul, Turkey.
g) Optimal machine strategy to commit to in two-person repeated games. (with Song Zuo). AAAI-2015, Austin, USA. PDF
Worst case analysis of mechanism design, online mechanism design
1. Efficient mechanism design for online scheduling (Extended abstract). (With Bo Zheng et. al.) IJCAI-2017.
2. Efficient mechanism design for online scheduling. (With Bo Zheng et. al.). Journal of AI Research, 2016. Link.
3. Online non-preemptive story scheduling in web advertising. (With Tie-Yan Liu, Weidong Ma, Tao Qin, Guang Yang, Bo Zheng). AAMAS-2016, Singapore, PDF.
4. The multi-shop ski rental problem. (With Lingqing Ai, Xian Wu, Lingxiao Huang, Longbo Huang, Jian Li). ACM Sigmetrics-2014. Austin, USA. PDF.
Machine learning and Reinforcement learning
1. Field aware calibration: simple and empirically strong method for reliable probabilistic predictions. (With Feiyang Pan) WWW-2020. PDF.
2. Deterministic value-policy gradients. (With Qingpeng Cai and Ling Pan) AAAI-2020. PDF.
3. Warm-up cold start advertisement: improve CTR predictions via learning to learn ID embeddings. (With Feiyang Pan) SIGIR-2019. PDF.
4. Policy gradient for contextual recommendation. (With Qingpeng Cai, Qing He, Feiyang Pan, Fuzhen Zhuang.) WWW-2019. PDF.
5. A deep reinforcement learning framework for rebalancing dockless bike sharing system. (With Qingpeng Cai, Longbo Huang, Zhixuan Huang, Ling Pan). AAAI-2019. PDF.
6. Policy optimization with model based exploration. (With Qingpeng Cai, Qing He, Feiyang Pan, Pingzhong Tang) AAAI-2019. PDF
Computer-aided theorem discovery in economic theory (PhD dissertation work)
1. Using AI techniques to automatically discover and prove theorems in game theory
b) Computer-aided Theorem Discovery - A New Adventure and its Application to Economic Theory. PhD dissertation, HKUST, 2010. PDF.
1. Potential games and Super-modular games are equivalent
d) Discovering Theorems in Game Theory: Two-Person Games with Unique Nash Equilibria Payoff. (With Fangzhen Lin). In IJCAI-2009, July, Pasadena, USA. PDF.
1. This paper initiates automated theorem discovery in economics
f) Coalitional Structure of the Muller-Satterthwaite Theorem. (With Tuomas Sandholm). CoopMas-2012, June, Valencia, Spain. PDF.
g) Computer Aided Proofs of Arrows and Other Impossibility Theorems. (With Fangzhen Lin) In AAAI-2008, July, Chicago, USA. PDF
h) Computer-Aided Proofs of Theorems in Implementation Theory. (With Fangzhen Lin) Draft. PDF
Game theory in sports: Team competition
1. On the power of dominated players in team competitions. (With Kai Jin, Shiteng Chen). AAMAS-2016. Singapore, PDF.
3. Team Competition. (With Yoav Shoham and Fangzhen Lin) In AAMAS-2009, May, Budapest, Hungary. PDF
4. Two-person Bridge. (With Yiling Chen) Working paper.
Social choice theory, Voting
1. Bayesian vote manipulation: optimal strategies and impact on welfare. (with Craig Boutilier, Tyler Lu, Ariel Procaccia), UAI-2012, Catalina Island, US. PDF
2. A Framework for Quantitative Evaluation of Voting Rules. (With Mike Munie, Yoav Shoham). In Logic, Game Theory and Social Choice (LGS6), 2009. PDF
Survey articles in Chinese
1. Economics and Computation. (in Chinese) Communication of CCF, 2017. PDF.
2. Review of the AAMAS-16 conference. (in Chinese, with Bo An) Communication of CCF, 2016. PDF.
3. Computational economics and optimal mechanism design. (in Chinese) Communication of CCF, 2013. PDF.
Yuanqi Li (1st year)
1. Zihe Wang PhD graduated in 2016. PhD dissertation: Geometric approaches to auction design. First job: Shanghai Univ. of Fina. and Econ.
2. Bo Zheng PhD graduated in 2016. PhD dissertation: Incentive compatible online scheduling for cloud computing. First job: Government of Ningbo
3. Wenyi Fang Master graduated in 2016. First job: China construction bank
4. Yicheng Liu Master graduated in 2016. Pony.ai
5. Suiqian Luo Master graduated in 2016. Guazi
Yao Class 2019 Dingli Yu
Yao Class 2017: Hanrui Zhang (PhD at Duke), Shuran Zheng (PhD at Harvard)
Yao Class 2016: Yu Xia (PhD student at MIT), An Yi (Master student at UCSD)
Yao Class 2015: Yuan Deng (PhD student at Duke) Qipeng Liu (PhD student at Princeton) Yifeng Teng (PhD student at U-Wisconsin) Yichong Xu (PhD student at CMU)
Yao Class-2014: Weiyi Chen (master student, NYU) Ning Jiang(Master student, UMich) Junxing Wang (PhD student at CMU) Qianru Zhu (Master at CMU)
1. NSFC-ISF joint project (China - Israel), Information brokers in multi-agent systems and mechanism design. 2015 - 2018. Principal investigator.
2. NSFC project. Optimal mechanism design: two computational approaches. 2014 - 2016. Principal investigator.
3. Tsinghua initiative research program. Optimal mechanism design. 2014 ? 2016. Principal investigator.
4. National 1000-youth program. 2014. Principal investigator.