Cache /robots.txt at the HTTP level because it rarely changes but it gets requested by bots relatively frequently.