PyWhy talk series: DAGitty. This Monday Johannes Textor will be talking about the amazing dagitty tool and lessons learnt about using causal graphs in science. Monday, Feb 26, 8am PT/9:30pm IST. Join here: groups.google.com/g/pywhy-causal…

We take a closer look at prompt optimization problem & develop UniPrompt for learning LM prompt for a task from scratch. We argue when greedy opt. methods could help in this discrete & challenging problem. Gurusha Juneja, Amit Sharma, Hua Li & Jian Jiao. arxiv.org/pdf/2406.10504

Can we teach Transformers Causal Reasoning? We propose Axiomatic Framework, a new paradigm for training LMs. Our 67M-param model, trained from scratch on simple causal chains, outperforms billion-scale LLMs and rivals GPT-4 in inferring cause-effect relations over complex graphs

Semi-symbolic Training for Causal Reasoning in Transformers? Matching performance with 26,000 times fewer parameters. 🧵 1/n #causality #transformers #machinelearning #ai

Teaching Transformers Causal Reasoning through Axiomatic Training The ability to reason causally is increasingly recognized as a crucial skill for AI systems to interact effectively with the real world. However, teaching LLMs to understand and apply causal relationships has