Authors
Andreas Sauter
Saber Salehkaleybar
Aske Plaat
Erman Acar
Date (dd-mm-yyyy)
2025-03-01
Title
ACTIVA: Amortized Causal Effect Estimation via Transformer-based Variational Autoencoder
Journal
[No source information available]
Publication Year
2025-03-01
Document type
Article
Abstract
Predicting the distribution of outcomes under hypothetical interventions is crucial across healthcare, economics, and policy-making. However, existing methods often require restrictive assumptions, and are typically limited by the lack of amortization across problem instances. We propose ACTIVA, a transformer-based conditional variational autoencoder (VAE) architecture for amortized causal inference, which estimates interventional distributions directly from observational data without. ACTIVA learns a latent representation conditioned on observational inputs and intervention queries, enabling zero-shot inference by amortizing causal knowledge from diverse training scenarios. We provide theoretical insights showing that ACTIVA predicts interventional distributions as mixtures over observationally equivalent causal models. Empirical evaluations on synthetic and semi-synthetic datasets confirm the effectiveness of our amortized approach and highlight promising directions for future real-world applications.
Permalink
https://hdl.handle.net/11245.1/9bed5dc0-3455-411c-b4f3-e227f69b270e
Downloads