Nov 14 – 16, 2025
US/Eastern timezone

Does visualization help AI understand data?

Nov 16, 2025, 1:50 PM
10m
Emergent Technology Presentations Session

Description

Charts and graphs help people analyze data—but can they also be useful to AI systems? To investigate this question, we perform a series of experiments with two commercial vision-language models: GPT 4.1 and Claude 3.5. Across three representative analysis tasks, the two systems describe synthetic data sets more precisely and accurately when raw data is accompanied by a scatterplot, especially as datasets grow in complexity. Comparison with two baselines -- providing a blank chart and a chart with mismatched data -- shows that the improved performance is due to the content of the charts. We provide initial evidence that AI systems, like humans, can benefit from visualization.

Authors

Johnathan Sun (Harvard) Martin Wattenberg (Harvard) Victoria Li (Harvard)

Presentation materials

There are no materials yet.