Article by Pew Research: “As artificial intelligence becomes more advanced, there is growing interest in using it to stand in for real respondents in public opinion surveys. Put simply: Instead of contacting large numbers of people and asking them what they think, pollsters can ask an AI model to predict how those people would have answered a certain question.
Pew Research Center has long sought to better understand new developments in public opinion research, and we wanted to learn more about how this AI-based polling works. So we ran an experiment. We developed a state-of-the-art process for fielding AI surveys and compared their results with three recent survey waves from our American Trends Panel (ATP) taken by human respondents at roughly the same time.
This experiment taught us that, at this time, AI models are not an adequate replacement for traditional polling on topics of broad public importance. Our AI-generated survey results struggled to accurately reproduce the findings from high-quality public opinion polls in a variety of ways.
Here are some of the main issues we encountered:
Results of AI polls differed – often by quite a lot – from results of human surveys
Across nearly 300 individual survey questions, the estimates produced using our AI respondents differed from their human counterparts by an average of 12 percentage points...(More)”.
