Immigration and Customs Enforcement officers escort an arrestee in an apartment building in the Bronx on March 3, 2015, during a series of early-morning raids. (AP/Richard Drew)
On Feb. 22, websites favorable to President Donald Trump touted a poll result that showed wide support for one of the presidents highest-profile immigration policies -- cracking down on "sanctuary cities."
"SHOCK POLL: 80% OF AMERICANS OPPOSE SANCTUARY CITIES," said a headline in the conspiracy-minded site InfoWars. The poll also got prominent play on the conservative websites NewsMax, BizPacReview. Breitbart, Town Hall and American Thinker, as well as on the Russian websites RT and Sputnik.
One of our readers asked us to investigate. We decided not to put the 80 percent finding to the Truth-O-Meter, because we dont doubt the reliability of the poll itself. But questions phrased differently can show dramatically different results.
All told, the finding is a case study in how poll results can be seized by advocates for one side of an issue -- and how some of the nuances in the questions and the answers can be lost in the hubbub.
About the Harvard-Harris poll
The poll result in question came from a new and relatively little-known poll -- the Harvard-Harris survey -- that initially didnt put its full data documentation online. The shortage of information about the poll caused one contributor to the liberal website Daily Kos to wonder whether someone had "catfished" the media with fake data.
We can confirm that the polling partnership is real -- and legitimate. It is headed by longtime Democratic pollster Mark Penn and Stephen Ansolabehere, a professor of government at Harvard University and the director of its Center for American Political Studies. The poll grew out of courses the two have taught together at Harvard. Penn and Ansolabehere are collaborating on the project with the Harris Poll, a venerable public-opinion pollster.
The poll, conducted online between Feb. 11 and 13, was initially released exclusively to the Capitol Hill newspaper The Hill, and the pollsters posted a detailed presentation of the results here,
A closer look at the questions
The question in the poll that attracted the most attention -- certainly from the political right -- was this one: "Should cities that arrest illegal immigrants for crimes be required to turn them over to immigration authorities?" On this question, 80 percent of respondents said yes.
But as we looked into the question, we noticed a couple things.
One was that, despite the blaring headlines about sanctuary cities, the question being asked didnt actually use the words "sanctuary cities." The other concerned words that the question did use -- "arrest" and "crimes."
To understand why such wording choices matter -- and why they could potentially change the results of the poll -- we first need to review what the term "sanctuary city" actually means.
What is a sanctuary city?
There isnt a federal law defining "sanctuary city." Different jurisdictions that use the term -- and even some that shy away from it -- may have some policies in place that other cities dont, and vice versa. But generally speaking, it means they have policies limiting how much local law enforcement assists federal immigration authorities seeking to apprehend and deport people in the United States illegally.
For instance, San Francisco, Los Angeles, and San Diego do not hold immigrants for immigration officials unless they have violent felonies on their records or current charges, according to the Los Angeles Times.
Supporters of sanctuary cities argue that not questioning people about their immigration status builds trust between police and the community, encouraging residents to report crime and help in prosecutions. If an undocumented immigrant gets arrested for a non-immigration offense, they can still be charged, tried and convicted for that crime, Lena Graber, a special projects attorney for the Immigrant Legal Resource Center, told PolitiFact.
Opponents counter that sanctuary cities attract illegal immigration and undermine enforcement of the law. Any crime by someone in the country illegally is a crime that could have been avoided by having removed that person, Ira Mehlman, a spokesman for the Federation for American Immigration Reform, which seeks to reduce immigration levels, told PolitiFact in November.
The question wording
The specific wording used to ask any poll question is always important. Its not even necessarily a comparison of "good wording" vs."bad wording" -- if a question is asked a certain way, it could nudge respondents to answer in one direction.
In this case, respondents were asked about "crimes." To many, that could bring to mind "violent crimes," especially when paired with the term "arrest."
But the experts we spoke to said the jurisdictions described as sanctuary cities dont simply let murderers, rapists, armed robbers and other people they arrest for violent crimes go free. Not only would federal immigration officials be notified, but the violent crimes they were charged with would be prosecuted.
Instead, where the rubber hits the road with sanctuary cities is with lesser, non-violent offenses, even down to a broken tail light -- or simply any interaction with police, such as an undocumented immigrant becoming a happenstance witness to a crime. These are the cases in which police in sanctuary cities would typically be trained to refrain from asking for immigration status or informing federal immigration officials.
And this nuance is not captured by the question that garnered 80 percent support in the Harvard-Harris poll -- as well as the lions share of headlines.
"Question wording always affects responses," said Steven S. Smith, a political scientist and pollster at Washington University in St. Louis. "Arrest for crimes certainly primes the respondent to think that the person is dangerous and therefore should be a high priority in immigration law enforcement."
Karlyn Bowman, a polling analyst at the American Enterprise Institute, noted that there is little history of past polling on the issue of sanctuary cities. But she did uncover one poll released a few days after the Harvard-Harris poll that seems to back up the idea that different wording can substantially change the result.
The poll, conducted by Quinnipiac University and released on Feb. 23, asked, "Thinking about people who have immigrated to the U.S. illegally, who do you think should be deported: Should no illegal immigrants be deported, only illegal immigrants that have committed serious crimes, only illegal immigrants that have committed any crime, or should all illegal immigrants be deported?"
The results: Only 3 percent said no illegal immigrants should be deported, and 19 percent said all illegal immigrants should be deported. But 53 percent of respondents said deportations should only be done for "serious crimes," compared to 22 percent for "any crime."
Thats not just a plurality -- its a majority. And that tells a different story than the Internet headlines.
The pollsters speak
Both Ansolabehere and Penn responded to our inquiries.
Penn called our question about wording differences "an important one" and agreed that finding the right wording in a case like this one is tricky,
"We think the question is fair and clear as worded to obtain the sentiment on the issue," he said. "Had we said serious crimes, that would have tilted it one way and minor crimes would have tilted it the other way. In either case, it would be a different question about the gradations of policy, and a deep dive would surely find some nuances as with all policy."
He added that the task was made more difficult given his teams failure to find any questions on sanctuary cities that had been road-tested in previous polls.
Ansolabehere added, "If you can think of alternative wordings that capture the policy better, please send them to me."
Continue reading here:
Anatomy of a statistic: Do 80 percent of Americans oppose sanctuary cities? - PolitiFact
- Anatomy of the Phillips curve - CEPR - June 10th, 2025 [June 10th, 2025]
- Don't Expect Arizona To Return To Grey's Anatomy Anytime Soon After This Exciting Jessica Capshaw Update - Screen Rant - June 10th, 2025 [June 10th, 2025]
- Pacers vs. Thunder NBA Finals: Anatomy of a comeback How the Pacers once again did the unthinkable - Yahoo Sports - June 10th, 2025 [June 10th, 2025]
- Anatomy Of A Debacle: How Mayor Adams Went From Visionary to Bully on E-Bikes - Streetsblog New York City - June 10th, 2025 [June 10th, 2025]
- Anatomy of an At-Bat: How Matt Wallner Conquered Kevin Gausman - Twins Daily - June 10th, 2025 [June 10th, 2025]
- Enhancing anatomy education with virtual reality: integrating three-dimensional models for improved learning efficiency and student satisfaction -... - June 10th, 2025 [June 10th, 2025]
- Greys Anatomy Season 22 Cast Updates: Just Two Actors Confirmed After Shocking Finale, Though 7 More Stars Have Deals to Return - Just Jared - June 10th, 2025 [June 10th, 2025]
- S11E20: 5 Things You Should Know About Tactical Anatomy With Steve Moses - concealedcarry.com - June 10th, 2025 [June 10th, 2025]
- Airport security held Greys Anatomy star for an hour over snack - Yahoo - June 10th, 2025 [June 10th, 2025]
- Wine Walk: The anatomy of a wine bottle, its cork and how it is sealed - The Courier of Montgomery County - June 10th, 2025 [June 10th, 2025]
- MSc grad reflects on learning and legacy in the anatomy lab - Schulich School of Medicine & Dentistry - June 10th, 2025 [June 10th, 2025]
- Greys Anatomy star Ellen Pompeo says TSA detained her over sunflower seeds - Washington Times - June 10th, 2025 [June 10th, 2025]
- Cardiac Anatomy & Orientation of the 3D Heart Part 3 - University of Nebraska Medical Center - June 1st, 2025 [June 1st, 2025]
- Greys Anatomy Star Chris Carmack Teases Link and Jos Season 22 Storyline: Anything Can Happen - Life & Style - June 1st, 2025 [June 1st, 2025]
- Greys Anatomy Star Reveals Her Secret to Flying Under the Radar on Planes - EntertainmentNow - June 1st, 2025 [June 1st, 2025]
- None of her preserved anatomy looked like any other fossil. Scientists Realize That A Fossil Thats Millions Of Years Old Was Fossilized From The... - June 1st, 2025 [June 1st, 2025]
- Greys Anatomy star is fighting to get Denzel Washington on the show: 'Im hoping he does it' - GeekSided - June 1st, 2025 [June 1st, 2025]
- No, Sandra Oh is not watching Greys Anatomy in her free time - GeekSided - June 1st, 2025 [June 1st, 2025]
- Brigitte and Emmanuel Macron the anatomy of a slap - The Spectator World - June 1st, 2025 [June 1st, 2025]
- Sandra Oh Reveals If She Watches Grey's Anatomy Reruns 11 Years Since Cristina Yang Left The Show - Screen Rant - June 1st, 2025 [June 1st, 2025]
- Fan-Favorite Greys Anatomy Star Sandra Oh Reveals Whether She Still Watches the Show or Not - Collider - June 1st, 2025 [June 1st, 2025]
- Greys Anatomy: Why Did Sandra Oh Leave The Show? Revisiting Her Shocking Exit & Remarkable Legacy - Koimoi - June 1st, 2025 [June 1st, 2025]
- Warfare at night, deepfakes by day: The anatomy of a rumour in modern era conflicts - The Indian Express - June 1st, 2025 [June 1st, 2025]
- Greys Anatomy Hunk, 59, Turns Heads in Rare Monaco Outing With Wife - parade.com - June 1st, 2025 [June 1st, 2025]
- Grey's Anatomy season 22 confirmed to premiere in fall 2025 - GeekSided - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy season 21 finale: Where to watch for free tonight - MassLive - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Showrunner Meg Marinis Confirms Your Fears After That Explosive Cliffhanger Finale - The Hollywood Reporter - May 21st, 2025 [May 21st, 2025]
- 'Grey's Anatomy' Recap: Did Firebomb Just Kill Off Lucas Adams, Teddy Altman, or Miranda Bailey? - TV Insider - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy season 22 will not introduce any major new additions: 'I have a big enough cast as it is' - GeekSided - May 21st, 2025 [May 21st, 2025]
- 8 Biggest Unanswered Questions & Mysteries After The Grey's Anatomy Season 21 Finale - Screen Rant - May 21st, 2025 [May 21st, 2025]
- Only 2 Grey's Anatomy characters are confirmed to be safe in season 22 - GeekSided - May 21st, 2025 [May 21st, 2025]
- 'Grey's Anatomy': Meredith Puts Herself in Harm's Way Once Again as a Hostage Situation Leaves Grey Sloan Reeling - People.com - May 21st, 2025 [May 21st, 2025]
- This Greys Anatomy character death still remains the shows most gut-wrenching - GeekSided - May 21st, 2025 [May 21st, 2025]
- Anatomy Of A Perfect Trip Cybercaf Across The Algarve - Quartersnacks - May 21st, 2025 [May 21st, 2025]
- Why the Greys Anatomy Hospital Is Facing Another Bomb Threat in Season 21 Finale - E! Online - May 21st, 2025 [May 21st, 2025]
- Streaming Set Another Record In April, But Greys Anatomy And The White Lotus Prove Linears Reach, Nielsen Says - Deadline - May 21st, 2025 [May 21st, 2025]
- 'Grey's Anatomy' Boss Answers the Biggest Questions From That Explosive Season Finale (Exclusive) - parade.com - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Season-Finale Recap: Explosions in the Sky - Vulture - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Boss Breaks Down That Explosive Season 21 Finale Cliffhanger, Merediths Surprising Decision - TheWrap - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy boss confirms one new star will return in season 22 - GeekSided - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Season 21 Finale Review: I Cant Believe The Show Pulled Off This Cliffhanger Reminiscent Of Its Glory Days - Screen Rant - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy Finale Preview: Chris Carmack Teases 'Be Afraid' - Us Weekly - May 21st, 2025 [May 21st, 2025]
- ABC NEWS STUDIOS ANNOUNCES HEY BEAUTIFUL: ANATOMY OF A ROMANCE SCAM BEGINS STREAMING MAY 20, ONLY ON HULU - dgepress.com - May 21st, 2025 [May 21st, 2025]
- 5 Grey's Anatomy characters who might not return for season 22 after that fiery cliffhanger - GeekSided - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Explosion & Possible Character Deaths: Showrunner Explains Why Shes Doing This to Link & Jo - Just Jared - May 21st, 2025 [May 21st, 2025]
- 'Grey's Anatomy' season 21 ending explained: Is Meredith returning to Grey Sloan for good? - Entertainment Weekly - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy Season 21 Finally Resolved Its Most Frustrating Plot In Limbo - Screen Rant - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy Season 21 Ending Explained: Amelia Survives A Near-Death Experience While Tragedy Strikes A Fan-Favorite - Screen Rant - May 21st, 2025 [May 21st, 2025]
- James Pickens Jr. Says Every Day Is an Adventure on 'Greys Anatomy' (Exclusive) - People.com - May 21st, 2025 [May 21st, 2025]
- The Doctor Is Out: Greys Anatomy Ends Season 21 With a Devastating Death - Yahoo - May 21st, 2025 [May 21st, 2025]
- Greys Anatomy Season 22 Cast: Only 2 Characters Confirmed Alive After Finale, Though 7 More Actors Have Deals to Return - Just Jared - May 21st, 2025 [May 21st, 2025]
- 'Grey's Anatomy' Interview: James Pickens Jr. Reflects on Pilot and Reveals Season 22 Hopes (Exclusive) - TV Insider - May 21st, 2025 [May 21st, 2025]
- Grey's Anatomy tells fans to "brace yourself" for season finale that's as dramatic as this iconic episode - Digital Spy - May 21st, 2025 [May 21st, 2025]
- I Can't Believe Grey's Anatomy Still Hasn't Told Us Who Adams' Mother Is - Cinemablend - May 21st, 2025 [May 21st, 2025]
- Katherine Heigl Shares Why She's Grateful Her Daughters Aren't Interested in Grey's Anatomy (Exclusive) - parade.com - May 12th, 2025 [May 12th, 2025]
- 'Grey's Anatomy' Fans Are Just Realizing This Fun Fact About the Series That Affects All but 1 Episode - People.com - May 12th, 2025 [May 12th, 2025]
- In a Nutshell: Turning anatomy education into online sensation - Ohio University - May 12th, 2025 [May 12th, 2025]
- 'Grey's Anatomy' Gets Musical Again: Link Serenades Jo With Song at the Wedding Altar - TV Insider - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy Boss Unpacks Jo and Links Momentous Wedding Song, Teases Bonkers Season 21 Finale - TheWrap - May 12th, 2025 [May 12th, 2025]
- Generating cervical anatomy labels using a deep ensemble multi-class segmentation model applied to transvaginal ultrasound images - Nature - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy creator Shonda Rhimes reveals the hardest death she had to write - Yahoo - May 12th, 2025 [May 12th, 2025]
- Katherine Heigl Reveals What 1 Medical Trick She Thinks She Could Still Do After Grey's Anatomy (Exclusive) - parade.com - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy Season 21, Episode 17 Review: As A Long-Time Fan, I Loved This Romantic & Poignant Episode That Felt Like Classic Greys - Screen... - May 12th, 2025 [May 12th, 2025]
- As One Greys Anatomy Couple Weds, Another Breaks Up and a Third Relationship Lands on Life Support - TVLine - May 12th, 2025 [May 12th, 2025]
- Every Wedding on Greys Anatomy , Ranked - Vulture - May 12th, 2025 [May 12th, 2025]
- 'Greys Anatomy': Link Surprises Jo at Their Wedding, Owen Holds onto the Past and 1 Couple Calls It Quits - People.com - May 12th, 2025 [May 12th, 2025]
- Here comes the bride: Where to stream Greys Anatomy for FREE - PennLive.com - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy Preview: Will Link and Jo I Do It Right On Their Wedding Day? Plus, [Spoiler]s Back - TVLine - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy boss reveals the disappointing reason Meredith missed Jo and Links wedding - GeekSided - May 12th, 2025 [May 12th, 2025]
- Anatomy Of Startup Governance Issues, Funding Zooms & More - StartupNews.fyi - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy Shock: Lucas and Simone Split Will Fans Even Miss Them? - Decatur Metro - May 12th, 2025 [May 12th, 2025]
- 9 Secrets of the Greys Anatomy Sets Superfans Need to Know - Architectural Digest - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy Continues to Ignore a Key Character's Storyline (& It's Frustrating Fans) - Comic Book Resources - May 12th, 2025 [May 12th, 2025]
- Jo & Link's Unique Wedding Set-Up Is Exactly Why Their Romance Works In Grey's Anatomy - Screen Rant - May 12th, 2025 [May 12th, 2025]
- Greys Anatomy creator Shonda Rhimes reveals the hardest death she had to write - The Independent - May 12th, 2025 [May 12th, 2025]
- Grey's Anatomy fans are just realizing clever aspect of 'every episode' after 20 years - The Mirror US - May 12th, 2025 [May 12th, 2025]
- Did the Success of The Substance and Anatomy of a Fall Finally Teach Cannes a Lesson? - IndieWire - May 12th, 2025 [May 12th, 2025]
- Grey's Anatomy fans floored after spotting 'hidden message' in every episode - Irish Star - May 12th, 2025 [May 12th, 2025]
- Anatomy of an apprehension: Where are you taking the baby? - Maple Ridge-Pitt Meadows News - May 12th, 2025 [May 12th, 2025]
- Isaiah Washington Says Sandra Oh Brought Him Back on Greys Anatomy Years After Firing - E! Online - April 27th, 2025 [April 27th, 2025]