Entertainment website TMZ said sources claimed producers were concerned the singer’s Newcastle accent was too strong for US audiences.
Cole’s UK publicist has refused to comment on the story.
Reports says Former Pussycat Doll Nicole Scherzinger, who had been lined up to co-host will replace her.
After months of speculation, it was confirmed earlier this month that Cole had landed the coveted spot on the judging panel alongside former American Idol judge Paula Abdul, Antonio LA Reid and Simon Cowell.
