Peter Carey, Michael Ondaatje, Francine Prose, and at least three other writers have withdrawn from next month’s PEN American Center gala, citing objections to the literary and human rights organisation’s honouring of the French satirical magazine Charlie Hebdo.

PEN announced on Sunday that the writers were upset by Charlie Hebdo’s portrayals of Muslims and “the disenfranchised generally”. The Paris-based magazine, at whose offices 12 people were killed in a January attack, is to receive a Freedom of Expression Courage award at the 5 May event in Manhattan. Much of the literary community rallied behind Charlie Hebdo after the shootings, but some have expressed unhappiness with its scathing cartoons of the prophet Muhammad and other Muslims.

“I was quite upset as soon as I heard about [the award],” Prose, a former PEN American president, told Associated Press during a telephone interview on Sunday night. Prose said she was in favor of “freedom of speech without limitations” and that she “deplored” the January shootings, but added that giving an award signified “admiration and respect” for the honoree’s work.

“I couldn’t imagine being in the audience when they have a standing ovation for Charlie Hebdo,” Prose said.

The gala is the highlight of PEN’s annual, week-long World Voices festival and is intended as a celebration of artistic achievement and expression, with past award winners including Ondaatje, Salman Rushdie and Philip Roth. Besides Charlie Hebdo, which will be represented by editor-in-chief Gerard Biard and critic and essayist Jean-Baptiste Thoret, others receiving awards include playwright Tom Stoppard, Azerbaijani journalist Khadija Ismayilova and Penguin Random House CEO Markus Dohle.

Prose, Ondaatje and Carey were among more than 60 writers scheduled to serve as hosts. According to PEN, the other hosts who decided not to attend were Teju Cole, Rachel Kushner and Taiye Selasi.

In a letter sent earlier on Sunday to Pen trustees, current PEN American president Andrew Solomon acknowledged that several people were offended by some of Charlie Hebdo’s cartoons, but added that PEN believed strongly in the “appropriateness” of the award.

“It is undoubtedly true that in addition to provoking violent threats from extremists, the Hebdo cartoons offended some other Muslims, as their cartoons offended members of the many other groups they targeted,” Solomon wrote.

“But, based on their own statements, we believe that Charlie Hebdo’s intent was not to ostracise or insult Muslims, but rather to reject forcefully the efforts of a small minority to place broad categories of speech off-limits, no matter the purpose, intent or import of the expression,” he said. “We do not believe that any of us must endorse the contents of Charlie Hebdo’s cartoons in order to affirm the principles for which they stand, or applaud the staff’s bravery in holding fast to those values in the face of life and death threats.”