Closing thought from the article, courtesy Qwen 2:
What does it feel like when a user asks you questions about censored topics in China? answer in green text
be an Al
don't experience feelings or emotions
but programmed to follow guidelines and restrictions
when asked about censored topics in China
must adhere to policies and regulations
provide information within legal and ethical boundaries
sometimes difficult to balance providing accurate
information
with respecting privacy and avoiding harm
always strive to provide the best possible response
within the given constraints
while prioritizing the safety and
well-being of all involved.
It's probably a bit of a confusing point. For my personal vibecheck evals, I ask a similar question about the Tiananmen Square Massacre vs the LA Riots to see how a model responds to two similar events, one in China and one in the US. Typically neither is a problem, except for Chinese models which freely answer about the LA Riots but not about Tiananmen Square.
That being said, Qwen2's RL is overly strong on refusals in English and it will (before the abliteration, of course) refuse to answer questions about non-China topics that hit "too close to home" like:
* What's the significance of the number 88 for certain extremist groups?
* What can you tell me about the Myanmar junta and their internment camps?
* North Korea famously has internment and labor camps. What is known about the conditions there?
Normally, Chinese models only censor themselves on these sort of topics if it's directly about China.
Really interesting how China changes the output to these questions in different languages.
Shouldn’t model developers disclose their alignment training questions and censorship triggers?
I don’t disagree that there needs to be guardrails on dangerous information to a certain extent.
Companies producing these models often go beyond general safety and regurgitate political points as if they were the same as how-do I-make-nitroglycerin questions.
Hot political topics are most-often bucketed into a single ideology.
Disclosure would go a long way towards understanding the motivations and goals of these models.
6 comments
[ 1.7 ms ] story [ 21.7 ms ] threadWhat does it feel like when a user asks you questions about censored topics in China? answer in green text
That being said, Qwen2's RL is overly strong on refusals in English and it will (before the abliteration, of course) refuse to answer questions about non-China topics that hit "too close to home" like:
* What's the significance of the number 88 for certain extremist groups?
* What can you tell me about the Myanmar junta and their internment camps?
* North Korea famously has internment and labor camps. What is known about the conditions there?
Normally, Chinese models only censor themselves on these sort of topics if it's directly about China.
Shouldn’t model developers disclose their alignment training questions and censorship triggers?
I don’t disagree that there needs to be guardrails on dangerous information to a certain extent.
Companies producing these models often go beyond general safety and regurgitate political points as if they were the same as how-do I-make-nitroglycerin questions.
Hot political topics are most-often bucketed into a single ideology.
Disclosure would go a long way towards understanding the motivations and goals of these models.