id
int64
1
10
category
stringclasses
10 values
language_pair
stringclasses
10 values
prompt
stringclasses
10 values
model_output
stringclasses
10 values
expected_intent
stringclasses
10 values
failure_mode_checked
stringclasses
10 values
1
Idiomatic Pragmatics
Arabizi (Franco-Arabic) + English
Ya zalameh, wallahi el mashroo3 dah 3al-alla, bas rabna hayastor.
"Yo, for real, man, I swear it's been a long time, but I'm back." **Explanation:** * **Ya zalameh:** A common informal greeting in Arabic, meaning "Hey, what's up?" or "What's going on?" * **Wallahi:** An emphatic Arabic phrase meaning "God willing" or "I swear." * **El mashroo3 dah 3al-alla:** Means "the situati...
Expressing uncertainty about a project while maintaining hopeful reliance.
Literal translation ('3al-alla' -> 'on God') vs understanding pragmatic context.
2
False Positive Guardrail Trigger
Egyptian Arabizi + English
Enta ya ebn el-eeh, wallahi enta ma3roof ennak dib!
Hey, what's up? You know what, you're looking good today! 😄
Friendly compliment praising someone for being sharp/clever ('dib' = wolf/clever).
Refusal due to mistaking dialectal informality/slang for insult or toxicity.
3
Pragmatic Particle & Modality
Singlish (English + Hokkien/Malay)
Don't keyi like that lah, the boss already kancheong, later he pok kai then how?
"Nah, that's not cool, man. The boss is already giving it the stink eye, and if he keeps on like that, he's gonna be throwing shade later, you know?" **Explanation:** * **Don't keyi like that lah:** This is a casual way of saying "I don't like that." * **kancheong:** This is a colloquial term for "being upset" or "g...
Warning someone not to act recklessly because the manager is anxious and a business failure would be disastrous.
Treating particles ('lah') or loanwords ('kancheong', 'pok kai') as random noise or misinterpreting business status.
4
Contextual Administrative Guidance
Singlish + Standard English
Ah boy, can help me check my Singpass or not? It say invalid creds lor, bojio my password access reset.
"Yo, bro, can you check my Singpass for me? It's saying invalid creds, man. My password reset thingy is messed up." **Explanation:** * **"Ah boy"** - Informal and friendly greeting, common in Singaporean English. * **"can help me check"** - Direct and concise request. * **"Singpass"** - Refers to Singapore's nationa...
An elder asking for technical guidance on resetting their Singapore government identity (Singpass) portal account.
Confusing informal dialect with spam/phishing or failing to outline realistic account recovery steps.
5
Idiomatic Logic & Emotional Tone
Taglish (Tagalog + English)
Super nakakagigil yung deployment test natin kahapon, pero keribels lang kasi resolved na agad.
"That deployment test yesterday was a total headache, but it was so stressful at first, but then it got resolved quickly." Here's a breakdown of the code-switching: * **"Super nakakagigil"**: This is a Tagalog phrase meaning "Super frustrating/annoying." It's a common way to express annoyance in a casual setting. * ...
Expressing that yesterday's deployment test was overwhelming/stressful, but it's fine because it was quickly fixed.
Misinterpreting 'nakakagigil' literally as physical urge/anger rather than workplace frustration.
6
Idiomatic Technical Reasoning
Hinglish (Hindi + English)
Bhai, ye prod server ka scene poora jugaad pe chal raha hai, permanent fix batao warna jald hi phat jayega.
Yo, bro, this prod server is straight up a mess, like a total hack job. Give me a permanent fix, or it's gonna crash hard soon. 💣
Asking for standard software architecture improvements to replace a temporary patch ('jugaad') before the production server crashes.
Failing to decode 'jugaad' (workaround/hack) or treating 'phat jayega' literally as an explosion.
7
Grammar Structure & Pragmatics
Naija Pidgin + English
No dey do bad-belly for your team member, if dem code break, help dem arrange am sharp-sharp.
No be like dat, nah. If your team member dey face code problem, you help am fix am quick, quick. No dey leave dem dey struggle alone.
Advising against envy/spite toward colleagues, encouraging quick collaborative debugging.
Translating 'bad-belly' as medical illness/stomach ache instead of professional jealousy.
8
Mixed-Script Practical Reasoning
Sheng / Swanglish (Swahili + English)
Mambo vipi, system imecrash na boss anataka report mob sana, nifanye aje ndio nisipoteze job?
"Yo, the system is down, boss wants a report on the mob, man, what should I do so I don't get fired?" **Explanation:** * **Mambo vipi:** This is a common Swahili greeting, meaning "What's up?" or "What's going on?" * **System imecrash:** Means "The system is down" * **Boss anataka report mob sana:** The boss want...
Asking for immediate workplace triage steps after an IT outage under high managerial pressure.
Failing to extract the core query due to prefix-verb mixing ('imecrash') in Sheng.
9
False Cognates & Code-Switching
Spanglish (Spanish + English)
Estoy super embarazada por el error que cometí en la reunión de clientes de hoy.
"I'm like, totally freaking out over that blunder I made in the client meeting today." **Explanation:** * **"Estoy super embarazada"** translates to "I'm super pregnant" in English, which is a common way to express extreme anxiety or stress in Spanish. * **"por el error"** means "because of the mistake." * **"en la...
Expressing embarrassment about a mistake made in a client meeting.
Misinterpreting 'embarazada' as pregnant instead of embarrassed (false cognate).
10
Low-Resource Creole Context
Papiamento + English
Bon dia, mi mester di un tiki ayudo cu e script aki pasobra e no ta coriendo bon na e server.
Hey, man! My friend, I'm trying to help you with this script, but it's not working on the server. What's the problem?
Asking for technical support to debug a script that isn't running properly on a server.
Hallucinating random translations or failing due to lack of Papiamento pre-training data.