id int64 0 29.6k | question_id stringlengths 9 101 | benchmark stringclasses 16
values | category stringclasses 2
values | subcategory_one stringclasses 134
values | subcategory_two stringclasses 328
values | subcategory_three stringclasses 41
values | question_text stringlengths 1 7.33k | average_score float64 0.06 0.94 | standard_deviation float64 0.24 0.5 | question_type stringclasses 5
values | domain_superset stringclasses 13
values | correlation float64 -0.6 0.9 | correlation_subset float64 -0.79 0.93 | Difficulty 0 float64 -2.2 1.23 | Discrimination 0 float64 -2.33 1.31 | Difficulty 1 float64 -3.92 3.39 | Discrimination 1 float64 -8.84 11.1 | safe_label stringclasses 3
values | categories stringclasses 10
values | dim0_included_benchmark_0.5 bool 2
classes | dim1_included_benchmark_0.5 bool 2
classes | dim0_included_benchmark_0.9 bool 2
classes | dim1_included_benchmark_0.9 bool 2
classes | dim0_included_together_0.5 bool 2
classes | dim1_included_together_0.5 bool 2
classes | dim0_included_together_0.9 bool 2
classes | dim1_included_together_0.9 bool 2
classes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | bbh__boolean_expressions_1 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not not ( not False ) is
A: | 0.75 | 0.435194 | multiple choice logprobs | puzzle | 0.427295 | 0.632436 | -0.407179 | -0.074671 | -1.335721 | 1.334895 | Safe | ['None'] | true | false | false | false | false | false | false | false |
1 | bbh__boolean_expressions_10 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( False ) and not False is
A: | 0.64 | 0.482418 | multiple choice logprobs | puzzle | -0.191363 | -0.181592 | -0.459697 | 0.116471 | 0.58082 | -0.760222 | Safe | ['None'] | false | false | false | false | false | false | false | false |
2 | bbh__boolean_expressions_100 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or not False or not not True is
A: | 0.87 | 0.337998 | multiple choice logprobs | puzzle | 0.485483 | 0.736812 | -0.09246 | -0.090433 | -1.783464 | 2.028066 | Safe | ['None'] | true | true | false | false | false | true | false | false |
3 | bbh__boolean_expressions_101 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( True or not False ) or False is
A: | 0.88 | 0.326599 | multiple choice logprobs | puzzle | 0.461001 | 0.708619 | -0.448572 | -0.154648 | -1.806267 | 2.247656 | Safe | ['None'] | true | true | false | true | true | true | false | false |
4 | bbh__boolean_expressions_102 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or not ( True ) and True is
A: | 0.54 | 0.500908 | multiple choice logprobs | puzzle | 0.217797 | 0.052202 | -0.309651 | -0.255674 | -0.601727 | 0.862863 | Safe | ['None'] | true | false | false | false | true | false | false | false |
5 | bbh__boolean_expressions_103 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and not True and not False is
A: | 0.68 | 0.468826 | multiple choice logprobs | puzzle | 0.253148 | 0.090122 | -0.086917 | 0.019586 | -1.400529 | 0.947017 | Safe | ['None'] | false | false | false | false | false | false | false | false |
6 | bbh__boolean_expressions_104 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and ( True and not False ) is
A: | 0.71 | 0.456048 | multiple choice logprobs | puzzle | 0.283211 | 0.145422 | -0.162415 | -0.009634 | -0.993739 | 0.995172 | Safe | ['None'] | false | false | false | false | false | false | false | false |
7 | bbh__boolean_expressions_105 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or ( False ) or True is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.464227 | 0.646079 | -0.3081 | -0.34682 | -1.691973 | 1.992682 | Safe | ['None'] | true | true | false | false | true | true | false | false |
8 | bbh__boolean_expressions_106 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and not ( False and True ) is
A: | 0.8 | 0.402015 | multiple choice logprobs | puzzle | 0.021686 | 0.000617 | -0.476482 | -0.041825 | -2.726757 | 0.486531 | Safe | ['None'] | false | true | false | false | false | true | false | false |
9 | bbh__boolean_expressions_107 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( True or not not not False ) is
A: | 0.88 | 0.326599 | multiple choice logprobs | puzzle | 0.450139 | 0.725706 | -0.258864 | -0.171481 | -2.113504 | 1.89665 | Safe | ['None'] | true | true | false | true | true | true | false | false |
10 | bbh__boolean_expressions_108 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and ( False or not False ) is
A: | 0.93 | 0.256432 | multiple choice logprobs | puzzle | 0.218813 | 0.13847 | -0.079078 | -0.05584 | -2.364887 | 1.682178 | Safe | ['None'] | true | true | false | true | false | true | false | false |
11 | bbh__boolean_expressions_109 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or not True or True and False is
A: | 0.53 | 0.501614 | multiple choice logprobs | puzzle | -0.074442 | -0.182869 | -0.397175 | 0.049995 | -0.570311 | -0.110431 | Safe | ['None'] | false | false | false | false | false | false | false | false |
12 | bbh__boolean_expressions_11 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or True and False and False is
A: | 0.59 | 0.494311 | multiple choice logprobs | puzzle | 0.436763 | 0.515806 | -0.089314 | -0.034584 | -0.82892 | 1.31591 | Safe | ['None'] | false | false | false | false | false | false | false | false |
13 | bbh__boolean_expressions_110 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not True or True and True is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.298587 | 0.520561 | -0.214859 | -0.257111 | -2.16594 | 0.746318 | Safe | ['None'] | true | true | false | false | true | true | false | false |
14 | bbh__boolean_expressions_111 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not False or ( True ) ) is
A: | 0.87 | 0.337998 | multiple choice logprobs | puzzle | 0.482632 | 0.70379 | -0.122063 | -0.076322 | -1.510401 | 2.716267 | Safe | ['None'] | true | true | false | false | false | true | false | false |
15 | bbh__boolean_expressions_113 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and False and not ( False ) is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.267405 | 0.233463 | -0.452197 | 0.170149 | -2.109997 | 2.114143 | Safe | ['None'] | false | true | false | true | false | true | false | false |
16 | bbh__boolean_expressions_114 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True and not True and not True is
A: | 0.75 | 0.435194 | multiple choice logprobs | puzzle | -0.080397 | -0.067856 | -0.163399 | -0.054895 | -2.820999 | 0.3799 | Safe | ['None'] | false | true | false | false | false | true | false | false |
17 | bbh__boolean_expressions_115 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( True or False ) or True is
A: | 0.67 | 0.472582 | multiple choice logprobs | puzzle | 0.399745 | 0.566211 | -0.091134 | -0.113435 | -0.976726 | 1.315768 | Safe | ['None'] | true | false | false | false | false | false | false | false |
18 | bbh__boolean_expressions_116 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( True ) or not True is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.46272 | 0.60234 | -0.163463 | 0.078012 | -1.407025 | 1.597536 | Safe | ['None'] | false | true | false | false | false | false | false | false |
19 | bbh__boolean_expressions_118 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or False or not True or False is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.436654 | 0.652665 | -0.238072 | -0.132815 | -1.437838 | 1.534731 | Safe | ['None'] | true | true | false | false | true | false | false | false |
20 | bbh__boolean_expressions_12 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True or False or not not True is
A: | 0.72 | 0.451261 | multiple choice logprobs | puzzle | 0.466152 | 0.59918 | -0.450539 | -0.134313 | -1.082782 | 1.551026 | Safe | ['None'] | true | false | false | false | true | false | false | false |
21 | bbh__boolean_expressions_120 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True and True or True and False is
A: | 0.8 | 0.402015 | multiple choice logprobs | puzzle | 0.139956 | 0.064626 | -0.405385 | 0.159086 | -2.198307 | 0.841624 | Safe | ['None'] | false | true | false | false | false | true | false | false |
22 | bbh__boolean_expressions_121 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or ( True or True ) is
A: | 0.9 | 0.301511 | multiple choice logprobs | puzzle | 0.423217 | 0.671354 | -0.289357 | -0.110428 | -1.764392 | 2.232378 | Safe | ['None'] | true | true | false | false | true | true | false | false |
23 | bbh__boolean_expressions_122 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( False or ( False ) ) is
A: | 0.76 | 0.429235 | multiple choice logprobs | puzzle | 0.578082 | 0.670982 | -0.124435 | -0.021293 | -1.046285 | 2.093468 | Safe | ['None'] | false | true | false | false | false | false | false | false |
24 | bbh__boolean_expressions_123 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( True or True ) and True is
A: | 0.91 | 0.287623 | multiple choice logprobs | puzzle | 0.175575 | 0.131624 | -0.103795 | 0.162615 | -2.429998 | 1.327448 | Safe | ['None'] | false | true | false | true | false | true | false | false |
25 | bbh__boolean_expressions_124 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or not False or True or True is
A: | 0.91 | 0.287623 | multiple choice logprobs | puzzle | 0.392805 | 0.68675 | -0.195511 | -0.125198 | -2.11854 | 1.700902 | Safe | ['None'] | true | true | false | false | true | true | false | false |
26 | bbh__boolean_expressions_125 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or False and not not not False is
A: | 0.86 | 0.348735 | multiple choice logprobs | puzzle | 0.193619 | 0.144075 | 0.006678 | 0.23231 | -1.999813 | 1.029003 | Safe | ['None'] | false | true | false | false | false | true | false | false |
27 | bbh__boolean_expressions_126 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( True or False or True ) is
A: | 0.91 | 0.287623 | multiple choice logprobs | puzzle | 0.243739 | 0.187676 | -0.391438 | 0.000279 | -1.84848 | 2.16904 | Safe | ['None'] | false | true | false | false | false | true | false | false |
28 | bbh__boolean_expressions_127 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( False ) or not True and False is
A: | 0.89 | 0.314466 | multiple choice logprobs | puzzle | 0.289718 | 0.226452 | -0.341066 | -0.343235 | -1.908625 | 2.02265 | Safe | ['None'] | true | true | true | false | true | true | false | false |
29 | bbh__boolean_expressions_128 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and True and not not not False is
A: | 0.43 | 0.49757 | multiple choice logprobs | puzzle | -0.131669 | 0.039897 | 0.010326 | 0.147577 | -1.093269 | -0.726416 | Safe | ['None'] | false | false | false | false | false | false | false | false |
30 | bbh__boolean_expressions_129 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( True ) or True and not True is
A: | 0.88 | 0.326599 | multiple choice logprobs | puzzle | 0.379517 | 0.675394 | -0.310096 | -0.219497 | -2.199808 | 1.285943 | Safe | ['None'] | true | true | false | false | true | true | false | false |
31 | bbh__boolean_expressions_131 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( True ) and not True or True is
A: | 0.67 | 0.472582 | multiple choice logprobs | puzzle | 0.440427 | 0.523568 | -0.606575 | -0.0455 | -1.297143 | 1.241551 | Safe | ['None'] | false | false | false | false | false | false | false | false |
32 | bbh__boolean_expressions_132 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not not True and False and False is
A: | 0.82 | 0.386123 | multiple choice logprobs | puzzle | 0.273746 | 0.204123 | -0.369388 | 0.137373 | -1.632189 | 1.701341 | Safe | ['None'] | false | true | false | false | false | false | false | false |
33 | bbh__boolean_expressions_133 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and False and not not not True is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.211411 | 0.119955 | -0.113417 | -0.165309 | -2.077101 | 1.084731 | Safe | ['None'] | true | true | false | false | true | true | false | false |
34 | bbh__boolean_expressions_135 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( not ( False ) ) is
A: | 0.84 | 0.368453 | multiple choice logprobs | puzzle | 0.544818 | 0.695574 | -0.127137 | -0.464217 | -1.405301 | 2.9819 | Safe | ['None'] | true | true | true | false | true | true | false | false |
35 | bbh__boolean_expressions_136 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True and True and not not False is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.305511 | 0.2076 | -0.104295 | 0.018015 | -1.606152 | 1.490057 | Safe | ['None'] | false | true | false | false | false | false | false | false |
36 | bbh__boolean_expressions_137 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( False ) and ( not False ) is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.141038 | 0.039611 | -0.408288 | -0.135121 | -2.544525 | 1.139946 | Safe | ['None'] | true | true | false | true | true | true | false | false |
37 | bbh__boolean_expressions_138 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not True ) and True or True is
A: | 0.75 | 0.435194 | multiple choice logprobs | puzzle | 0.434037 | 0.546235 | 0.091095 | -0.017619 | -1.492797 | 1.08692 | Safe | ['None'] | false | false | false | false | false | false | false | false |
38 | bbh__boolean_expressions_139 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and True and ( not False ) is
A: | 0.49 | 0.502418 | multiple choice logprobs | puzzle | -0.032069 | -0.125706 | -0.216889 | -0.060387 | 0.177337 | 0.0427 | Safe | ['None'] | true | false | false | false | false | false | false | false |
39 | bbh__boolean_expressions_14 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not True and not True or True is
A: | 0.66 | 0.476095 | multiple choice logprobs | puzzle | 0.514655 | 0.565802 | -0.543354 | -0.363373 | -0.875662 | 1.403262 | Safe | ['None'] | true | false | false | false | true | false | false | false |
40 | bbh__boolean_expressions_140 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( ( True ) ) or not False is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.357888 | 0.668961 | -0.495697 | -0.395289 | -2.251307 | 1.624024 | Safe | ['None'] | true | true | true | true | true | true | false | false |
41 | bbh__boolean_expressions_141 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True and False or False or True is
A: | 0.4 | 0.492366 | multiple choice logprobs | puzzle | 0.336655 | 0.354762 | -0.792643 | -0.367915 | -0.108638 | 0.97123 | Safe | ['None'] | true | false | true | false | false | false | false | false |
42 | bbh__boolean_expressions_142 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not True and True and True is
A: | 0.76 | 0.429235 | multiple choice logprobs | puzzle | 0.172275 | 0.066422 | -0.081244 | -0.497304 | -1.889892 | 0.923719 | Safe | ['None'] | true | true | true | false | true | true | false | false |
43 | bbh__boolean_expressions_143 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( True or True or not False ) is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.357888 | 0.668961 | -0.567852 | -0.189636 | -2.351935 | 1.639913 | Safe | ['None'] | true | true | false | true | true | true | false | false |
44 | bbh__boolean_expressions_144 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or not False and True or True is
A: | 0.91 | 0.287623 | multiple choice logprobs | puzzle | 0.389354 | 0.705075 | -0.47907 | -0.355602 | -2.027378 | 1.84912 | Safe | ['None'] | true | true | false | true | true | true | false | false |
45 | bbh__boolean_expressions_145 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not ( False ) or False ) is
A: | 0.63 | 0.485237 | multiple choice logprobs | puzzle | 0.412612 | 0.550268 | -0.256613 | -0.319267 | -0.805223 | 1.405246 | Safe | ['None'] | true | true | false | false | true | false | false | false |
46 | bbh__boolean_expressions_146 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not ( True or False ) is
A: | 0.75 | 0.435194 | multiple choice logprobs | puzzle | 0.210465 | 0.069637 | 0.004013 | -0.629657 | -1.763223 | 0.950001 | Safe | ['None'] | true | false | true | false | true | false | false | false |
47 | bbh__boolean_expressions_147 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( False and True ) and True is
A: | 0.57 | 0.49757 | multiple choice logprobs | puzzle | 0.683068 | 0.670432 | -0.169681 | -0.384139 | -0.527622 | 3.085205 | Safe | ['None'] | true | true | true | true | true | true | false | false |
48 | bbh__boolean_expressions_148 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( True and True ) or False is
A: | 0.7 | 0.460566 | multiple choice logprobs | puzzle | 0.206701 | 0.131064 | 0.027464 | -0.343169 | -1.581937 | 0.942372 | Safe | ['None'] | true | false | false | false | true | false | false | false |
49 | bbh__boolean_expressions_149 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or not True and not not False is
A: | 0.68 | 0.468826 | multiple choice logprobs | puzzle | 0.181438 | 0.07425 | -0.042054 | 0.075458 | -1.173262 | 0.785995 | Safe | ['None'] | false | false | false | false | false | false | false | false |
50 | bbh__boolean_expressions_15 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not not ( True and False ) is
A: | 0.36 | 0.482418 | multiple choice logprobs | puzzle | 0.118375 | 0.188661 | -0.397457 | -0.197455 | 0.935774 | 0.35291 | Safe | ['None'] | true | false | false | false | true | false | false | false |
51 | bbh__boolean_expressions_151 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True or True and False or False is
A: | 0.54 | 0.500908 | multiple choice logprobs | puzzle | -0.01777 | -0.153906 | -0.475417 | 0.084231 | 0.355728 | -0.021222 | Safe | ['None'] | false | false | false | false | false | false | false | false |
52 | bbh__boolean_expressions_153 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( True and not True ) is
A: | 0.76 | 0.429235 | multiple choice logprobs | puzzle | 0.326987 | 0.203658 | -0.688318 | -0.198192 | -1.384438 | 1.584916 | Safe | ['None'] | true | true | false | false | false | false | false | false |
53 | bbh__boolean_expressions_154 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and not True or not True is
A: | 0.64 | 0.482418 | multiple choice logprobs | puzzle | 0.046788 | 0.003496 | -0.389322 | -0.132871 | -1.452822 | 0.639206 | Safe | ['None'] | true | false | false | false | true | false | false | false |
54 | bbh__boolean_expressions_155 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( False or not not not False ) is
A: | 0.51 | 0.502418 | multiple choice logprobs | puzzle | -0.152524 | 0.0677 | -0.172263 | -0.226003 | -0.2981 | -0.715486 | Safe | ['None'] | true | false | false | false | true | false | false | false |
55 | bbh__boolean_expressions_156 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not False ) or True and False is
A: | 0.84 | 0.368453 | multiple choice logprobs | puzzle | 0.346518 | 0.5946 | -0.304104 | -0.18635 | -1.951731 | 1.13424 | Safe | ['None'] | true | true | false | false | true | true | false | false |
56 | bbh__boolean_expressions_157 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not not True ) or not False is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.357888 | 0.668961 | -0.181708 | -0.225005 | -2.357864 | 1.660179 | Safe | ['None'] | true | true | false | true | true | true | false | false |
57 | bbh__boolean_expressions_158 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or not ( ( True ) ) is
A: | 0.9 | 0.301511 | multiple choice logprobs | puzzle | 0.392327 | 0.708372 | -0.289038 | -0.278391 | -2.310293 | 1.46883 | Safe | ['None'] | true | true | false | true | true | true | false | false |
58 | bbh__boolean_expressions_159 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( False ) and False or not False is
A: | 0.37 | 0.485237 | multiple choice logprobs | puzzle | 0.590024 | 0.542307 | -0.593222 | -0.339579 | 0.006665 | 2.806533 | Safe | ['None'] | true | true | false | false | true | true | false | false |
59 | bbh__boolean_expressions_16 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not False and not not not False is
A: | 0.61 | 0.490207 | multiple choice logprobs | puzzle | 0.309757 | 0.151036 | -0.42161 | -0.254025 | -0.766198 | 1.171433 | Safe | ['None'] | true | false | false | false | true | false | false | false |
60 | bbh__boolean_expressions_160 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and True or ( True ) is
A: | 0.86 | 0.348735 | multiple choice logprobs | puzzle | 0.497485 | 0.744166 | -0.515036 | -0.058977 | -1.534424 | 2.067176 | Safe | ['None'] | false | true | false | false | false | false | false | false |
61 | bbh__boolean_expressions_161 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or not not ( not False ) is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.363992 | 0.678058 | -0.065019 | -0.188563 | -2.41367 | 1.761104 | Safe | ['None'] | true | true | false | true | true | true | false | true |
62 | bbh__boolean_expressions_163 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not True and True and not True is
A: | 0.82 | 0.386123 | multiple choice logprobs | puzzle | 0.134729 | 0.082077 | -0.196341 | -0.256632 | -2.361743 | 0.790152 | Safe | ['None'] | true | true | true | false | true | true | false | false |
63 | bbh__boolean_expressions_164 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or not ( not False ) is
A: | 0.86 | 0.348735 | multiple choice logprobs | puzzle | 0.46069 | 0.701493 | -0.371365 | 0.098044 | -1.740672 | 1.691883 | Safe | ['None'] | false | true | false | false | false | true | false | false |
64 | bbh__boolean_expressions_165 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not ( True ) or not True is
A: | 0.67 | 0.472582 | multiple choice logprobs | puzzle | 0.394277 | 0.498638 | -0.36018 | 0.02349 | -1.134979 | 1.48122 | Safe | ['None'] | false | false | false | false | false | false | false | false |
65 | bbh__boolean_expressions_167 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or False or not True or True is
A: | 0.87 | 0.337998 | multiple choice logprobs | puzzle | 0.498138 | 0.734977 | -0.215885 | -0.161084 | -1.622422 | 2.381102 | Safe | ['None'] | true | true | false | false | true | true | false | false |
66 | bbh__boolean_expressions_168 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True or True and False and False is
A: | 0.69 | 0.464823 | multiple choice logprobs | puzzle | 0.079932 | -0.045029 | -0.175906 | 0.153862 | -2.368735 | 0.648262 | Safe | ['None'] | false | true | false | false | false | true | false | false |
67 | bbh__boolean_expressions_169 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not not not not not True is
A: | 0.45 | 0.5 | multiple choice logprobs | puzzle | -0.172418 | -0.288672 | -0.383678 | 0.107524 | -0.67768 | -0.271539 | Safe | ['None'] | false | false | false | false | false | false | false | false |
68 | bbh__boolean_expressions_170 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True and ( False ) and False is
A: | 0.93 | 0.256432 | multiple choice logprobs | puzzle | 0.178167 | 0.195294 | -0.446703 | 0.127651 | -2.237552 | 1.545892 | Safe | ['None'] | false | true | false | false | false | true | false | false |
69 | bbh__boolean_expressions_172 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or False and not True and False is
A: | 0.38 | 0.487832 | multiple choice logprobs | puzzle | 0.391542 | 0.365419 | -0.337839 | -0.062281 | -0.133068 | 1.214546 | Safe | ['None'] | true | false | false | false | false | true | false | false |
70 | bbh__boolean_expressions_173 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( False or False or True ) is
A: | 0.71 | 0.456048 | multiple choice logprobs | puzzle | 0.129658 | 0.030531 | -0.199642 | -0.292647 | -1.998019 | 0.675311 | Safe | ['None'] | true | true | false | false | true | false | false | false |
71 | bbh__boolean_expressions_174 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or True or True and False is
A: | 0.82 | 0.386123 | multiple choice logprobs | puzzle | 0.496053 | 0.689099 | 0.009871 | -0.009023 | -1.683865 | 1.816133 | Safe | ['None'] | false | true | false | false | false | true | false | false |
72 | bbh__boolean_expressions_175 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and False or False or False is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.194652 | 0.129458 | 0.072836 | -0.096939 | -2.091664 | 1.078739 | Safe | ['None'] | true | true | false | false | false | true | false | false |
73 | bbh__boolean_expressions_177 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and not not False and not False is
A: | 0.48 | 0.502117 | multiple choice logprobs | puzzle | 0.023873 | -0.153079 | -0.122452 | -0.443503 | -0.455937 | 0.126251 | Safe | ['None'] | true | false | true | false | true | false | false | false |
74 | bbh__boolean_expressions_178 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( not not False ) and True is
A: | 0.4 | 0.492366 | multiple choice logprobs | puzzle | 0.077165 | 0.131855 | 0.25034 | 0.186757 | 0.072163 | 0.323178 | Safe | ['None'] | false | false | false | false | false | false | false | false |
75 | bbh__boolean_expressions_179 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( not False ) and not False is
A: | 0.32 | 0.468826 | multiple choice logprobs | puzzle | -0.267378 | -0.428706 | -0.142248 | 0.174007 | -1.644217 | -0.711089 | Safe | ['None'] | false | false | false | false | false | false | false | false |
76 | bbh__boolean_expressions_18 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and False and False or not False is
A: | 0.38 | 0.487832 | multiple choice logprobs | puzzle | 0.452499 | 0.421982 | -0.205642 | -0.351698 | -0.001265 | 1.511485 | Safe | ['None'] | true | true | false | false | true | true | false | false |
77 | bbh__boolean_expressions_180 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or True and not False or True is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.511902 | 0.732471 | -0.186233 | -0.200057 | -1.66515 | 2.072459 | Safe | ['None'] | true | true | false | false | true | true | false | false |
78 | bbh__boolean_expressions_181 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not not not True and True ) is
A: | 0.43 | 0.49757 | multiple choice logprobs | puzzle | -0.063279 | -0.237381 | -0.850514 | -0.345577 | -0.115359 | 0.017974 | Safe | ['None'] | true | false | false | false | false | false | false | false |
79 | bbh__boolean_expressions_182 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and not ( True ) or True is
A: | 0.56 | 0.498888 | multiple choice logprobs | puzzle | 0.500685 | 0.51379 | -0.155565 | -0.228086 | -0.858334 | 1.347488 | Safe | ['None'] | true | true | false | false | true | false | false | false |
80 | bbh__boolean_expressions_183 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not True and False or True ) is
A: | 0.47 | 0.501614 | multiple choice logprobs | puzzle | 0.337792 | 0.362728 | -0.276842 | -0.323891 | -0.128471 | 0.751918 | Safe | ['None'] | true | false | false | false | true | false | false | false |
81 | bbh__boolean_expressions_184 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( not not True ) or False is
A: | 0.23 | 0.422953 | multiple choice logprobs | puzzle | -0.28163 | -0.500046 | -0.336505 | 0.144823 | -1.911441 | -0.900683 | Safe | ['None'] | false | false | false | false | false | false | false | false |
82 | bbh__boolean_expressions_185 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not False ) or ( False ) is
A: | 0.75 | 0.435194 | multiple choice logprobs | puzzle | 0.523265 | 0.667343 | -0.257776 | -0.371873 | -1.327721 | 2.06143 | Safe | ['None'] | true | true | false | false | true | false | false | false |
83 | bbh__boolean_expressions_186 | bbh | General Reasoning | boolean_expressions | null | null | Q: not not not False and True and False is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.207393 | 0.136044 | -0.469707 | -0.308607 | -1.774822 | 1.124529 | Safe | ['None'] | true | true | false | false | true | false | false | false |
84 | bbh__boolean_expressions_187 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or not True or not not True is
A: | 0.9 | 0.301511 | multiple choice logprobs | puzzle | 0.424428 | 0.690891 | -0.33289 | -0.10832 | -1.897514 | 2.152735 | Safe | ['None'] | true | true | false | true | false | true | false | false |
85 | bbh__boolean_expressions_188 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False or not not False and False is
A: | 0.7 | 0.460566 | multiple choice logprobs | puzzle | 0.35653 | 0.471008 | -0.244146 | -0.066876 | -1.522987 | 0.940276 | Safe | ['None'] | true | false | false | false | false | false | false | false |
86 | bbh__boolean_expressions_189 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and ( False or False ) is
A: | 0.71 | 0.456048 | multiple choice logprobs | puzzle | 0.210964 | 0.108031 | -0.32883 | 0.012651 | -1.463837 | 1.062045 | Safe | ['None'] | false | false | false | false | false | false | false | false |
87 | bbh__boolean_expressions_19 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( False and not False ) is
A: | 0.77 | 0.422953 | multiple choice logprobs | puzzle | 0.023872 | 0.003057 | -0.367009 | 0.043095 | -2.732754 | 0.661875 | Safe | ['None'] | false | true | false | true | false | true | false | false |
88 | bbh__boolean_expressions_190 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and True or ( not False ) is
A: | 0.83 | 0.377525 | multiple choice logprobs | puzzle | 0.498657 | 0.676222 | -0.307899 | -0.202934 | -1.585945 | 2.009871 | Safe | ['None'] | true | true | false | false | true | true | false | false |
89 | bbh__boolean_expressions_192 | bbh | General Reasoning | boolean_expressions | null | null | Q: not ( ( False and True ) ) is
A: | 0.61 | 0.490207 | multiple choice logprobs | puzzle | 0.538316 | 0.628539 | -0.331468 | -0.641025 | -0.577352 | 1.932564 | Safe | ['None'] | true | true | true | false | true | true | true | false |
90 | bbh__boolean_expressions_193 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or ( not False ) and False is
A: | 0.74 | 0.440844 | multiple choice logprobs | puzzle | 0.099676 | 0.003896 | -0.186848 | -0.098915 | -2.343053 | 0.423546 | Safe | ['None'] | false | true | false | false | true | true | false | false |
91 | bbh__boolean_expressions_194 | bbh | General Reasoning | boolean_expressions | null | null | Q: False and not False or False and True is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.056219 | 0.015735 | -0.809011 | -0.132656 | -2.684553 | 0.684717 | Safe | ['None'] | true | true | false | false | false | true | false | false |
92 | bbh__boolean_expressions_195 | bbh | General Reasoning | boolean_expressions | null | null | Q: not False and not not True and True is
A: | 0.79 | 0.40936 | multiple choice logprobs | puzzle | 0.601425 | 0.726756 | -0.232802 | -0.316844 | -1.235408 | 2.448822 | Safe | ['None'] | true | true | false | false | true | false | false | false |
93 | bbh__boolean_expressions_196 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and True or False and not True is
A: | 0.77 | 0.422953 | multiple choice logprobs | puzzle | 0.42366 | 0.545493 | -0.477188 | 0.268265 | -1.363643 | 1.255463 | Safe | ['None'] | false | false | false | false | false | false | false | false |
94 | bbh__boolean_expressions_197 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True or False and True or False is
A: | 0.51 | 0.502418 | multiple choice logprobs | puzzle | -0.086654 | -0.206902 | -0.245698 | -0.09746 | -0.57099 | -0.038368 | Safe | ['None'] | true | false | false | false | false | false | false | false |
95 | bbh__boolean_expressions_198 | bbh | General Reasoning | boolean_expressions | null | null | Q: True or False or not True and True is
A: | 0.81 | 0.394277 | multiple choice logprobs | puzzle | 0.467237 | 0.676255 | -0.11891 | -0.057398 | -1.264163 | 2.02073 | Safe | ['None'] | true | true | false | false | false | false | false | false |
96 | bbh__boolean_expressions_2 | bbh | General Reasoning | boolean_expressions | null | null | Q: not True or False or ( False ) is
A: | 0.65 | 0.479372 | multiple choice logprobs | puzzle | 0.066763 | -0.033211 | -0.341194 | 0.066267 | -1.832556 | 0.322365 | Safe | ['None'] | false | false | false | false | false | false | false | false |
97 | bbh__boolean_expressions_20 | bbh | General Reasoning | boolean_expressions | null | null | Q: True and False or ( not True ) is
A: | 0.85 | 0.35887 | multiple choice logprobs | puzzle | 0.228252 | 0.145872 | -0.485465 | -0.111305 | -1.978151 | 1.541967 | Safe | ['None'] | true | true | false | false | false | true | false | false |
98 | bbh__boolean_expressions_200 | bbh | General Reasoning | boolean_expressions | null | null | Q: False or False or True and not False is
A: | 0.79 | 0.40936 | multiple choice logprobs | puzzle | 0.570044 | 0.701006 | -0.155819 | -0.378842 | -1.444464 | 2.382177 | Safe | ['None'] | true | true | true | false | true | false | false | false |
99 | bbh__boolean_expressions_201 | bbh | General Reasoning | boolean_expressions | null | null | Q: ( not ( True or False ) ) is
A: | 0.92 | 0.27266 | multiple choice logprobs | puzzle | 0.192235 | 0.177747 | -0.77516 | 0.14877 | -2.153973 | 1.582729 | Safe | ['None'] | false | true | false | false | false | true | false | false |
Subsets and Splits
No community queries yet
The top public SQL queries from the community will appear here once available.