Question
Salmons Stores operates a national chain of women's apparel stores. Five thousand copies of an expensive four-color sales catalog have been printed, and each catalog
Salmons Stores operates a national chain of women's apparel stores. Five thousand copies of an expensive four-color sales catalog have been printed, and each catalog includes a coupon that provides a $50 discount on purchases of $200 or more. Salmons would like to send the catalogs only to customers who have the highest probability of using the coupon. For each of 1,000 Salmons customers, three variables were tracked from an earlier promotional campaign: last year's total spending at Salmons (Spending), whether they have a Salmons store credit card (Card), and whether they used the promotional coupon they were sent (Coupon). Apply logistic regression to classify observations as a promotion-responder or not by using Spending and Card as input variables and Coupon as the target (or response) variable.
a. Evaluate candidate logistic regression models based on their predictive performance on the validation set. Recommend a final model and express the model as a mathematical equation relating the target variable to the input variables. b. For the model selected in part (a), provide and interpret the lift measure on the top 10% of the test set observations most likely to use the promotional coupon. c. What is the area under the ROC curve on the test set? To achieve a sensitivity of at least 0.80, how much Class 0 error rate must be tolerated?
Customer | Spending | Card | Coupon | Partition |
1 | 2291 | 1 | 0 | t |
5 | 2528 | 1 | 0 | t |
8 | 7076 | 0 | 0 | t |
15 | 6737 | 0 | 0 | t |
18 | 3470 | 1 | 0 | t |
20 | 6404 | 0 | 1 | t |
21 | 2229 | 0 | 0 | t |
22 | 2933 | 0 | 0 | t |
23 | 2118 | 0 | 0 | t |
25 | 4998 | 0 | 1 | t |
26 | 1394 | 0 | 0 | t |
28 | 2059 | 0 | 1 | t |
29 | 1677 | 0 | 0 | t |
32 | 2933 | 1 | 0 | t |
33 | 5365 | 1 | 1 | t |
35 | 6179 | 0 | 0 | t |
37 | 1058 | 1 | 0 | t |
45 | 3566 | 0 | 0 | t |
47 | 1554 | 1 | 0 | t |
48 | 4631 | 0 | 0 | t |
49 | 4345 | 1 | 1 | t |
54 | 3386 | 1 | 1 | t |
56 | 2050 | 1 | 1 | t |
57 | 2323 | 1 | 1 | t |
59 | 3345 | 0 | 1 | t |
60 | 3318 | 1 | 1 | t |
61 | 4721 | 0 | 1 | t |
62 | 1662 | 0 | 1 | t |
65 | 2313 | 0 | 1 | t |
66 | 6851 | 0 | 0 | t |
68 | 3470 | 1 | 1 | t |
73 | 1878 | 1 | 0 | t |
81 | 5501 | 1 | 1 | t |
82 | 5991 | 1 | 1 | t |
83 | 2372 | 1 | 0 | t |
84 | 3995 | 1 | 0 | t |
88 | 2429 | 1 | 0 | t |
91 | 1130 | 1 | 0 | t |
92 | 1911 | 1 | 1 | t |
95 | 1403 | 1 | 0 | t |
97 | 2421 | 1 | 0 | t |
98 | 6073 | 0 | 0 | t |
108 | 4971 | 0 | 0 | t |
109 | 2252 | 1 | 0 | t |
110 | 1979 | 1 | 0 | t |
112 | 1786 | 1 | 0 | t |
113 | 5438 | 1 | 1 | t |
114 | 1834 | 0 | 0 | t |
115 | 2000 | 1 | 0 | t |
118 | 2864 | 1 | 0 | t |
119 | 2246 | 1 | 0 | t |
120 | 8312 | 0 | 1 | t |
122 | 1015 | 0 | 0 | t |
123 | 2180 | 0 | 0 | t |
128 | 3352 | 1 | 0 | t |
129 | 1409 | 1 | 0 | t |
132 | 4397 | 0 | 0 | t |
133 | 4494 | 1 | 0 | t |
134 | 3720 | 0 | 0 | t |
136 | 17675 | 0 | 1 | t |
141 | 2277 | 0 | 0 | t |
142 | 1340 | 0 | 0 | t |
143 | 3004 | 0 | 0 | t |
146 | 2634 | 1 | 0 | t |
148 | 7761 | 1 | 1 | t |
150 | 5172 | 1 | 1 | t |
153 | 2609 | 0 | 0 | t |
156 | 2318 | 1 | 0 | t |
157 | 3195 | 0 | 0 | t |
159 | 1982 | 0 | 0 | t |
161 | 1799 | 0 | 0 | t |
164 | 1773 | 1 | 0 | t |
167 | 1761 | 0 | 0 | t |
169 | 1981 | 0 | 0 | t |
174 | 2662 | 0 | 0 | t |
179 | 8256 | 0 | 1 | t |
181 | 4320 | 0 | 0 | t |
182 | 7156 | 0 | 0 | t |
187 | 4875 | 1 | 1 | t |
188 | 2021 | 1 | 0 | t |
189 | 1694 | 0 | 0 | t |
190 | 1708 | 0 | 0 | t |
192 | 3558 | 1 | 0 | t |
193 | 1315 | 0 | 0 | t |
196 | 1889 | 1 | 0 | t |
200 | 3385 | 0 | 0 | t |
201 | 2194 | 0 | 0 | t |
202 | 5139 | 1 | 0 | t |
205 | 3468 | 1 | 0 | t |
209 | 2288 | 0 | 0 | t |
210 | 4001 | 0 | 0 | t |
211 | 2911 | 0 | 0 | t |
212 | 1736 | 0 | 0 | t |
215 | 1712 | 0 | 0 | t |
217 | 1846 | 0 | 0 | t |
219 | 1811 | 0 | 0 | t |
220 | 4815 | 0 | 0 | t |
230 | 1179 | 0 | 0 | t |
232 | 2761 | 0 | 0 | t |
234 | 2752 | 0 | 0 | t |
239 | 3352 | 1 | 0 | t |
241 | 3439 | 1 | 0 | t |
244 | 3134 | 0 | 0 | t |
246 | 3075 | 1 | 0 | t |
249 | 2893 | 1 | 0 | t |
250 | 2344 | 1 | 0 | t |
254 | 1340 | 0 | 0 | t |
256 | 1991 | 1 | 0 | t |
261 | 3670 | 0 | 0 | t |
262 | 3415 | 1 | 0 | t |
263 | 12151 | 1 | 1 | t |
266 | 4895 | 1 | 0 | t |
267 | 2424 | 0 | 0 | t |
269 | 1894 | 1 | 0 | t |
270 | 1774 | 1 | 0 | t |
272 | 2270 | 0 | 0 | t |
274 | 4959 | 0 | 0 | t |
277 | 3201 | 1 | 0 | t |
278 | 4846 | 1 | 0 | t |
280 | 2411 | 1 | 0 | t |
282 | 3212 | 1 | 0 | t |
287 | 2978 | 1 | 0 | t |
289 | 1427 | 1 | 0 | t |
292 | 2940 | 0 | 0 | t |
297 | 2876 | 1 | 0 | t |
298 | 3909 | 0 | 0 | t |
300 | 3178 | 1 | 0 | t |
302 | 1846 | 0 | 0 | t |
303 | 3502 | 0 | 0 | t |
308 | 2357 | 0 | 0 | t |
311 | 3200 | 1 | 0 | t |
315 | 2657 | 0 | 0 | t |
316 | 4777 | 0 | 0 | t |
317 | 1879 | 1 | 0 | t |
320 | 1211 | 1 | 0 | t |
321 | 1263 | 1 | 0 | t |
322 | 1676 | 1 | 0 | t |
323 | 1482 | 1 | 0 | t |
325 | 3485 | 1 | 0 | t |
327 | 4848 | 0 | 0 | t |
329 | 1351 | 0 | 0 | t |
332 | 2846 | 1 | 0 | t |
334 | 1908 | 0 | 0 | t |
336 | 2764 | 0 | 0 | t |
340 | 5091 | 0 | 0 | t |
343 | 1865 | 1 | 0 | t |
346 | 1013 | 1 | 0 | t |
348 | 2853 | 0 | 0 | t |
355 | 5538 | 0 | 0 | t |
356 | 3850 | 1 | 0 | t |
357 | 2328 | 1 | 0 | t |
363 | 1751 | 0 | 0 | t |
366 | 1013 | 0 | 0 | t |
371 | 10311 | 1 | 1 | t |
372 | 3012 | 0 | 0 | t |
373 | 2300 | 1 | 0 | t |
375 | 2825 | 0 | 0 | t |
376 | 5497 | 0 | 0 | t |
377 | 1118 | 0 | 0 | t |
380 | 2662 | 1 | 0 | t |
381 | 4037 | 1 | 0 | t |
384 | 1576 | 1 | 0 | t |
386 | 4700 | 0 | 0 | t |
387 | 2175 | 1 | 0 | t |
390 | 3894 | 1 | 0 | t |
393 | 2140 | 1 | 0 | t |
396 | 2747 | 0 | 0 | t |
397 | 2936 | 1 | 0 | t |
398 | 3854 | 0 | 0 | t |
399 | 2717 | 0 | 0 | t |
400 | 1387 | 1 | 0 | t |
402 | 3118 | 0 | 0 | t |
404 | 4626 | 0 | 0 | t |
408 | 3415 | 0 | 0 | t |
412 | 3390 | 0 | 0 | t |
413 | 7787 | 0 | 1 | t |
415 | 4130 | 1 | 0 | t |
416 | 3850 | 0 | 0 | t |
418 | 2996 | 0 | 0 | t |
420 | 3546 | 0 | 0 | t |
427 | 1247 | 0 | 0 | t |
429 | 5274 | 0 | 0 | t |
431 | 4854 | 1 | 0 | t |
432 | 2962 | 1 | 0 | t |
433 | 2013 | 0 | 0 | t |
434 | 5437 | 1 | 1 | t |
436 | 3180 | 0 | 0 | t |
444 | 1687 | 1 | 0 | t |
446 | 1784 | 1 | 0 | t |
448 | 3748 | 0 | 0 | t |
449 | 3028 | 1 | 0 | t |
452 | 4585 | 0 | 0 | t |
453 | 2761 | 0 | 0 | t |
454 | 2081 | 0 | 0 | t |
455 | 4394 | 0 | 0 | t |
464 | 5269 | 1 | 1 | t |
465 | 8475 | 1 | 1 | t |
466 | 3491 | 0 | 0 | t |
474 | 3079 | 0 | 0 | t |
475 | 1745 | 1 | 0 | t |
477 | 2060 | 0 | 0 | t |
478 | 4938 | 0 | 0 | t |
479 | 2847 | 0 | 0 | t |
481 | 1338 | 1 | 0 | t |
482 | 1907 | 0 | 0 | t |
485 | 3376 | 0 | 0 | t |
488 | 2306 | 0 | 0 | t |
491 | 1835 | 0 | 0 | t |
494 | 1523 | 1 | 0 | t |
495 | 3350 | 0 | 0 | t |
496 | 6260 | 1 | 1 | t |
498 | 994 | 0 | 0 | t |
501 | 1893 | 1 | 0 | t |
503 | 3865 | 0 | 0 | t |
504 | 2781 | 1 | 0 | t |
510 | 2867 | 1 | 0 | t |
511 | 7262 | 1 | 1 | t |
518 | 1874 | 1 | 0 | t |
519 | 2261 | 0 | 0 | t |
520 | 2291 | 1 | 0 | t |
522 | 1725 | 1 | 0 | t |
524 | 1983 | 1 | 0 | t |
525 | 2264 | 0 | 0 | t |
527 | 6614 | 1 | 1 | t |
531 | 4879 | 1 | 0 | t |
534 | 6443 | 1 | 1 | t |
535 | 3419 | 1 | 1 | t |
537 | 2282 | 1 | 0 | t |
538 | 2735 | 1 | 0 | t |
546 | 1306 | 0 | 0 | t |
547 | 6762 | 0 | 0 | t |
549 | 4099 | 1 | 0 | t |
552 | 5520 | 1 | 0 | t |
553 | 1615 | 1 | 0 | t |
555 | 1640 | 1 | 0 | t |
556 | 3359 | 1 | 0 | t |
559 | 5031 | 0 | 0 | t |
561 | 3619 | 0 | 0 | t |
563 | 3477 | 1 | 0 | t |
564 | 2430 | 0 | 0 | t |
572 | 1653 | 0 | 0 | t |
577 | 1954 | 0 | 0 | t |
578 | 4032 | 0 | 0 | t |
583 | 2983 | 1 | 0 | t |
584 | 2098 | 1 | 0 | t |
585 | 1360 | 0 | 0 | t |
586 | 4895 | 1 | 1 | t |
588 | 1860 | 0 | 0 | t |
591 | 1359 | 0 | 0 | t |
593 | 2194 | 1 | 0 | t |
595 | 5309 | 0 | 0 | t |
604 | 2624 | 1 | 0 | t |
607 | 4059 | 1 | 1 | t |
618 | 3860 | 1 | 0 | t |
621 | 1478 | 0 | 0 | t |
622 | 3969 | 0 | 0 | t |
624 | 1540 | 1 | 0 | t |
626 | 2054 | 0 | 0 | t |
629 | 6101 | 1 | 1 | t |
633 | 2125 | 0 | 0 | t |
636 | 1708 | 0 | 0 | t |
640 | 1677 | 0 | 0 | t |
641 | 3846 | 0 | 0 | t |
642 | 2045 | 0 | 0 | t |
643 | 3896 | 1 | 1 | t |
644 | 872 | 0 | 0 | t |
645 | 8750 | 1 | 1 | t |
646 | 5464 | 1 | 1 | t |
647 | 1615 | 0 | 0 | t |
649 | 2485 | 0 | 0 | t |
652 | 3898 | 1 | 1 | t |
656 | 2948 | 0 | 0 | t |
659 | 4010 | 0 | 0 | t |
663 | 4539 | 1 | 0 | t |
669 | 1181 | 0 | 0 | t |
672 | 3854 | 0 | 0 | t |
675 | 3651 | 0 | 0 | t |
676 | 2982 | 1 | 0 | t |
677 | 2753 | 1 | 0 | t |
678 | 1633 | 0 | 0 | t |
679 | 1168 | 1 | 0 | t |
681 | 1148 | 1 | 0 | t |
686 | 1744 | 0 | 0 | t |
688 | 3145 | 0 | 0 | t |
692 | 2901 | 0 | 0 | t |
705 | 6489 | 0 | 0 | t |
712 | 2162 | 0 | 0 | t |
715 | 3319 | 1 | 0 | t |
719 | 2994 | 1 | 0 | t |
720 | 1899 | 1 | 0 | t |
723 | 2438 | 1 | 0 | t |
728 | 955 | 0 | 0 | t |
732 | 5593 | 1 | 1 | t |
737 | 2941 | 0 | 0 | t |
739 | 5707 | 0 | 0 | t |
743 | 2198 | 0 | 0 | t |
744 | 2348 | 1 | 0 | t |
745 | 4412 | 0 | 0 | t |
749 | 3777 | 1 | 0 | t |
753 | 1891 | 0 | 0 | t |
755 | 1262 | 0 | 0 | t |
766 | 4517 | 0 | 0 | t |
767 | 2746 | 1 | 0 | t |
770 | 5002 | 0 | 0 | t |
771 | 2391 | 1 | 0 | t |
775 | 4680 | 1 | 1 | t |
777 | 2097 | 0 | 0 | t |
778 | 2032 | 0 | 0 | t |
780 | 2103 | 0 | 0 | t |
782 | 4301 | 1 | 1 | t |
787 | 2035 | 1 | 0 | t |
790 | 6207 | 0 | 0 | t |
793 | 1466 | 0 | 0 | t |
794 | 3058 | 1 | 0 | t |
797 | 3684 | 0 | 0 | t |
813 | 6529 | 1 | 1 | t |
814 | 5091 | 1 | 1 | t |
816 | 1314 | 0 | 0 | t |
817 | 2621 | 0 | 0 | t |
818 | 3001 | 1 | 0 | t |
819 | 3558 | 1 | 0 | t |
820 | 3671 | 1 | 0 | t |
822 | 3024 | 0 | 0 | t |
827 | 8120 | 1 | 1 | t |
829 | 4919 | 0 | 0 | t |
831 | 2484 | 1 | 0 | t |
835 | 3292 | 0 | 0 | t |
838 | 4199 | 1 | 0 | t |
839 | 6287 | 0 | 0 | t |
842 | 1266 | 0 | 0 | t |
843 | 6653 | 1 | 1 | t |
844 | 1396 | 0 | 0 | t |
846 | 2712 | 1 | 0 | t |
848 | 4360 | 0 | 0 | t |
849 | 1681 | 0 | 0 | t |
850 | 3163 | 1 | 0 | t |
854 | 2949 | 1 | 0 | t |
856 | 5107 | 0 | 0 | t |
857 | 2490 | 1 | 0 | t |
859 | 1176 | 1 | 0 | t |
861 | 3576 | 1 | 0 | t |
864 | 1746 | 0 | 0 | t |
865 | 1282 | 1 | 0 | t |
866 | 2183 | 1 | 0 | t |
867 | 2995 | 1 | 0 | t |
868 | 3140 | 1 | 0 | t |
871 | 4265 | 1 | 1 | t |
872 | 5788 | 1 | 1 | t |
874 | 4310 | 0 | 0 | t |
876 | 2325 | 0 | 0 | t |
880 | 3628 | 0 | 0 | t |
883 | 4953 | 0 | 0 | t |
889 | 2403 | 1 | 0 | t |
891 | 2955 | 0 | 0 | t |
893 | 3488 | 1 | 0 | t |
894 | 1367 | 0 | 0 | t |
895 | 1311 | 1 | 0 | t |
897 | 2407 | 1 | 0 | t |
901 | 2503 | 0 | 0 | t |
902 | 3225 | 0 | 0 | t |
906 | 3958 | 1 | 1 | t |
908 | 4067 | 1 | 0 | t |
911 | 2906 | 0 | 0 | t |
916 | 2597 | 0 | 0 | t |
917 | 2114 | 0 | 0 | t |
918 | 1133 | 1 | 0 | t |
919 | 5281 | 1 | 1 | t |
920 | 2206 | 0 | 0 | t |
921 | 3626 | 0 | 0 | t |
923 | 2192 | 0 | 0 | t |
926 | 1603 | 1 | 0 | t |
929 | 1833 | 1 | 0 | t |
931 | 2298 | 1 | 0 | t |
934 | 1512 | 1 | 0 | t |
935 | 992 | 0 | 0 | t |
936 | 2273 | 1 | 0 | t |
937 | 3755 | 0 | 0 | t |
941 | 7521 | 0 | 1 | t |
945 | 2254 | 1 | 0 | t |
947 | 4336 | 0 | 0 | t |
950 | 5791 | 1 | 1 | t |
951 | 3072 | 0 | 0 | t |
952 | 4358 | 1 | 1 | t |
953 | 5148 | 1 | 1 | t |
957 | 6225 | 1 | 1 | t |
958 | 6146 | 0 | 0 | t |
959 | 2474 | 1 | 0 | t |
961 | 6993 | 1 | 1 | t |
968 | 5900 | 1 | 1 | t |
969 | 7534 | 0 | 0 | t |
970 | 5041 | 1 | 1 | t |
972 | 3867 | 0 | 0 | t |
973 | 1387 | 1 | 0 | t |
975 | 5419 | 0 | 0 | t |
978 | 3006 | 0 | 0 | t |
980 | 6512 | 1 | 1 | t |
984 | 5498 | 1 | 1 | t |
985 | 2277 | 1 | 0 | t |
986 | 3700 | 1 | 0 | t |
987 | 2483 | 0 | 0 | t |
988 | 3420 | 0 | 0 | t |
990 | 1655 | 1 | 0 | t |
991 | 1978 | 1 | 0 | t |
992 | 3214 | 1 | 0 | t |
994 | 5708 | 0 | 0 | t |
995 | 1874 | 0 | 0 | t |
998 | 3154 | 0 | 0 | t |
171 | 2489 | 1 | 0 | t |
338 | 6483 | 0 | 0 | t |
443 | 3178 | 0 | 0 | t |
870 | 7202 | 1 | 1 | t |
661 | 5694 | 1 | 1 | t |
741 | 3532 | 1 | 1 | t |
166 | 1265 | 0 | 0 | t |
462 | 6359 | 1 | 1 | t |
106 | 4173 | 1 | 1 | t |
590 | 3032 | 0 | 0 | t |
445 | 2497 | 1 | 0 | t |
514 | 1390 | 1 | 0 | t |
409 | 5589 | 1 | 1 | t |
240 | 3412 | 1 | 0 | t |
451 | 1139 | 0 | 0 | t |
764 | 3753 | 0 | 0 | t |
351 | 4164 | 1 | 0 | t |
185 | 2363 | 0 | 0 | t |
324 | 3708 | 0 | 0 | t |
693 | 801 | 0 | 0 | t |
628 | 2730 | 0 | 0 | t |
414 | 1502 | 0 | 0 | t |
42 | 1839 | 0 | 0 | t |
242 | 2425 | 0 | 0 | t |
441 | 2814 | 1 | 0 | t |
294 | 1655 | 1 | 0 | t |
89 | 4701 | 1 | 1 | t |
580 | 1200 | 1 | 0 | t |
16 | 6486 | 0 | 0 | t |
100 | 3411 | 0 | 1 | t |
896 | 1090 | 0 | 0 | t |
983 | 2725 | 1 | 0 | t |
742 | 1879 | 1 | 0 | t |
80 | 2148 | 1 | 0 | t |
437 | 2528 | 0 | 0 | t |
349 | 6744 | 0 | 0 | t |
78 | 7076 | 1 | 1 | t |
342 | 3897 | 1 | 1 | t |
570 | 1654 | 0 | 0 | t |
662 | 3681 | 0 | 0 | t |
264 | 4909 | 0 | 0 | t |
76 | 3411 | 1 | 1 | t |
915 | 6244 | 1 | 1 | t |
841 | 2636 | 0 | 0 | t |
726 | 1910 | 0 | 0 | t |
186 | 1685 | 0 | 0 | t |
938 | 4517 | 0 | 0 | t |
12 | 3255 | 0 | 1 | t |
369 | 5653 | 1 | 1 | t |
704 | 3380 | 0 | 0 | t |
651 | 3599 | 0 | 0 | t |
11 | 2140 | 1 | 0 | t |
760 | 3682 | 1 | 1 | t |
41 | 3253 | 0 | 0 | t |
71 | 2678 | 1 | 1 | t |
772 | 3002 | 1 | 0 | t |
695 | 1263 | 1 | 0 | t |
993 | 3121 | 1 | 0 | t |
670 | 2289 | 1 | 0 | t |
24 | 2050 | 0 | 0 | t |
698 | 6995 | 1 | 1 | t |
605 | 2314 | 1 | 0 | t |
635 | 2060 | 1 | 0 | t |
637 | 2988 | 1 | 0 | t |
145 | 2815 | 1 | 0 | t |
530 | 2387 | 0 | 0 | t |
391 | 987 | 0 | 0 | t |
545 | 1507 | 1 | 0 | t |
751 | 1392 | 0 | 0 | t |
39 | 1124 | 0 | 0 | t |
614 | 2047 | 1 | 0 | t |
425 | 2016 | 0 | 0 | t |
965 | 2328 | 0 | 0 | t |
717 | 1405 | 1 | 0 | t |
304 | 2380 | 0 | 0 | t |
168 | 3173 | 0 | 0 | t |
221 | 1292 | 1 | 0 | t |
658 | 2912 | 0 | 0 | t |
949 | 1794 | 1 | 0 | t |
130 | 3333 | 1 | 1 | t |
245 | 3967 | 1 | 0 | t |
195 | 2076 | 1 | 0 | t |
810 | 3030 | 0 | 0 | t |
568 | 3447 | 1 | 0 | t |
752 | 2507 | 0 | 0 | t |
468 | 7718 | 1 | 1 | t |
107 | 1802 | 0 | 0 | t |
807 | 1616 | 1 | 0 | t |
435 | 1194 | 0 | 0 | t |
967 | 4096 | 1 | 1 | t |
506 | 3868 | 0 | 0 | t |
603 | 947 | 0 | 0 | t |
526 | 3159 | 1 | 0 | t |
939 | 2186 | 0 | 0 | v |
746 | 5969 | 1 | 1 | v |
214 | 3556 | 1 | 0 | v |
803 | 4838 | 1 | 1 | v |
551 | 2492 | 1 | 0 | v |
218 | 1488 | 0 | 0 | v |
579 | 4803 | 0 | 0 | v |
623 | 1754 | 0 | 0 | v |
888 | 3189 | 0 | 0 | v |
884 | 2381 | 0 | 0 | v |
158 | 7149 | 1 | 1 | v |
718 | 2603 | 1 | 0 | v |
789 | 3740 | 1 | 0 | v |
330 | 2918 | 0 | 0 | v |
370 | 4308 | 0 | 0 | v |
105 | 2402 | 1 | 0 | v |
834 | 2453 | 1 | 0 | v |
438 | 2257 | 0 | 0 | v |
707 | 2427 | 0 | 0 | v |
594 | 4129 | 0 | 0 | v |
909 | 1492 | 0 | 0 | v |
337 | 1349 | 0 | 0 | v |
664 | 2509 | 0 | 0 | v |
447 | 4842 | 1 | 1 | v |
360 | 4546 | 1 | 1 | v |
388 | 2717 | 0 | 0 | v |
769 | 2169 | 1 | 0 | v |
997 | 1936 | 0 | 0 | v |
912 | 3468 | 1 | 1 | v |
403 | 6087 | 1 | 1 | v |
70 | 2059 | 0 | 0 | v |
989 | 3854 | 0 | 0 | v |
882 | 2527 | 0 | 0 | v |
830 | 3675 | 1 | 0 | v |
499 | 2264 | 0 | 0 | v |
295 | 5027 | 1 | 1 | v |
933 | 2558 | 1 | 0 | v |
956 | 2862 | 0 | 0 | v |
922 | 5335 | 1 | 1 | v |
925 | 472 | 1 | 0 | v |
616 | 2049 | 0 | 0 | v |
798 | 3277 | 1 | 0 | v |
788 | 1358 | 1 | 0 | v |
796 | 5979 | 0 | 0 | v |
523 | 1391 | 0 | 0 | v |
631 | 1451 | 1 | 0 | v |
224 | 2265 | 0 | 0 | v |
666 | 1299 | 1 | 0 | v |
392 | 2090 | 1 | 0 | v |
50 | 4004 | 1 | 1 | v |
673 | 1742 | 0 | 0 | v |
252 | 3092 | 1 | 0 | v |
286 | 2166 | 0 | 0 | v |
117 | 968 | 1 | 0 | v |
611 | 2583 | 1 | 0 | v |
687 | 2033 | 0 | 0 | v |
55 | 1677 | 1 | 0 | v |
257 | 2655 | 1 | 0 | v |
735 | 4555 | 0 | 0 | v |
260 | 5774 | 0 | 0 | v |
536 | 944 | 1 | 0 | v |
713 | 1088 | 0 | 0 | v |
489 | 2737 | 0 | 0 | v |
699 | 2205 | 1 | 0 | v |
625 | 2669 | 1 | 0 | v |
576 | 2993 | 1 | 0 | v |
442 | 3275 | 0 | 0 | v |
702 | 2784 | 0 | 0 | v |
907 | 3730 | 1 | 0 | v |
421 | 4340 | 0 | 0 | v |
77 | 5991 | 0 | 1 | v |
53 | 4414 | 0 | 0 | v |
125 | 3276 | 1 | 0 | v |
587 | 1803 | 0 | 0 | v |
733 | 3017 | 1 | 0 | v |
761 | 1682 | 1 | 0 | v |
927 | 2231 | 1 | 0 | v |
748 | 2542 | 0 | 0 | v |
476 | 1007 | 1 | 0 | v |
208 | 1349 | 0 | 0 | v |
542 | 2125 | 0 | 0 | v |
154 | 5319 | 1 | 1 | v |
754 | 1700 | 1 | 0 | v |
222 | 2922 | 0 | 0 | v |
517 | 5398 | 0 | 0 | v |
924 | 2885 | 1 | 0 | v |
426 | 8007 | 1 | 1 | v |
472 | 3310 | 1 | 0 | v |
2 | 3215 | 1 | 0 | v |
548 | 2464 | 0 | 0 | v |
184 | 3471 | 0 | 0 | v |
236 | 2050 | 1 | 0 | v |
648 | 3043 | 0 | 0 | v |
515 | 3965 | 1 | 1 | v |
486 | 2839 | 1 | 0 | v |
630 | 3357 | 0 | 0 | v |
955 | 1552 | 0 | 0 | v |
756 | 7207 | 0 | 0 | v |
875 | 3892 | 0 | 0 | v |
229 | 1649 | 1 | 0 | v |
774 | 3412 | 0 | 0 | v |
104 | 4787 | 0 | 0 | v |
903 | 4384 | 0 | 0 | v |
660 | 6507 | 0 | 0 | v |
575 | 4717 | 1 | 0 | v |
163 | 1221 | 1 | 0 | v |
411 | 1933 | 0 | 0 | v |
694 | 6959 | 1 | 1 | v |
460 | 4683 | 1 | 1 | v |
795 | 4239 | 0 | 0 | v |
290 | 6855 | 1 | 1 | v |
207 | 797 | 1 | 0 | v |
328 | 3384 | 0 | 0 | v |
350 | 2481 | 1 | 0 | v |
971 | 1816 | 1 | 0 | v |
470 | 4084 | 1 | 1 | v |
869 | 1540 | 1 | 0 | v |
964 | 3359 | 0 | 0 | v |
966 | 1710 | 0 | 0 | v |
667 | 9102 | 0 | 1 | v |
457 | 1655 | 0 | 0 | v |
126 | 5198 | 0 | 0 | v |
385 | 5990 | 0 | 0 | v |
516 | 1688 | 1 | 0 | v |
560 | 3015 | 0 | 0 | v |
228 | 2743 | 0 | 0 | v |
347 | 1872 | 0 | 0 | v |
729 | 3008 | 1 | 0 | v |
716 | 5597 | 1 | 1 | v |
840 | 1148 | 1 | 0 | v |
204 | 2483 | 0 | 0 | v |
235 | 1935 | 0 | 0 | v |
170 | 7137 | 1 | 1 | v |
996 | 804 | 1 | 0 | v |
422 | 2891 | 0 | 0 | v |
13 | 1512 | 0 | 0 | v |
223 | 5344 | 1 | 1 | v |
497 | 3561 | 0 | 0 | v |
731 | 2107 | 0 | 0 | v |
493 | 1747 | 0 | 0 | v |
910 | 3255 | 1 | 0 | v |
887 | 5284 | 1 | 1 | v |
243 | 2777 | 1 | 0 | v |
285 | 2732 | 0 | 0 | v |
318 | 2684 | 1 | 0 | v |
314 | 2815 | 0 | 0 | v |
335 | 2165 | 1 | 0 | v |
463 | 2224 | 1 | 0 | v |
727 | 1625 | 1 | 0 | v |
38 | 6851 | 1 | 1 | v |
99 | 2630 | 1 | 0 | v |
758 | 2050 | 1 | 0 | v |
979 | 2049 | 1 | 0 | v |
248 | 2855 | 1 | 0 | v |
440 | 1668 | 1 | 0 | v |
138 | 1856 | 1 | 0 | v |
144 | 2064 | 0 | 0 | v |
251 | 2739 | 0 | 0 | v |
738 | 3510 | 0 | 0 | v |
333 | 6023 | 1 | 1 | v |
982 | 3277 | 0 | 0 | v |
31 | 1138 | 0 | 0 | v |
473 | 5375 | 1 | 1 | v |
492 | 2668 | 1 | 0 | v |
569 | 3871 | 1 | 0 | v |
27 | 3993 | 1 | 1 | v |
703 | 1763 | 0 | 0 | v |
863 | 2681 | 0 | 0 | v |
852 | 3414 | 0 | 0 | v |
354 | 2362 | 0 | 0 | v |
94 | 6073 | 1 | 1 | v |
541 | 2045 | 0 | 0 | v |
194 | 6204 | 0 | 0 | v |
14 | 2148 | 0 | 1 | v |
394 | 3165 | 0 | 0 | v |
785 | 1765 | 1 | 0 | v |
502 | 2352 | 1 | 0 | v |
361 | 4516 | 0 | 0 | v |
17 | 1307 | 0 | 0 | v |
72 | 2323 | 1 | 0 | v |
899 | 1302 | 1 | 0 | v |
808 | 2196 | 0 | 0 | v |
655 | 2269 | 1 | 0 | v |
4 | 3924 | 0 | 0 | v |
596 | 2513 | 1 | 0 | v |
837 | 7406 | 1 | 1 | v |
165 | 5028 | 1 | 1 | v |
565 | 5020 | 0 | 0 | v |
602 | 4637 | 1 | 1 | v |
776 | 2751 | 1 | 0 | v |
500 | 2284 | 0 | 0 | v |
562 | 4369 | 1 | 1 | v |
914 | 1607 | 0 | 0 | v |
309 | 4724 | 0 | 0 | v |
617 | 1070 | 1 | 0 | v |
467 | 9216 | 0 | 1 | v |
43 | 1657 | 1 | 0 | v |
821 | 2233 | 1 | 0 | v |
237 | 5935 | 0 | 0 | v |
589 | 2911 | 0 | 0 | v |
932 | 4417 | 1 | 0 | v |
873 | 3095 | 0 | 0 | v |
977 | 2063 | 1 | 0 | v |
36 | 1980 | 1 | 0 | v |
942 | 4685 | 1 | 1 | v |
674 | 5976 | 1 | 1 | v |
571 | 7399 | 1 | 1 | v |
824 | 3182 | 1 | 0 | v |
573 | 3417 | 1 | 1 | v |
599 | 2306 | 1 | 0 | v |
458 | 5661 | 0 | 0 | v |
439 | 1578 | 0 | 0 | v |
275 | 2497 | 1 | 0 | v |
116 | 2366 | 0 | 0 | v |
697 | 2733 | 1 | 0 | v |
851 | 2133 | 1 | 0 | v |
279 | 9043 | 1 | 1 | v |
10 | 3345 | 0 | 0 | v |
6 | 2473 | 0 | 1 | v |
609 | 5120 | 0 | 0 | v |
368 | 2582 | 1 | 0 | v |
1000 | 5816 | 1 | 1 | v |
456 | 10470 | 1 | 1 | v |
747 | 2360 | 0 | 0 | v |
64 | 2049 | 0 | 0 | v |
930 | 3268 | 1 | 1 | v |
765 | 3544 | 0 | 0 | v |
183 | 2044 | 0 | 0 | v |
139 | 5257 | 1 | 1 | v |
833 | 1028 | 0 | 0 | v |
781 | 7036 | 1 | 1 | v |
407 | 2782 | 1 | 0 | v |
800 | 1855 | 1 | 0 | v |
653 | 1183 | 1 | 0 | v |
558 | 8302 | 0 | 1 | v |
740 | 5955 | 1 | 1 | v |
566 | 1297 | 1 | 0 | v |
654 | 804 | 1 | 0 | v |
539 | 3830 | 1 | 0 | v |
405 | 4623 | 1 | 1 | v |
612 | 4135 | 0 | 0 | v |
281 | 3419 | 0 | 0 | v |
378 | 5144 | 0 | 0 | v |
233 | 2553 | 0 | 0 | v |
247 | 2868 | 1 | 0 | v |
509 | 1995 | 0 | 0 | v |
685 | 1734 | 0 | 0 | v |
162 | 3242 | 1 | 0 | v |
51 | 1068 | 1 | 1 | v |
690 | 7456 | 1 | 1 | v |
879 | 2291 | 1 | 0 | v |
701 | 5142 | 1 | 1 | v |
554 | 3149 | 1 | 0 | v |
540 | 984 | 1 | 0 | v |
268 | 1371 | 0 | 0 | v |
680 | 10367 | 0 | 1 | v |
69 | 3253 | 0 | 0 | v |
147 | 6930 | 0 | 0 | v |
853 | 5059 | 1 | 0 | v |
140 | 3575 | 0 | 0 | v |
943 | 2949 | 1 | 0 | v |
886 | 6701 | 0 | 0 | v |
419 | 3045 | 0 | 0 | v |
87 | 6486 | 1 | 1 | v |
410 | 1455 | 1 | 0 | v |
763 | 1295 | 1 | 0 | v |
191 | 1553 | 0 | 0 | v |
725 | 4051 | 1 | 1 | v |
307 | 3524 | 1 | 0 | v |
487 | 3283 | 0 | 0 | v |
313 | 2079 | 0 | 0 | v |
362 | 487 | 1 | 0 | v |
714 | 3291 | 0 | 0 | v |
606 | 798 | 0 | 0 | v |
721 | 5180 | 1 | 1 | v |
44 | 1075 | 0 | 0 | v |
259 | 3631 | 1 | 0 | v |
860 | 1564 | 0 | 0 | v |
619 | 1793 | 1 | 0 | v |
176 | 2309 | 0 | 0 | v |
258 | 2687 | 1 | 0 | v |
981 | 2633 | 0 | 0 | v |
344 | 1959 | 0 | 0 | v |
3 | 2135 | 1 | 0 | v |
954 | 3542 | 0 | 0 | v |
881 | 1995 | 1 | 0 | v |
974 | 3514 | 1 | 0 | v |
582 | 4373 | 1 | 0 | v |
512 | 3065 | 1 | 0 | v |
948 | 2139 | 0 | 0 | v |
691 | 5214 | 1 | 1 | v |
293 | 1835 | 0 | 0 | v |
567 | 1733 | 0 | 0 | v |
862 | 6063 | 0 | 0 | v |
319 | 6988 | 1 | 1 | v |
710 | 2325 | 0 | 0 | v |
19 | 2936 | 0 | 0 | v |
283 | 1395 | 1 | 0 | v |
634 | 1747 | 1 | 0 | v |
74 | 2678 | 1 | 1 | v |
592 | 3452 | 1 | 0 | s |
379 | 2455 | 0 | 0 | s |
101 | 3685 | 0 | 0 | s |
364 | 3449 | 1 | 0 | s |
299 | 4349 | 0 | 0 | s |
665 | 5661 | 1 | 1 | s |
597 | 12398 | 0 | 1 | s |
58 | 5501 | 0 | 0 | s |
102 | 4914 | 0 | 0 | s |
845 | 1896 | 1 | 0 | s |
601 | 1233 | 1 | 0 | s |
225 | 2957 | 1 | 0 | s |
359 | 7311 | 1 | 1 | s |
63 | 2936 | 1 | 0 | s |
253 | 2187 | 0 | 0 | s |
430 | 10726 | 1 | 1 | s |
706 | 2495 | 0 | 0 | s |
401 | 3755 | 0 | 0 | s |
326 | 4179 | 1 | 0 | s |
750 | 6994 | 1 | 1 | s |
284 | 5194 | 0 | 0 | s |
358 | 2660 | 1 | 0 | s |
791 | 2466 | 0 | 0 | s |
792 | 2082 | 1 | 0 | s |
557 | 11168 | 0 | 1 | s |
265 | 2320 | 0 | 0 | s |
533 | 1487 | 0 | 0 | s |
175 | 2310 | 1 | 0 | s |
177 | 4832 | 0 | 0 | s |
734 | 2300 | 1 | 0 | s |
773 | 1420 | 0 | 0 | s |
521 | 3145 | 0 | 0 | s |
173 | 2915 | 1 | 0 | s |
855 | 2130 | 1 | 0 | s |
199 | 2002 | 1 | 0 | s |
7 | 2384 | 0 | 0 | s |
946 | 2652 | 0 | 0 | s |
86 | 6737 | 1 | 1 | s |
291 | 1363 | 1 | 0 | s |
610 | 3080 | 1 | 0 | s |
768 | 2338 | 0 | 0 | s |
428 | 4494 | 1 | 0 | s |
828 | 2999 | 1 | 0 | s |
30 | 2229 | 0 | 1 | s |
469 | 5529 | 0 | 0 | s |
815 | 5561 | 0 | 0 | s |
709 | 2555 | 1 | 0 | s |
944 | 2202 | 1 | 0 | s |
67 | 2291 | 0 | 0 | s |
353 | 2421 | 0 | 0 | s |
600 | 2125 | 0 | 0 | s |
85 | 2135 | 0 | 1 | s |
826 | 9627 | 1 | 1 | s |
976 | 3368 | 1 | 0 | s |
940 | 3680 | 1 | 1 | s |
892 | 2900 | 0 | 0 | s |
271 | 2750 | 0 | 0 | s |
528 | 1662 | 1 | 0 | s |
762 | 1563 | 0 | 0 | s |
137 | 6474 | 1 | 1 | s |
352 | 3615 | 0 | 0 | s |
75 | 6179 | 1 | 1 | s |
806 | 2338 | 1 | 0 | s |
111 | 6761 | 1 | 1 | s |
890 | 2528 | 1 | 0 | s |
52 | 2421 | 0 | 0 | s |
823 | 1709 | 0 | 0 | s |
40 | 1911 | 0 | 0 | s |
312 | 4343 | 0 | 0 | s |
730 | 2308 | 1 | 0 | s |
825 | 2714 | 1 | 0 | s |
389 | 2971 | 0 | 0 | s |
226 | 2594 | 0 | 0 | s |
812 | 1783 | 0 | 0 | s |
832 | 2447 | 0 | 0 | s |
93 | 4959 | 1 | 1 | s |
216 | 3799 | 1 | 0 | s |
103 | 1366 | 1 | 0 | s |
341 | 745 | 0 | 0 | s |
131 | 4207 | 1 | 1 | s |
301 | 1465 | 0 | 0 | s |
345 | 3207 | 1 | 0 | s |
847 | 3025 | 1 | 0 | s |
227 | 5308 | 1 | 1 | s |
206 | 2048 | 1 | 0 | s |
668 | 4164 | 1 | 0 | s |
801 | 1617 | 0 | 0 | s |
152 | 2678 | 1 | 0 | s |
900 | 4050 | 0 | 0 | s |
213 | 2375 | 1 | 0 | s |
809 | 8665 | 0 | 1 | s |
395 | 2713 | 1 | 0 | s |
46 | 2118 | 0 | 0 | s |
417 | 3957 | 1 | 0 | s |
999 | 1970 | 1 | 0 | s |
9 | 1182 | 1 | 1 | s |
529 | 3976 | 0 | 0 | s |
505 | 3700 | 0 | 0 | s |
471 | 1392 | 1 | 0 | s |
574 | 4201 | 0 | 0 | s |
836 | 2836 | 1 | 0 | s |
231 | 1669 | 0 | 0 | s |
885 |