---------------------------------------------------------------------------------------------------- 30/10/23 14:14:05| INFO: dataset imdb ---------------------------------------------------------------------------------------------------- 30/10/23 14:14:24| INFO: dataset imdb 30/10/23 14:14:31| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:14:35| WARNING: Method ref failed. Exception: 'dict' object has no attribute 'Keys' 30/10/23 14:14:35| WARNING: Method atc_mc failed. Exception: 'dict' object has no attribute 'Keys' 30/10/23 14:14:35| WARNING: Method atc_ne failed. Exception: 'dict' object has no attribute 'Keys' 30/10/23 14:14:42| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:14:52| WARNING: Method mul_sld failed. Exception: 'dict' object has no attribute 'Keys' 30/10/23 14:14:52| INFO: Dataset sample 0.90 of dataset imdb finished [took 21.1198s] 30/10/23 14:14:52| WARNING: Dataset sample 0.90 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 14:14:52| ERROR: Configuration imdb_1prevs failed. Exception: 'module' object is not callable 30/10/23 14:14:52| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 14:16:15| INFO: dataset imdb 30/10/23 14:16:22| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:16:34| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:16:36| INFO: ref finished [took 11.6636s] 30/10/23 14:16:39| INFO: atc_mc finished [took 14.8672s] 30/10/23 14:16:39| INFO: atc_ne finished [took 14.8614s] 30/10/23 14:16:49| INFO: mul_sld finished [took 24.6212s] 30/10/23 14:16:49| INFO: Dataset sample 0.90 of dataset imdb finished [took 26.7805s] 30/10/23 14:16:49| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 14:17:02| INFO: ref finished [took 13.0129s] 30/10/23 14:17:06| INFO: atc_mc finished [took 16.0277s] 30/10/23 14:17:06| INFO: atc_ne finished [took 16.1381s] 30/10/23 14:17:17| INFO: mul_sld finished [took 28.1917s] 30/10/23 14:17:23| INFO: mul_sld_bcts finished [took 33.5628s] 30/10/23 14:17:23| INFO: Dataset sample 0.80 of dataset imdb finished [took 34.3680s] 30/10/23 14:17:23| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 14:17:36| INFO: ref finished [took 12.5930s] 30/10/23 14:17:40| INFO: atc_mc finished [took 16.1461s] 30/10/23 14:17:40| INFO: atc_ne finished [took 16.1788s] 30/10/23 14:17:52| INFO: mul_sld finished [took 28.5367s] 30/10/23 14:18:00| INFO: mul_sld_bcts finished [took 36.0452s] 30/10/23 14:18:00| INFO: Dataset sample 0.50 of dataset imdb finished [took 36.7488s] 30/10/23 14:18:00| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 14:18:13| INFO: ref finished [took 12.3910s] 30/10/23 14:18:17| INFO: atc_mc finished [took 15.8804s] 30/10/23 14:18:17| INFO: atc_ne finished [took 15.7115s] 30/10/23 14:18:32| INFO: mul_sld_bcts finished [took 31.9997s] 30/10/23 14:18:34| INFO: mul_sld finished [took 33.3735s] 30/10/23 14:18:34| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.9557s] 30/10/23 14:18:34| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 14:18:44| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:18:46| INFO: ref finished [took 11.7451s] 30/10/23 14:18:50| INFO: atc_mc finished [took 15.2294s] 30/10/23 14:18:50| INFO: atc_ne finished [took 15.1239s] 30/10/23 14:18:55| INFO: mul_sld finished [took 21.3092s] 30/10/23 14:18:55| INFO: Dataset sample 0.10 of dataset imdb finished [took 21.7186s] 30/10/23 14:18:55| ERROR: Configuration imdb_1prevs failed. Exception: 'mul_sld_bcts' 30/10/23 14:18:55| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 14:32:36| INFO: dataset imdb 30/10/23 14:32:43| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:32:56| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:32:58| INFO: ref finished [took 12.0197s] 30/10/23 14:33:01| INFO: atc_mc finished [took 15.0884s] 30/10/23 14:33:01| INFO: atc_ne finished [took 15.0503s] 30/10/23 14:33:10| INFO: mul_sld finished [took 24.4470s] 30/10/23 14:33:10| INFO: Dataset sample 0.90 of dataset imdb finished [took 26.6099s] 30/10/23 14:33:10| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 14:33:23| INFO: ref finished [took 12.1812s] 30/10/23 14:33:27| INFO: atc_mc finished [took 15.5589s] 30/10/23 14:33:27| INFO: atc_ne finished [took 15.5283s] 30/10/23 14:33:38| INFO: mul_sld finished [took 27.1282s] 30/10/23 14:33:44| INFO: mul_sld_bcts finished [took 33.1098s] 30/10/23 14:33:44| INFO: Dataset sample 0.80 of dataset imdb finished [took 33.9196s] 30/10/23 14:33:44| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 14:33:57| INFO: ref finished [took 12.5959s] 30/10/23 14:34:01| INFO: atc_mc finished [took 15.9389s] 30/10/23 14:34:01| INFO: atc_ne finished [took 16.0795s] 30/10/23 14:34:13| INFO: mul_sld finished [took 28.1568s] 30/10/23 14:34:20| INFO: mul_sld_bcts finished [took 35.7147s] 30/10/23 14:34:20| INFO: Dataset sample 0.50 of dataset imdb finished [took 36.3828s] 30/10/23 14:34:20| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 14:34:33| INFO: ref finished [took 12.2399s] 30/10/23 14:34:37| INFO: atc_mc finished [took 15.4570s] 30/10/23 14:34:37| INFO: atc_ne finished [took 15.5302s] 30/10/23 14:34:52| INFO: mul_sld_bcts finished [took 31.1972s] 30/10/23 14:34:54| INFO: mul_sld finished [took 32.9409s] 30/10/23 14:34:54| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.5034s] 30/10/23 14:34:54| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 14:35:04| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:35:06| INFO: ref finished [took 11.6742s] 30/10/23 14:35:09| INFO: atc_mc finished [took 14.8324s] 30/10/23 14:35:10| INFO: atc_ne finished [took 14.8661s] 30/10/23 14:35:15| INFO: mul_sld finished [took 21.1356s] 30/10/23 14:35:15| INFO: Dataset sample 0.10 of dataset imdb finished [took 21.5814s] 30/10/23 14:35:15| ERROR: Configuration imdb_1prevs failed. Exception: ('acc', None) 30/10/23 14:35:15| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 14:37:47| INFO: dataset imdb 30/10/23 14:37:54| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:38:07| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:38:09| INFO: ref finished [took 12.0443s] 30/10/23 14:38:12| INFO: atc_mc finished [took 14.8929s] 30/10/23 14:38:12| INFO: atc_ne finished [took 15.0431s] 30/10/23 14:38:21| INFO: mul_sld finished [took 24.7987s] 30/10/23 14:38:21| INFO: Dataset sample 0.90 of dataset imdb finished [took 27.0182s] 30/10/23 14:38:21| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 14:38:35| INFO: ref finished [took 12.4504s] 30/10/23 14:38:38| INFO: atc_mc finished [took 16.1560s] 30/10/23 14:38:39| INFO: atc_ne finished [took 16.1785s] 30/10/23 14:38:49| INFO: mul_sld finished [took 27.0617s] 30/10/23 14:38:55| INFO: mul_sld_bcts finished [took 32.7384s] 30/10/23 14:38:55| INFO: Dataset sample 0.80 of dataset imdb finished [took 33.5347s] 30/10/23 14:38:55| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 14:39:08| INFO: ref finished [took 12.4381s] 30/10/23 14:39:11| INFO: atc_mc finished [took 15.6709s] 30/10/23 14:39:11| INFO: atc_ne finished [took 15.7319s] 30/10/23 14:39:23| INFO: mul_sld finished [took 27.9301s] 30/10/23 14:39:31| INFO: mul_sld_bcts finished [took 35.5094s] 30/10/23 14:39:31| INFO: Dataset sample 0.50 of dataset imdb finished [took 36.1333s] 30/10/23 14:39:31| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 14:39:44| INFO: ref finished [took 12.0382s] 30/10/23 14:39:47| INFO: atc_mc finished [took 15.0164s] 30/10/23 14:39:47| INFO: atc_ne finished [took 15.1080s] 30/10/23 14:40:02| INFO: mul_sld_bcts finished [took 30.9659s] 30/10/23 14:40:04| INFO: mul_sld finished [took 32.9418s] 30/10/23 14:40:04| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.4681s] 30/10/23 14:40:04| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 14:40:14| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:40:17| INFO: ref finished [took 11.8501s] 30/10/23 14:40:20| INFO: atc_mc finished [took 14.8473s] 30/10/23 14:40:21| INFO: atc_ne finished [took 15.2000s] 30/10/23 14:40:26| INFO: mul_sld finished [took 21.4799s] 30/10/23 14:40:26| INFO: Dataset sample 0.10 of dataset imdb finished [took 21.9220s] 30/10/23 14:40:26| ERROR: Configuration imdb_1prevs failed. Exception: NDFrame.droplevel() got an unexpected keyword argument 'index' 30/10/23 14:40:26| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 14:42:13| INFO: dataset imdb 30/10/23 14:42:20| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:42:33| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:42:34| INFO: ref finished [took 12.1951s] 30/10/23 14:42:38| INFO: atc_ne finished [took 15.3431s] 30/10/23 14:42:38| INFO: atc_mc finished [took 15.4508s] 30/10/23 14:42:47| INFO: mul_sld finished [took 25.0246s] 30/10/23 14:42:47| INFO: Dataset sample 0.90 of dataset imdb finished [took 27.1381s] 30/10/23 14:42:47| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 14:43:00| INFO: ref finished [took 12.3269s] 30/10/23 14:43:04| INFO: atc_ne finished [took 15.9216s] 30/10/23 14:43:04| INFO: atc_mc finished [took 16.1140s] 30/10/23 14:43:16| INFO: mul_sld finished [took 28.0575s] 30/10/23 14:43:22| INFO: mul_sld_bcts finished [took 33.9201s] 30/10/23 14:43:22| INFO: Dataset sample 0.80 of dataset imdb finished [took 34.7703s] 30/10/23 14:43:22| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 14:43:35| INFO: ref finished [took 12.6508s] 30/10/23 14:43:39| INFO: atc_mc finished [took 16.0527s] 30/10/23 14:43:39| INFO: atc_ne finished [took 16.0515s] 30/10/23 14:43:50| INFO: mul_sld finished [took 28.1061s] 30/10/23 14:43:57| INFO: mul_sld_bcts finished [took 34.9278s] 30/10/23 14:43:57| INFO: Dataset sample 0.50 of dataset imdb finished [took 35.6587s] 30/10/23 14:43:57| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 14:44:10| INFO: ref finished [took 12.0801s] 30/10/23 14:44:14| INFO: atc_mc finished [took 15.4685s] 30/10/23 14:44:14| INFO: atc_ne finished [took 15.4165s] 30/10/23 14:44:29| INFO: mul_sld_bcts finished [took 31.5628s] 30/10/23 14:44:31| INFO: mul_sld finished [took 33.3113s] 30/10/23 14:44:31| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.8828s] 30/10/23 14:44:31| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 14:44:41| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:44:44| INFO: ref finished [took 11.6822s] 30/10/23 14:44:47| INFO: atc_mc finished [took 14.8091s] 30/10/23 14:44:47| INFO: atc_ne finished [took 14.7900s] 30/10/23 14:44:53| INFO: mul_sld finished [took 21.0390s] 30/10/23 14:44:53| INFO: Dataset sample 0.10 of dataset imdb finished [took 21.4515s] 30/10/23 14:44:53| ERROR: Configuration imdb_1prevs failed. Exception: 'function' object has no attribute 'index' 30/10/23 14:44:53| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 14:46:34| INFO: dataset imdb 30/10/23 14:46:41| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 14:46:54| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:46:56| INFO: ref finished [took 12.5001s] 30/10/23 14:46:59| INFO: atc_mc finished [took 15.5415s] 30/10/23 14:46:59| INFO: atc_ne finished [took 15.6358s] 30/10/23 14:47:08| INFO: mul_sld finished [took 24.5102s] 30/10/23 14:47:08| INFO: Dataset sample 0.90 of dataset imdb finished [took 26.5553s] 30/10/23 14:47:08| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 14:47:21| INFO: ref finished [took 12.0997s] 30/10/23 14:47:24| INFO: atc_mc finished [took 15.4285s] 30/10/23 14:47:24| INFO: atc_ne finished [took 15.5599s] 30/10/23 14:47:36| INFO: mul_sld finished [took 27.6146s] 30/10/23 14:47:43| INFO: mul_sld_bcts finished [took 34.2610s] 30/10/23 14:47:43| INFO: Dataset sample 0.80 of dataset imdb finished [took 35.0096s] 30/10/23 14:47:43| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 14:47:56| INFO: ref finished [took 12.1238s] 30/10/23 14:48:00| INFO: atc_mc finished [took 15.6990s] 30/10/23 14:48:00| INFO: atc_ne finished [took 15.8708s] 30/10/23 14:48:11| INFO: mul_sld finished [took 28.0048s] 30/10/23 14:48:20| INFO: mul_sld_bcts finished [took 36.1524s] 30/10/23 14:48:20| INFO: Dataset sample 0.50 of dataset imdb finished [took 36.8480s] 30/10/23 14:48:20| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 14:48:32| INFO: ref finished [took 11.3690s] 30/10/23 14:48:35| INFO: atc_mc finished [took 14.3092s] 30/10/23 14:48:35| INFO: atc_ne finished [took 14.4043s] 30/10/23 14:48:51| INFO: mul_sld_bcts finished [took 30.2595s] 30/10/23 14:48:52| INFO: mul_sld finished [took 31.4270s] 30/10/23 14:48:52| INFO: Dataset sample 0.20 of dataset imdb finished [took 31.9598s] 30/10/23 14:48:52| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 14:49:02| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 14:49:04| INFO: ref finished [took 12.1449s] 30/10/23 14:49:08| INFO: atc_mc finished [took 15.0332s] 30/10/23 14:49:08| INFO: atc_ne finished [took 15.3463s] 30/10/23 14:49:13| INFO: mul_sld finished [took 21.2802s] 30/10/23 14:49:13| INFO: Dataset sample 0.10 of dataset imdb finished [took 21.7079s] 30/10/23 14:49:14| ERROR: Configuration imdb_1prevs failed. Exception: unsupported operand type(s) for -: 'list' and 'list' 30/10/23 14:49:14| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 15:10:08| INFO: dataset imdb 30/10/23 15:10:14| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 15:10:26| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 15:10:27| INFO: ref finished [took 10.8100s] 30/10/23 15:10:30| INFO: atc_mc finished [took 13.5996s] 30/10/23 15:10:30| INFO: atc_ne finished [took 13.6110s] 30/10/23 15:10:39| INFO: mul_sld finished [took 22.7361s] 30/10/23 15:10:39| INFO: Dataset sample 0.90 of dataset imdb finished [took 24.8056s] 30/10/23 15:10:39| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 15:10:51| INFO: ref finished [took 10.9293s] 30/10/23 15:10:54| INFO: atc_mc finished [took 13.8377s] 30/10/23 15:10:54| INFO: atc_ne finished [took 13.9983s] 30/10/23 15:11:05| INFO: mul_sld finished [took 25.1977s] 30/10/23 15:11:11| INFO: mul_sld_bcts finished [took 31.1124s] 30/10/23 15:11:11| INFO: Dataset sample 0.80 of dataset imdb finished [took 31.8294s] 30/10/23 15:11:11| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 15:11:23| INFO: ref finished [took 11.0056s] 30/10/23 15:11:26| INFO: atc_mc finished [took 14.3946s] 30/10/23 15:11:27| INFO: atc_ne finished [took 14.6355s] 30/10/23 15:11:38| INFO: mul_sld finished [took 26.2697s] 30/10/23 15:11:45| INFO: mul_sld_bcts finished [took 33.8992s] 30/10/23 15:11:45| INFO: Dataset sample 0.50 of dataset imdb finished [took 34.4963s] 30/10/23 15:11:45| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 15:11:57| INFO: ref finished [took 10.9836s] 30/10/23 15:12:00| INFO: atc_mc finished [took 13.8378s] 30/10/23 15:12:00| INFO: atc_ne finished [took 13.8318s] 30/10/23 15:12:16| INFO: mul_sld_bcts finished [took 29.9813s] 30/10/23 15:12:17| INFO: mul_sld finished [took 30.7175s] 30/10/23 15:12:17| INFO: Dataset sample 0.20 of dataset imdb finished [took 31.2508s] 30/10/23 15:12:17| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 15:12:26| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 15:12:28| INFO: ref finished [took 10.4376s] 30/10/23 15:12:31| INFO: atc_ne finished [took 13.3510s] 30/10/23 15:12:31| INFO: atc_mc finished [took 13.5172s] 30/10/23 15:12:37| INFO: mul_sld finished [took 19.7440s] 30/10/23 15:12:37| INFO: Dataset sample 0.10 of dataset imdb finished [took 20.1519s] 30/10/23 15:12:37| ERROR: Configuration imdb_1prevs failed. Exception: ufunc 'isfinite' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe'' 30/10/23 15:12:37| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 17:12:41| INFO: dataset imdb 30/10/23 17:12:48| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 17:13:01| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 17:13:03| INFO: ref finished [took 12.6699s] 30/10/23 17:13:07| INFO: atc_ne finished [took 15.6073s] 30/10/23 17:13:07| INFO: atc_mc finished [took 15.6695s] 30/10/23 17:13:15| INFO: mul_sld finished [took 24.8617s] 30/10/23 17:13:15| INFO: Dataset sample 0.90 of dataset imdb finished [took 27.6018s] 30/10/23 17:13:15| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 17:13:29| INFO: ref finished [took 12.6205s] 30/10/23 17:13:33| INFO: atc_mc finished [took 16.2005s] 30/10/23 17:13:33| INFO: atc_ne finished [took 16.2091s] 30/10/23 17:13:43| INFO: mul_sld finished [took 27.1113s] 30/10/23 17:13:49| INFO: mul_sld_bcts finished [took 33.3939s] 30/10/23 17:13:49| INFO: Dataset sample 0.80 of dataset imdb finished [took 34.1222s] 30/10/23 17:13:49| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 17:14:04| INFO: ref finished [took 13.2345s] 30/10/23 17:14:07| INFO: atc_mc finished [took 16.5475s] 30/10/23 17:14:07| INFO: atc_ne finished [took 16.6557s] 30/10/23 17:14:19| INFO: mul_sld finished [took 28.8817s] 30/10/23 17:14:27| INFO: mul_sld_bcts finished [took 36.5726s] 30/10/23 17:14:27| INFO: Dataset sample 0.50 of dataset imdb finished [took 37.2057s] 30/10/23 17:14:27| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 17:14:39| INFO: ref finished [took 11.7051s] 30/10/23 17:14:42| INFO: atc_mc finished [took 14.8335s] 30/10/23 17:14:43| INFO: atc_ne finished [took 15.0826s] 30/10/23 17:14:59| INFO: mul_sld_bcts finished [took 31.7685s] 30/10/23 17:15:00| INFO: mul_sld finished [took 33.2861s] 30/10/23 17:15:00| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.8225s] 30/10/23 17:15:00| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 17:15:11| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 17:15:13| INFO: ref finished [took 12.0927s] 30/10/23 17:15:17| INFO: atc_mc finished [took 15.4201s] 30/10/23 17:15:17| INFO: atc_ne finished [took 15.5212s] 30/10/23 17:15:23| INFO: mul_sld finished [took 21.7236s] 30/10/23 17:15:23| INFO: Dataset sample 0.10 of dataset imdb finished [took 22.2065s] 30/10/23 17:15:23| ERROR: Configuration imdb_1prevs failed. Exception: operands could not be broadcast together with shapes (0,) (0,21) 30/10/23 17:15:23| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 17:16:39| INFO: dataset imdb 30/10/23 17:16:46| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 17:16:58| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 17:17:00| INFO: ref finished [took 11.7575s] 30/10/23 17:17:03| INFO: atc_ne finished [took 14.7709s] 30/10/23 17:17:03| INFO: atc_mc finished [took 14.8925s] 30/10/23 17:17:12| INFO: mul_sld finished [took 23.7037s] 30/10/23 17:17:12| INFO: Dataset sample 0.90 of dataset imdb finished [took 25.8491s] 30/10/23 17:17:12| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 17:17:25| INFO: ref finished [took 12.2081s] 30/10/23 17:17:28| INFO: atc_ne finished [took 15.3145s] 30/10/23 17:17:28| INFO: atc_mc finished [took 15.5166s] 30/10/23 17:17:39| INFO: mul_sld finished [took 26.7520s] 30/10/23 17:17:45| INFO: mul_sld_bcts finished [took 32.0850s] 30/10/23 17:17:45| INFO: Dataset sample 0.80 of dataset imdb finished [took 32.8702s] 30/10/23 17:17:45| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 17:17:57| INFO: ref finished [took 11.9494s] 30/10/23 17:18:01| INFO: atc_mc finished [took 15.3034s] 30/10/23 17:18:01| INFO: atc_ne finished [took 15.3254s] 30/10/23 17:18:12| INFO: mul_sld finished [took 27.2902s] 30/10/23 17:18:20| INFO: mul_sld_bcts finished [took 34.4237s] 30/10/23 17:18:20| INFO: Dataset sample 0.50 of dataset imdb finished [took 35.1216s] 30/10/23 17:18:20| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 17:18:32| INFO: ref finished [took 11.7945s] 30/10/23 17:18:35| INFO: atc_mc finished [took 14.9218s] 30/10/23 17:18:36| INFO: atc_ne finished [took 14.9745s] 30/10/23 17:18:51| INFO: mul_sld_bcts finished [took 30.7287s] 30/10/23 17:18:53| INFO: mul_sld finished [took 32.5641s] 30/10/23 17:18:53| INFO: Dataset sample 0.20 of dataset imdb finished [took 33.0982s] 30/10/23 17:18:53| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 17:19:02| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 17:19:05| INFO: ref finished [took 11.4568s] 30/10/23 17:19:08| INFO: atc_mc finished [took 14.4778s] 30/10/23 17:19:08| INFO: atc_ne finished [took 14.5099s] 30/10/23 17:19:14| INFO: mul_sld finished [took 20.5183s] 30/10/23 17:19:14| INFO: Dataset sample 0.10 of dataset imdb finished [took 20.9251s] 30/10/23 17:19:14| ERROR: Configuration imdb_1prevs failed. Exception: operands could not be broadcast together with shapes (0,) (0,21) 30/10/23 17:19:14| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- 30/10/23 19:57:49| INFO: dataset imdb 30/10/23 19:58:00| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 19:58:11| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 19:58:22| INFO: ref finished [took 20.9010s] 30/10/23 19:58:29| INFO: atc_ne finished [took 27.8453s] 30/10/23 19:58:29| INFO: atc_mc finished [took 28.1079s] 30/10/23 19:58:37| INFO: mul_sld finished [took 36.1699s] 30/10/23 19:58:37| INFO: Dataset sample 0.90 of dataset imdb finished [took 36.7140s] 30/10/23 19:58:37| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 19:59:01| INFO: ref finished [took 23.2803s] 30/10/23 19:59:09| INFO: atc_ne finished [took 31.1099s] 30/10/23 19:59:09| INFO: atc_mc finished [took 31.5916s] 30/10/23 19:59:19| INFO: mul_sld finished [took 41.5113s] 30/10/23 19:59:24| INFO: mul_sld_bcts finished [took 46.6603s] 30/10/23 19:59:24| INFO: Dataset sample 0.80 of dataset imdb finished [took 47.4989s] 30/10/23 19:59:24| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 19:59:49| INFO: ref finished [took 23.6312s] 30/10/23 19:59:57| INFO: atc_ne finished [took 31.5195s] 30/10/23 19:59:57| INFO: atc_mc finished [took 31.8197s] 30/10/23 20:00:08| INFO: mul_sld finished [took 42.8675s] 30/10/23 20:00:15| INFO: mul_sld_bcts finished [took 50.5527s] 30/10/23 20:00:16| INFO: Dataset sample 0.50 of dataset imdb finished [took 51.3659s] 30/10/23 20:00:16| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 20:00:41| INFO: ref finished [took 24.2178s] 30/10/23 20:00:48| INFO: atc_mc finished [took 31.9886s] 30/10/23 20:00:49| INFO: atc_ne finished [took 32.1537s] 30/10/23 20:01:03| INFO: mul_sld_bcts finished [took 46.2477s] 30/10/23 20:01:07| INFO: mul_sld finished [took 50.8912s] 30/10/23 20:01:07| INFO: Dataset sample 0.20 of dataset imdb finished [took 51.4589s] 30/10/23 20:01:07| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 20:01:18| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 20:01:30| INFO: ref finished [took 22.6404s] 30/10/23 20:01:38| INFO: atc_mc finished [took 29.8371s] 30/10/23 20:01:38| INFO: atc_ne finished [took 30.2098s] 30/10/23 20:01:41| INFO: mul_sld finished [took 33.6271s] 30/10/23 20:01:41| INFO: Dataset sample 0.10 of dataset imdb finished [took 34.1993s] 30/10/23 20:01:42| ERROR: Configuration imdb_1prevs failed. Exception: operands could not be broadcast together with shapes (0,) (0,21) 30/10/23 20:01:42| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 20:05:04| INFO: dataset imdb 30/10/23 20:05:14| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 20:05:26| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 20:05:38| INFO: ref finished [took 22.7241s] 30/10/23 20:05:45| INFO: atc_mc finished [took 29.9191s] 30/10/23 20:05:45| INFO: atc_ne finished [took 29.8405s] 30/10/23 20:05:52| INFO: mul_sld finished [took 37.4045s] 30/10/23 20:05:52| INFO: Dataset sample 0.90 of dataset imdb finished [took 37.9554s] 30/10/23 20:05:52| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 20:06:17| INFO: ref finished [took 23.2465s] 30/10/23 20:06:25| INFO: atc_ne finished [took 31.0138s] 30/10/23 20:06:25| INFO: atc_mc finished [took 31.1341s] 30/10/23 20:06:34| INFO: mul_sld finished [took 40.8777s] 30/10/23 20:06:40| INFO: mul_sld_bcts finished [took 46.7083s] 30/10/23 20:06:40| INFO: Dataset sample 0.80 of dataset imdb finished [took 47.5062s] 30/10/23 20:06:40| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:07:05| INFO: ref finished [took 24.3375s] 30/10/23 20:07:15| INFO: atc_mc finished [took 33.8014s] 30/10/23 20:07:15| INFO: atc_ne finished [took 33.7355s] 30/10/23 20:07:25| INFO: mul_sld finished [took 44.2891s] 30/10/23 20:07:32| INFO: mul_sld_bcts finished [took 51.2404s] 30/10/23 20:07:32| INFO: Dataset sample 0.50 of dataset imdb finished [took 51.9917s] 30/10/23 20:07:32| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 20:07:55| INFO: ref finished [took 21.6828s] 30/10/23 20:08:01| INFO: atc_mc finished [took 28.2369s] 30/10/23 20:08:01| INFO: atc_ne finished [took 28.4328s] 30/10/23 20:08:15| INFO: mul_sld_bcts finished [took 41.9176s] 30/10/23 20:08:18| INFO: mul_sld finished [took 45.4999s] 30/10/23 20:08:18| INFO: Dataset sample 0.20 of dataset imdb finished [took 46.0301s] 30/10/23 20:08:18| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 20:08:28| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 20:08:38| INFO: ref finished [took 19.4082s] 30/10/23 20:08:45| INFO: atc_mc finished [took 26.2343s] 30/10/23 20:08:45| INFO: atc_ne finished [took 26.2322s] 30/10/23 20:08:48| INFO: mul_sld finished [took 29.8392s] 30/10/23 20:08:48| INFO: Dataset sample 0.10 of dataset imdb finished [took 30.3563s] ---------------------------------------------------------------------------------------------------- 30/10/23 20:29:28| INFO: dataset imdb 30/10/23 20:29:38| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:29:59| INFO: ref finished [took 19.1581s] 30/10/23 20:30:06| INFO: atc_mc finished [took 26.3398s] 30/10/23 20:30:07| INFO: atc_ne finished [took 26.4359s] 30/10/23 20:30:07| INFO: Dataset sample 0.50 of dataset imdb finished [took 28.7984s] ---------------------------------------------------------------------------------------------------- 30/10/23 20:31:50| INFO: dataset imdb 30/10/23 20:32:00| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:33:59|INFO: ref finished [took 118.1306s] ---------------------------------------------------------------------------------------------------- 30/10/23 20:36:06| INFO: dataset imdb 30/10/23 20:36:17| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:38:52|WARNING: Method ref failed. Exception: "['acc_score' 'f1_score' 'ref'] not in index" 30/10/23 20:41:28|WARNING: Method atc_mc failed. Exception: "['acc' 'acc_score' 'atc_mc' 'f1' 'f1_score'] not in index" 30/10/23 20:41:32|WARNING: Method atc_ne failed. Exception: "['acc' 'acc_score' 'atc_ne' 'f1' 'f1_score'] not in index" 30/10/23 20:41:32| INFO: Dataset sample 0.50 of dataset imdb finished [took 315.4626s] 30/10/23 20:41:32| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:41:32| ERROR: Configuration imdb_1prevs failed. Exception: 'module' object is not callable 30/10/23 20:41:32| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 20:41:43| INFO: dataset imdb 30/10/23 20:41:54| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:42:26| WARNING: Method ref failed. Exception: Shape of passed values is (2, 1), indices imply (1, 2) 30/10/23 20:43:01| WARNING: Method atc_mc failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:43:08| WARNING: Method atc_ne failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:43:08| INFO: Dataset sample 0.50 of dataset imdb finished [took 73.6011s] 30/10/23 20:43:08| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:43:08| ERROR: Configuration imdb_1prevs failed. Exception: 'module' object is not callable 30/10/23 20:43:08| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 20:44:25| INFO: dataset imdb 30/10/23 20:44:35| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:44:37| WARNING: Method ref failed. Exception: Shape of passed values is (2, 1), indices imply (1, 2) 30/10/23 20:44:37| WARNING: Method atc_mc failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:44:38| WARNING: Method atc_ne failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:44:38| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.6758s] 30/10/23 20:44:38| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:44:38| ERROR: Configuration imdb_1prevs failed. Exception: 'module' object is not callable 30/10/23 20:44:38| ERROR: estimate comparison failed. Exceprion: 'module' object is not callable ---------------------------------------------------------------------------------------------------- 30/10/23 20:47:08| INFO: dataset imdb 30/10/23 20:47:18| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:47:20| WARNING: Method ref failed. Exception: Shape of passed values is (2, 1), indices imply (1, 2) 30/10/23 20:47:21| WARNING: Method atc_mc failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:47:21| WARNING: Method atc_ne failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:47:21| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.6147s] 30/10/23 20:47:21| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:47:21| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 20:50:07| INFO: dataset imdb 30/10/23 20:50:17| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:50:19| WARNING: Method ref failed. Exception: Shape of passed values is (2, 1), indices imply (1, 2) 30/10/23 20:50:20| WARNING: Method atc_mc failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:50:20| WARNING: Method atc_ne failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:50:20| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.5897s] 30/10/23 20:50:20| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:50:20| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 20:51:29| INFO: dataset imdb 30/10/23 20:51:39| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:51:42| WARNING: Method ref failed. Exception: Shape of passed values is (2, 1), indices imply (1, 2) 30/10/23 20:51:42| WARNING: Method atc_mc failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:51:42| WARNING: Method atc_ne failed. Exception: Shape of passed values is (4, 1), indices imply (1, 4) 30/10/23 20:51:42| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.5821s] 30/10/23 20:51:42| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:51:42| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 20:56:28| INFO: dataset imdb 30/10/23 20:56:38| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:56:40| WARNING: Method ref failed. Exception: cannot reshape array of size 1 into shape (1,2) 30/10/23 20:56:40| WARNING: Method atc_mc failed. Exception: cannot reshape array of size 1 into shape (1,4) 30/10/23 20:56:40| WARNING: Method atc_ne failed. Exception: cannot reshape array of size 1 into shape (1,4) 30/10/23 20:56:40| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.6150s] 30/10/23 20:56:40| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:56:40| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 20:57:13| INFO: dataset imdb 30/10/23 20:57:23| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 20:59:40| WARNING: Method ref failed. Exception: cannot reshape array of size 1 into shape (1,2) 30/10/23 20:59:51| WARNING: Method atc_mc failed. Exception: cannot reshape array of size 1 into shape (1,4) 30/10/23 20:59:52| WARNING: Method atc_ne failed. Exception: cannot reshape array of size 1 into shape (1,4) 30/10/23 20:59:52| INFO: Dataset sample 0.50 of dataset imdb finished [took 149.2395s] 30/10/23 20:59:52| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 20:59:52| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 21:00:04| INFO: dataset imdb 30/10/23 21:00:14| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:01:33| INFO: ref finished [took 78.2917s] 30/10/23 21:01:42| INFO: atc_mc finished [took 86.9003s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:01:59| INFO: dataset imdb 30/10/23 21:02:09| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:04:09| INFO: dataset imdb 30/10/23 21:04:19| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:06:25| INFO: dataset imdb 30/10/23 21:06:35| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:07:33| INFO: dataset imdb 30/10/23 21:07:43| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:07:45| WARNING: Method ref failed. Exception: setting an array element with a sequence. 30/10/23 21:07:45| WARNING: Method atc_mc failed. Exception: setting an array element with a sequence. 30/10/23 21:07:45| WARNING: Method atc_ne failed. Exception: setting an array element with a sequence. 30/10/23 21:07:45| INFO: Dataset sample 0.50 of dataset imdb finished [took 2.5382s] 30/10/23 21:07:45| WARNING: Dataset sample 0.50 of dataset imdb failed. Exception: No objects to concatenate 30/10/23 21:07:45| ERROR: Configuration imdb_1prevs failed. Exception: No objects to concatenate ---------------------------------------------------------------------------------------------------- 30/10/23 21:09:07| INFO: dataset imdb 30/10/23 21:09:16| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:10:48| INFO: dataset imdb 30/10/23 21:10:58| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:18:53| INFO: dataset imdb 30/10/23 21:19:03| INFO: Dataset sample 0.50 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 21:22:03| INFO: dataset imdb 30/10/23 21:22:12| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:22:31| INFO: ref finished [took 17.0861s] 30/10/23 21:22:37| INFO: atc_mc finished [took 23.6279s] 30/10/23 21:22:38| INFO: atc_ne finished [took 23.7395s] 30/10/23 21:22:38| INFO: Dataset sample 0.50 of dataset imdb finished [took 25.2007s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:29:55| INFO: dataset imdb 30/10/23 21:30:05| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:30:23| INFO: ref finished [took 16.7801s] 30/10/23 21:30:30| INFO: atc_mc finished [took 23.5645s] 30/10/23 21:30:30| INFO: atc_ne finished [took 23.5639s] 30/10/23 21:30:30| INFO: Dataset sample 0.50 of dataset imdb finished [took 25.0459s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:33:45| INFO: dataset imdb 30/10/23 21:33:55| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:34:13| INFO: ref finished [took 17.0169s] 30/10/23 21:34:20| INFO: atc_mc finished [took 23.4725s] 30/10/23 21:34:20| INFO: atc_ne finished [took 23.5928s] 30/10/23 21:34:20| INFO: Dataset sample 0.50 of dataset imdb finished [took 24.9542s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:37:32| INFO: dataset imdb 30/10/23 21:37:39| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:37:49| INFO: ref finished [took 8.9050s] 30/10/23 21:37:52| INFO: atc_mc finished [took 11.7412s] 30/10/23 21:37:52| INFO: atc_ne finished [took 11.7256s] 30/10/23 21:37:52| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.9758s] 30/10/23 21:37:53| ERROR: Configuration imdb_1prevs failed. Exception: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices ---------------------------------------------------------------------------------------------------- 30/10/23 21:39:14| INFO: dataset imdb 30/10/23 21:39:21| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:39:31| INFO: ref finished [took 8.5615s] 30/10/23 21:39:34| INFO: atc_mc finished [took 11.4156s] 30/10/23 21:39:34| INFO: atc_ne finished [took 11.4156s] 30/10/23 21:39:34| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.7024s] 30/10/23 21:39:35| ERROR: Configuration imdb_1prevs failed. Exception: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices ---------------------------------------------------------------------------------------------------- 30/10/23 21:40:51| INFO: dataset imdb 30/10/23 21:41:01| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:41:19| INFO: ref finished [took 16.7164s] 30/10/23 21:41:26| INFO: atc_mc finished [took 23.3181s] 30/10/23 21:41:26| INFO: atc_ne finished [took 23.4811s] 30/10/23 21:41:26| INFO: Dataset sample 0.50 of dataset imdb finished [took 24.9698s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:43:25| INFO: dataset imdb 30/10/23 21:43:35| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:43:53| INFO: ref finished [took 16.9333s] 30/10/23 21:44:00| INFO: atc_mc finished [took 23.4183s] 30/10/23 21:44:00| INFO: atc_ne finished [took 23.4274s] 30/10/23 21:44:00| INFO: Dataset sample 0.50 of dataset imdb finished [took 24.9308s] 30/10/23 21:44:19| ERROR: Configuration imdb_1prevs failed. Exception: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices ---------------------------------------------------------------------------------------------------- 30/10/23 21:45:16| INFO: dataset imdb 30/10/23 21:45:26| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:45:44| INFO: ref finished [took 17.6768s] 30/10/23 21:45:51| INFO: atc_mc finished [took 24.3756s] 30/10/23 21:45:52| INFO: atc_ne finished [took 24.5307s] 30/10/23 21:45:52| INFO: Dataset sample 0.50 of dataset imdb finished [took 25.8971s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:48:20| INFO: dataset imdb 30/10/23 21:48:27| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:48:36| INFO: ref finished [took 8.6456s] 30/10/23 21:48:39| INFO: atc_mc finished [took 11.2686s] 30/10/23 21:48:39| INFO: atc_ne finished [took 11.3112s] 30/10/23 21:48:39| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.5747s] 30/10/23 21:48:40| ERROR: Configuration imdb_1prevs failed. Exception: NDFrame.droplevel() got an unexpected keyword argument 'index' ---------------------------------------------------------------------------------------------------- 30/10/23 21:49:49| INFO: dataset imdb 30/10/23 21:49:55| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:50:05| INFO: ref finished [took 8.6556s] 30/10/23 21:50:08| INFO: atc_mc finished [took 11.6953s] 30/10/23 21:50:08| INFO: atc_ne finished [took 11.6000s] 30/10/23 21:50:08| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.8578s] 30/10/23 21:50:09| ERROR: Configuration imdb_1prevs failed. Exception: 'NoneType' object has no attribute 'groupby' ---------------------------------------------------------------------------------------------------- 30/10/23 21:50:57| INFO: dataset imdb 30/10/23 21:51:07| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:51:25| INFO: ref finished [took 17.0426s] 30/10/23 21:51:31| INFO: atc_mc finished [took 23.5734s] 30/10/23 21:51:31| INFO: atc_ne finished [took 23.5276s] 30/10/23 21:51:31| INFO: Dataset sample 0.50 of dataset imdb finished [took 24.8200s] ---------------------------------------------------------------------------------------------------- 30/10/23 21:55:21| INFO: dataset imdb 30/10/23 21:55:27| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:55:37| INFO: ref finished [took 8.8453s] 30/10/23 21:55:40| INFO: atc_mc finished [took 11.5585s] 30/10/23 21:55:40| INFO: atc_ne finished [took 11.5871s] 30/10/23 21:55:40| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.8416s] 30/10/23 21:55:41| ERROR: Configuration imdb_1prevs failed. Exception: 'DatasetReport' object has no attribute 'fit_scores' ---------------------------------------------------------------------------------------------------- 30/10/23 21:57:00| INFO: dataset imdb 30/10/23 21:57:06| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:57:16| INFO: ref finished [took 8.5540s] 30/10/23 21:57:19| INFO: atc_mc finished [took 11.4482s] 30/10/23 21:57:19| INFO: atc_ne finished [took 11.5399s] 30/10/23 21:57:19| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.7681s] 30/10/23 21:57:20| ERROR: Configuration imdb_1prevs failed. Exception: 'DatasetReport' object has no attribute 'fit_scores' ---------------------------------------------------------------------------------------------------- 30/10/23 21:57:38| INFO: dataset imdb 30/10/23 21:57:45| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 21:57:55| INFO: ref finished [took 8.7982s] 30/10/23 21:57:58| INFO: atc_mc finished [took 11.4787s] 30/10/23 21:57:58| INFO: atc_ne finished [took 11.5419s] 30/10/23 21:57:58| INFO: Dataset sample 0.50 of dataset imdb finished [took 12.8803s] ---------------------------------------------------------------------------------------------------- 30/10/23 22:00:05| INFO: dataset imdb 30/10/23 22:00:12| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 22:00:21| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:00:22| INFO: ref finished [took 10.0983s] 30/10/23 22:00:25| INFO: atc_mc finished [took 13.0928s] 30/10/23 22:00:26| INFO: atc_ne finished [took 13.1088s] 30/10/23 22:00:34| INFO: mul_sld finished [took 22.3228s] 30/10/23 22:00:34| INFO: Dataset sample 0.90 of dataset imdb finished [took 22.7020s] 30/10/23 22:00:34| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 22:00:46| INFO: ref finished [took 10.5937s] 30/10/23 22:00:49| INFO: atc_mc finished [took 13.5008s] 30/10/23 22:00:49| INFO: atc_ne finished [took 13.7521s] 30/10/23 22:01:00| INFO: mul_sld finished [took 25.0319s] 30/10/23 22:01:06| INFO: mul_sld_bcts finished [took 31.0525s] 30/10/23 22:01:06| INFO: Dataset sample 0.80 of dataset imdb finished [took 31.7700s] 30/10/23 22:01:06| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 22:01:17| INFO: ref finished [took 10.6316s] 30/10/23 22:01:21| INFO: atc_ne finished [took 14.1054s] 30/10/23 22:01:21| INFO: atc_mc finished [took 14.4357s] 30/10/23 22:01:33| INFO: mul_sld finished [took 26.6800s] 30/10/23 22:01:41| INFO: mul_sld_bcts finished [took 34.4745s] 30/10/23 22:01:41| INFO: Dataset sample 0.50 of dataset imdb finished [took 35.1450s] 30/10/23 22:01:41| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 22:01:53| INFO: ref finished [took 10.7413s] 30/10/23 22:01:56| INFO: atc_ne finished [took 13.5169s] 30/10/23 22:01:56| INFO: atc_mc finished [took 13.5849s] 30/10/23 22:02:11| INFO: mul_sld_bcts finished [took 29.3981s] 30/10/23 22:02:12| INFO: mul_sld finished [took 30.6705s] 30/10/23 22:02:12| INFO: Dataset sample 0.20 of dataset imdb finished [took 31.2089s] 30/10/23 22:02:12| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 22:02:22| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:02:24| INFO: ref finished [took 10.3435s] 30/10/23 22:02:26| INFO: atc_mc finished [took 13.0763s] 30/10/23 22:02:27| INFO: atc_ne finished [took 13.2013s] 30/10/23 22:02:32| INFO: mul_sld finished [took 19.2237s] 30/10/23 22:02:32| INFO: Dataset sample 0.10 of dataset imdb finished [took 19.7097s] ---------------------------------------------------------------------------------------------------- 30/10/23 22:07:59| INFO: dataset imdb 30/10/23 22:08:07| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 22:08:10| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:08:11| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:08:11| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:08:11| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 22:08:18| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:08:20| INFO: ref finished [took 11.3765s] 30/10/23 22:08:23| INFO: atc_mc finished [took 14.2141s] 30/10/23 22:08:23| INFO: atc_ne finished [took 14.0568s] 30/10/23 22:08:31| INFO: mul_sld finished [took 23.9496s] 30/10/23 22:08:31| INFO: Dataset sample 0.90 of dataset imdb finished [took 24.5121s] 30/10/23 22:08:31| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 22:08:48| INFO: ref finished [took 14.8939s] 30/10/23 22:08:52| INFO: atc_mc finished [took 18.5014s] 30/10/23 22:08:52| INFO: atc_ne finished [took 18.4609s] 30/10/23 22:09:05| INFO: mul_sld finished [took 32.9898s] 30/10/23 22:09:12| INFO: mul_sld_bcts finished [took 39.3492s] 30/10/23 22:11:48| INFO: bin_sld_bcts finished [took 195.8293s] 30/10/23 22:11:49| INFO: bin_sld finished [took 196.6861s] 30/10/23 22:12:44| INFO: mul_sld_gs finished [took 250.9835s] 30/10/23 22:16:16| INFO: bin_sld_gs finished [took 462.9748s] 30/10/23 22:16:16| INFO: Dataset sample 0.80 of dataset imdb finished [took 464.4318s] 30/10/23 22:16:16| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 22:16:33| INFO: ref finished [took 15.2921s] 30/10/23 22:16:37| INFO: atc_mc finished [took 18.9592s] 30/10/23 22:16:37| INFO: atc_ne finished [took 19.1317s] 30/10/23 22:16:50| INFO: mul_sld finished [took 33.4304s] 30/10/23 22:16:59| INFO: mul_sld_bcts finished [took 42.3496s] 30/10/23 22:19:33| INFO: bin_sld finished [took 196.1571s] 30/10/23 22:19:36| INFO: bin_sld_bcts finished [took 199.7857s] 30/10/23 22:20:39| INFO: mul_sld_gs finished [took 261.6674s] 30/10/23 22:23:46| INFO: bin_sld_gs finished [took 449.3788s] 30/10/23 22:23:46| INFO: Dataset sample 0.50 of dataset imdb finished [took 450.7045s] 30/10/23 22:23:46| INFO: Dataset sample 0.20 of dataset imdb started 30/10/23 22:24:05| INFO: ref finished [took 16.4122s] 30/10/23 22:24:09| INFO: atc_mc finished [took 20.4920s] 30/10/23 22:24:09| INFO: atc_ne finished [took 20.3723s] 30/10/23 22:24:28| INFO: mul_sld_bcts finished [took 40.3400s] 30/10/23 22:24:30| INFO: mul_sld finished [took 43.2311s] 30/10/23 22:27:16| INFO: bin_sld_bcts finished [took 208.6113s] 30/10/23 22:27:21| INFO: bin_sld finished [took 214.1596s] 30/10/23 22:28:17| INFO: mul_sld_gs finished [took 269.1075s] 30/10/23 22:34:19| INFO: bin_sld_gs finished [took 630.9727s] 30/10/23 22:34:19| INFO: Dataset sample 0.20 of dataset imdb finished [took 632.2728s] 30/10/23 22:34:19| INFO: Dataset sample 0.10 of dataset imdb started 30/10/23 22:34:23| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 22:34:23| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 30/10/23 22:34:26| WARNING: Method bin_sld_bcts failed. Exception: Cannot have number of splits n_splits=5 greater than the number of samples: n_samples=4. 30/10/23 22:34:31| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:34:34| INFO: ref finished [took 13.7988s] 30/10/23 22:34:37| INFO: atc_mc finished [took 16.7490s] 30/10/23 22:34:38| INFO: atc_ne finished [took 16.7307s] 30/10/23 22:34:43| INFO: mul_sld finished [took 23.6079s] 30/10/23 22:36:42| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 30/10/23 22:36:42| INFO: Dataset sample 0.10 of dataset imdb finished [took 143.1097s] ---------------------------------------------------------------------------------------------------- 30/10/23 22:49:25| INFO: dataset imdb 30/10/23 22:49:37| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 22:49:42| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 22:49:43| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:49:43| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:49:43| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:49:51| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:50:02| INFO: ref finished [took 22.5398s] 30/10/23 22:50:09| INFO: atc_mc finished [took 29.3095s] 30/10/23 22:50:09| INFO: atc_ne finished [took 29.2984s] 30/10/23 22:50:16| INFO: mul_sld finished [took 37.6287s] 30/10/23 22:50:16| INFO: Dataset sample 0.90 of dataset imdb finished [took 38.3452s] ---------------------------------------------------------------------------------------------------- 30/10/23 22:53:57| INFO: dataset imdb 30/10/23 22:54:09| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 22:54:13| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 22:54:14| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:54:15| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:54:15| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 22:54:22| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 22:54:33| INFO: ref finished [took 22.4225s] 30/10/23 22:54:40| INFO: atc_ne finished [took 29.0085s] 30/10/23 22:54:41| INFO: atc_mc finished [took 29.6620s] 30/10/23 22:54:48| INFO: mul_sld finished [took 37.9580s] 30/10/23 22:54:48| INFO: Dataset sample 0.90 of dataset imdb finished [took 38.6632s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:02:33| INFO: dataset imdb 30/10/23 23:02:45| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 23:02:50| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 23:02:51| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:02:52| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:02:52| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:02:59| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 23:03:10| INFO: ref finished [took 23.4021s] 30/10/23 23:03:17| INFO: atc_mc finished [took 30.1849s] 30/10/23 23:03:18| INFO: atc_ne finished [took 30.4116s] 30/10/23 23:03:25| INFO: mul_sld finished [took 38.6513s] 30/10/23 23:03:25| INFO: Dataset sample 0.90 of dataset imdb finished [took 39.3497s] 30/10/23 23:07:32| INFO: Dataset sample 0.80 of dataset imdb started ---------------------------------------------------------------------------------------------------- 30/10/23 23:08:15| INFO: dataset imdb 30/10/23 23:08:26| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:08:51| INFO: ref finished [took 23.6855s] 30/10/23 23:08:59| INFO: atc_mc finished [took 31.1520s] 30/10/23 23:08:59| INFO: atc_ne finished [took 31.1659s] 30/10/23 23:09:10| INFO: mul_sld finished [took 42.2066s] 30/10/23 23:09:21| INFO: mul_sld_bcts finished [took 52.9631s] 30/10/23 23:09:21| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.5286s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:14:11| INFO: dataset imdb 30/10/23 23:14:22| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:14:47| INFO: ref finished [took 22.8152s] 30/10/23 23:14:55| INFO: atc_mc finished [took 31.2100s] 30/10/23 23:14:55| INFO: atc_ne finished [took 31.2325s] 30/10/23 23:15:06| INFO: mul_sld finished [took 42.5389s] 30/10/23 23:15:16| INFO: mul_sld_bcts finished [took 52.7119s] 30/10/23 23:15:16| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.2106s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:16:16| INFO: dataset imdb 30/10/23 23:16:27| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:16:51| INFO: ref finished [took 22.6482s] 30/10/23 23:17:00| INFO: atc_ne finished [took 30.5701s] 30/10/23 23:17:00| INFO: atc_mc finished [took 30.9988s] 30/10/23 23:17:10| INFO: mul_sld finished [took 41.9572s] 30/10/23 23:17:21| INFO: mul_sld_bcts finished [took 52.6091s] 30/10/23 23:17:21| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.1182s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:20:27| INFO: dataset imdb 30/10/23 23:20:38| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:21:02| INFO: ref finished [took 22.7779s] 30/10/23 23:21:10| INFO: atc_mc finished [took 30.4191s] 30/10/23 23:21:10| INFO: atc_ne finished [took 30.8097s] 30/10/23 23:21:20| INFO: mul_sld finished [took 41.5927s] 30/10/23 23:21:32| INFO: mul_sld_bcts finished [took 52.6374s] 30/10/23 23:21:32| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.1125s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:24:11| INFO: dataset imdb 30/10/23 23:24:22| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:24:46| INFO: ref finished [took 23.2007s] 30/10/23 23:24:54| INFO: atc_ne finished [took 30.9437s] 30/10/23 23:24:55| INFO: atc_mc finished [took 31.6008s] 30/10/23 23:25:05| INFO: mul_sld finished [took 42.0673s] 30/10/23 23:25:16| INFO: mul_sld_bcts finished [took 52.6228s] 30/10/23 23:25:16| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.0611s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:33:01| INFO: dataset imdb 30/10/23 23:33:11| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:33:36| INFO: ref finished [took 22.9215s] 30/10/23 23:33:44| INFO: atc_mc finished [took 30.5897s] 30/10/23 23:33:44| INFO: atc_ne finished [took 30.4788s] 30/10/23 23:33:55| INFO: mul_sld finished [took 42.0598s] 30/10/23 23:34:05| INFO: mul_sld_bcts finished [took 52.1772s] 30/10/23 23:34:05| INFO: Dataset sample 0.50 of dataset imdb finished [took 53.6878s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:38:11| INFO: dataset imdb 30/10/23 23:38:22| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:38:47| INFO: ref finished [took 22.8046s] 30/10/23 23:38:56| INFO: atc_mc finished [took 31.5660s] 30/10/23 23:38:56| INFO: atc_ne finished [took 31.5269s] 30/10/23 23:39:06| INFO: mul_sld finished [took 42.2553s] 30/10/23 23:39:16| INFO: mul_sld_bcts finished [took 52.2602s] 30/10/23 23:39:16| INFO: Dataset sample 0.50 of dataset imdb finished [took 53.7890s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:46:40| INFO: dataset imdb 30/10/23 23:46:51| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:47:16| INFO: ref finished [took 22.8069s] 30/10/23 23:47:24| INFO: atc_mc finished [took 30.7916s] 30/10/23 23:47:24| INFO: atc_ne finished [took 30.8668s] 30/10/23 23:47:35| INFO: mul_sld finished [took 42.2809s] 30/10/23 23:47:45| INFO: mul_sld_bcts finished [took 52.5498s] 30/10/23 23:47:45| INFO: Dataset sample 0.50 of dataset imdb finished [took 54.0424s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:50:43| INFO: dataset imdb 30/10/23 23:50:50| INFO: Dataset sample 0.50 of dataset imdb started 30/10/23 23:51:04| INFO: ref finished [took 12.0863s] 30/10/23 23:51:07| INFO: atc_ne finished [took 15.0218s] 30/10/23 23:51:08| INFO: atc_mc finished [took 15.7900s] 30/10/23 23:51:20| INFO: mul_sld finished [took 28.7221s] 30/10/23 23:51:31| INFO: mul_sld_bcts finished [took 39.4698s] 30/10/23 23:51:31| INFO: Dataset sample 0.50 of dataset imdb finished [took 40.8506s] ---------------------------------------------------------------------------------------------------- 30/10/23 23:52:29| INFO: dataset imdb 30/10/23 23:52:37| INFO: Dataset sample 0.90 of dataset imdb started 30/10/23 23:52:40| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:52:41| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:52:41| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 30/10/23 23:52:41| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 30/10/23 23:52:48| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 30/10/23 23:52:50| INFO: ref finished [took 12.4800s] 30/10/23 23:52:53| INFO: atc_mc finished [took 15.1770s] 30/10/23 23:52:54| INFO: atc_ne finished [took 15.2184s] 30/10/23 23:53:02| INFO: mul_sld finished [took 24.9402s] 30/10/23 23:53:02| INFO: Dataset sample 0.90 of dataset imdb finished [took 25.4588s] 30/10/23 23:53:02| INFO: Dataset sample 0.80 of dataset imdb started 30/10/23 23:53:20| INFO: ref finished [took 16.3699s] 30/10/23 23:53:25| INFO: atc_ne finished [took 20.5069s] 30/10/23 23:53:25| INFO: atc_mc finished [took 20.7398s] 30/10/23 23:53:38| INFO: mul_sld finished [took 35.3572s] 30/10/23 23:53:45| INFO: mul_sld_bcts finished [took 41.8712s] 30/10/23 23:56:35| INFO: bin_sld finished [took 212.1758s] 30/10/23 23:56:36| INFO: bin_sld_bcts finished [took 213.3641s] 30/10/23 23:57:38| INFO: mul_sld_gs finished [took 274.6360s] 31/10/23 00:01:13| INFO: bin_sld_gs finished [took 490.0221s] 31/10/23 00:01:13| INFO: Dataset sample 0.80 of dataset imdb finished [took 491.4099s] 31/10/23 00:01:13| INFO: Dataset sample 0.50 of dataset imdb started 31/10/23 00:01:32| INFO: ref finished [took 17.1003s] 31/10/23 00:01:37| INFO: atc_ne finished [took 21.2159s] 31/10/23 00:01:37| INFO: atc_mc finished [took 21.6794s] 31/10/23 00:01:51| INFO: mul_sld finished [took 37.3507s] 31/10/23 00:02:01| INFO: mul_sld_bcts finished [took 46.7227s] 31/10/23 00:04:46| INFO: bin_sld finished [took 211.9902s] 31/10/23 00:04:48| INFO: bin_sld_bcts finished [took 213.3398s] 31/10/23 00:05:55| INFO: mul_sld_gs finished [took 279.4401s] 31/10/23 00:08:56| INFO: bin_sld_gs finished [took 461.6571s] 31/10/23 00:08:56| INFO: Dataset sample 0.50 of dataset imdb finished [took 462.8616s] 31/10/23 00:08:56| INFO: Dataset sample 0.20 of dataset imdb started 31/10/23 00:09:15| INFO: ref finished [took 17.3643s] 31/10/23 00:09:20| INFO: atc_mc finished [took 21.0373s] 31/10/23 00:09:20| INFO: atc_ne finished [took 21.2599s] 31/10/23 00:09:38| INFO: mul_sld_bcts finished [took 41.0473s] 31/10/23 00:09:41| INFO: mul_sld finished [took 43.7800s] 31/10/23 00:12:30| INFO: bin_sld_bcts finished [took 212.8639s] 31/10/23 00:12:32| INFO: bin_sld finished [took 215.5704s] 31/10/23 00:13:29| INFO: mul_sld_gs finished [took 270.7454s] 31/10/23 00:19:19| INFO: bin_sld_gs finished [took 621.7089s] 31/10/23 00:19:19| INFO: Dataset sample 0.20 of dataset imdb finished [took 623.1501s] 31/10/23 00:19:19| INFO: Dataset sample 0.10 of dataset imdb started 31/10/23 00:19:24| WARNING: Method mul_sld_gs failed. Exception: a must be greater than 0 unless no samples are taken 31/10/23 00:19:24| WARNING: Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 31/10/23 00:19:26| WARNING: Method bin_sld_bcts failed. Exception: Cannot have number of splits n_splits=5 greater than the number of samples: n_samples=4. 31/10/23 00:19:31| WARNING: Method mul_sld_bcts failed. Exception: index 3 is out of bounds for axis 0 with size 3 31/10/23 00:19:35| INFO: ref finished [took 13.7926s] 31/10/23 00:19:38| INFO: atc_mc finished [took 16.8128s] 31/10/23 00:19:39| INFO: atc_ne finished [took 16.9032s] 31/10/23 00:19:44| INFO: mul_sld finished [took 23.7188s] 31/10/23 00:21:43| WARNING: Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 31/10/23 00:21:43| INFO: Dataset sample 0.10 of dataset imdb finished [took 143.1001s] ---------------------------------------------------------------------------------------------------- 31/10/23 01:36:56| INFO: dataset imdb 31/10/23 01:37:04| INFO: Dataset sample 0.90 of dataset imdb started 31/10/23 01:37:13| WARNING: Method bin_sld_bcts failed. Exception: fun: nan hess_inv: <3x3 LbfgsInvHessProduct with dtype=float64> jac: array([ 1.06687127, -0.00373246, 0.00373246]) message: 'ABNORMAL_TERMINATION_IN_LNSRCH' nfev: 53 nit: 34 njev: 53 status: 2 success: False x: array([ 0.11536329, -12.93833991, 12.93833991]) 31/10/23 01:37:24| INFO: ref finished [took 15.9844s] 31/10/23 01:37:28| INFO: atc_mc finished [took 19.7000s] 31/10/23 01:37:28| INFO: atc_ne finished [took 19.4612s] 31/10/23 01:37:39| INFO: mul_sld finished [took 33.2999s] 31/10/23 01:37:49| INFO: mul_sld_bcts finished [took 43.1402s] 31/10/23 01:40:23| INFO: bin_sld finished [took 197.7518s] 31/10/23 01:41:23| INFO: mul_sld_gs finished [took 256.4496s] 31/10/23 01:42:49| INFO: bin_sld_gs finished [took 342.7515s] 31/10/23 01:42:49| INFO: Dataset sample 0.90 of dataset imdb finished [took 344.8637s] 31/10/23 01:42:49| INFO: Dataset sample 0.50 of dataset imdb started 31/10/23 01:43:10| INFO: ref finished [took 17.6503s] 31/10/23 01:43:15| INFO: atc_mc finished [took 21.9510s] 31/10/23 01:43:15| INFO: atc_ne finished [took 21.5680s] 31/10/23 01:43:29| INFO: mul_sld finished [took 38.2515s] 31/10/23 01:43:41| INFO: mul_sld_bcts finished [took 48.9560s] 31/10/23 01:46:29| INFO: bin_sld_bcts finished [took 217.8464s] 31/10/23 01:46:29| INFO: bin_sld finished [took 218.6211s] 31/10/23 01:47:51| INFO: mul_sld_gs finished [took 298.6694s] 31/10/23 01:50:25| INFO: bin_sld_gs finished [took 452.8300s] 31/10/23 01:50:25| INFO: Dataset sample 0.50 of dataset imdb finished [took 455.3596s] 31/10/23 01:50:28| ERROR: Configuration imdb_2prevs failed. Exception: could not broadcast input array from shape (2100,7) into shape (2100,) ---------------------------------------------------------------------------------------------------- 31/10/23 02:13:21| INFO: dataset imdb 31/10/23 02:13:29| INFO: Dataset sample 0.90 of dataset imdb started 31/10/23 02:13:37| WARNING: Method bin_sld_bcts failed. Exception: fun: nan hess_inv: <3x3 LbfgsInvHessProduct with dtype=float64> jac: array([ 1.06687127, -0.00373246, 0.00373246]) message: 'ABNORMAL_TERMINATION_IN_LNSRCH' nfev: 53 nit: 34 njev: 53 status: 2 success: False x: array([ 0.11536329, -12.93833991, 12.93833991]) 31/10/23 02:13:48| INFO: ref finished [took 16.5509s] 31/10/23 02:13:52| INFO: atc_mc finished [took 20.3138s] 31/10/23 02:13:52| INFO: atc_ne finished [took 20.1191s] 31/10/23 02:14:02| INFO: mul_sld finished [took 32.5158s] 31/10/23 02:14:12| INFO: mul_sld_bcts finished [took 42.0654s] 31/10/23 02:16:44| INFO: bin_sld finished [took 193.9189s] 31/10/23 02:17:44| INFO: mul_sld_gs finished [took 252.9066s] 31/10/23 02:19:11| INFO: bin_sld_gs finished [took 339.9813s] 31/10/23 02:19:11| INFO: Dataset sample 0.90 of dataset imdb finished [took 341.6967s] 31/10/23 02:19:11| INFO: Dataset sample 0.50 of dataset imdb started 31/10/23 02:19:30| INFO: ref finished [took 16.1334s] 31/10/23 02:19:35| INFO: atc_mc finished [took 20.5691s] 31/10/23 02:19:35| INFO: atc_ne finished [took 20.0126s] 31/10/23 02:19:49| INFO: mul_sld finished [took 36.4597s] 31/10/23 02:20:02| INFO: mul_sld_bcts finished [took 48.7131s] 31/10/23 02:22:38| INFO: bin_sld finished [took 205.8577s] 31/10/23 02:22:41| INFO: bin_sld_bcts finished [took 208.1999s] 31/10/23 02:23:58| INFO: mul_sld_gs finished [took 284.9247s] 31/10/23 02:26:26| INFO: bin_sld_gs finished [took 432.5665s] 31/10/23 02:26:26| INFO: Dataset sample 0.50 of dataset imdb finished [took 435.0679s] ---------------------------------------------------------------------------------------------------- 31/10/23 03:05:44| INFO: dataset rcv1_CCAT 31/10/23 03:05:49| INFO: Dataset sample 0.90 of dataset rcv1_CCAT started 31/10/23 03:06:59| INFO: kfcv finished [took 59.0143s] 31/10/23 03:06:59| INFO: ref finished [took 56.9074s] 31/10/23 03:07:03| INFO: doc_feat finished [took 49.0683s] 31/10/23 03:07:05| INFO: atc_mc finished [took 59.3988s] 31/10/23 03:07:07| INFO: atc_ne finished [took 58.0283s] 31/10/23 03:07:09| INFO: mul_sld finished [took 76.8284s] 31/10/23 03:07:19| INFO: mul_sld_bcts finished [took 84.0129s] 31/10/23 03:09:51| INFO: bin_sld_bcts finished [took 237.9395s] 31/10/23 03:09:53| INFO: bin_sld finished [took 242.1415s] 31/10/23 03:10:13| INFO: mul_sld_gs finished [took 255.3743s] 31/10/23 03:13:59| INFO: bin_sld_gs finished [took 483.0217s] 31/10/23 03:13:59| INFO: Dataset sample 0.90 of dataset rcv1_CCAT finished [took 489.9328s] 31/10/23 03:13:59| INFO: Dataset sample 0.80 of dataset rcv1_CCAT started 31/10/23 03:15:04| INFO: ref finished [took 53.0703s] 31/10/23 03:15:05| INFO: kfcv finished [took 55.9779s] 31/10/23 03:15:05| INFO: doc_feat finished [took 48.1315s] 31/10/23 03:15:10| INFO: atc_mc finished [took 56.8062s] 31/10/23 03:15:11| INFO: atc_ne finished [took 55.9933s] 31/10/23 03:15:20| INFO: mul_sld finished [took 77.2840s] 31/10/23 03:15:25| INFO: mul_sld_bcts finished [took 80.0502s] 31/10/23 03:17:55| INFO: bin_sld finished [took 233.0173s] 31/10/23 03:17:55| INFO: bin_sld_bcts finished [took 231.2358s] 31/10/23 03:18:59| INFO: mul_sld_gs finished [took 291.7573s] 31/10/23 03:21:50| INFO: bin_sld_gs finished [took 463.8743s] 31/10/23 03:21:50| INFO: Dataset sample 0.80 of dataset rcv1_CCAT finished [took 470.4706s] 31/10/23 03:21:50| INFO: Dataset sample 0.70 of dataset rcv1_CCAT started 31/10/23 03:22:52| INFO: doc_feat finished [took 46.9563s] 31/10/23 03:22:53| INFO: ref finished [took 52.8185s] 31/10/23 03:22:54| INFO: kfcv finished [took 55.3202s] 31/10/23 03:22:57| INFO: atc_mc finished [took 55.1482s] 31/10/23 03:22:58| INFO: atc_ne finished [took 54.7420s] 31/10/23 03:23:09| INFO: mul_sld finished [took 76.8111s] 31/10/23 03:23:14| INFO: mul_sld_bcts finished [took 80.0460s] 31/10/23 03:25:43| INFO: bin_sld finished [took 231.7146s] 31/10/23 03:25:44| INFO: bin_sld_bcts finished [took 230.9954s] 31/10/23 03:26:53| INFO: mul_sld_gs finished [took 296.5824s] 31/10/23 03:29:12| INFO: bin_sld_gs finished [took 437.2666s] 31/10/23 03:29:12| INFO: Dataset sample 0.70 of dataset rcv1_CCAT finished [took 442.6584s] 31/10/23 03:29:12| INFO: Dataset sample 0.60 of dataset rcv1_CCAT started 31/10/23 03:30:14| INFO: doc_feat finished [took 47.2841s] 31/10/23 03:30:15| INFO: ref finished [took 52.5819s] 31/10/23 03:30:16| INFO: kfcv finished [took 54.9735s] 31/10/23 03:30:19| INFO: atc_mc finished [took 55.5994s] 31/10/23 03:30:20| INFO: atc_ne finished [took 55.0062s] 31/10/23 03:30:30| INFO: mul_sld finished [took 75.3263s] 31/10/23 03:30:37| INFO: mul_sld_bcts finished [took 80.4052s] 31/10/23 03:33:04| INFO: bin_sld finished [took 229.9416s] 31/10/23 03:33:05| INFO: bin_sld_bcts finished [took 229.0971s] 31/10/23 03:34:12| INFO: mul_sld_gs finished [took 292.9916s] 31/10/23 03:37:15| INFO: bin_sld_gs finished [took 477.2157s] 31/10/23 03:37:15| INFO: Dataset sample 0.60 of dataset rcv1_CCAT finished [took 482.5150s] 31/10/23 03:37:15| INFO: Dataset sample 0.50 of dataset rcv1_CCAT started 31/10/23 03:38:17| INFO: doc_feat finished [took 47.6798s] 31/10/23 03:38:17| INFO: ref finished [took 52.2283s] 31/10/23 03:38:18| INFO: kfcv finished [took 54.3535s] 31/10/23 03:38:22| INFO: atc_mc finished [took 55.4316s] 31/10/23 03:38:23| INFO: atc_ne finished [took 55.3697s] 31/10/23 03:38:32| INFO: mul_sld finished [took 74.3762s] 31/10/23 03:38:39| INFO: mul_sld_bcts finished [took 79.7216s] 31/10/23 03:41:05| INFO: bin_sld finished [took 228.4963s] 31/10/23 03:41:08| INFO: bin_sld_bcts finished [took 230.0901s] 31/10/23 03:42:09| INFO: mul_sld_gs finished [took 287.8477s] 31/10/23 03:45:08| INFO: bin_sld_gs finished [took 467.2633s] 31/10/23 03:45:08| INFO: Dataset sample 0.50 of dataset rcv1_CCAT finished [took 472.6090s] 31/10/23 03:45:08| INFO: Dataset sample 0.40 of dataset rcv1_CCAT started 31/10/23 03:46:08| INFO: doc_feat finished [took 47.0674s] 31/10/23 03:46:09| INFO: ref finished [took 51.5844s] 31/10/23 03:46:09| INFO: kfcv finished [took 53.6481s] 31/10/23 03:46:14| INFO: atc_mc finished [took 55.3679s] 31/10/23 03:46:14| INFO: atc_ne finished [took 54.6174s] 31/10/23 03:46:21| INFO: mul_sld finished [took 71.5925s] 31/10/23 03:46:29| INFO: mul_sld_bcts finished [took 77.5938s] 31/10/23 03:48:55| INFO: bin_sld finished [took 226.3217s] 31/10/23 03:48:57| INFO: bin_sld_bcts finished [took 226.5561s] 31/10/23 03:50:04| INFO: mul_sld_gs finished [took 289.8958s] 31/10/23 03:53:13| INFO: bin_sld_gs finished [took 479.9650s] 31/10/23 03:53:13| INFO: Dataset sample 0.40 of dataset rcv1_CCAT finished [took 485.0438s] 31/10/23 03:53:13| INFO: Dataset sample 0.30 of dataset rcv1_CCAT started 31/10/23 03:54:15| INFO: doc_feat finished [took 47.1959s] 31/10/23 03:54:16| INFO: ref finished [took 52.7452s] 31/10/23 03:54:17| INFO: kfcv finished [took 55.3715s] 31/10/23 03:54:20| INFO: atc_mc finished [took 55.5749s] 31/10/23 03:54:21| INFO: atc_ne finished [took 54.8719s] 31/10/23 03:54:29| INFO: mul_sld finished [took 74.1932s] 31/10/23 03:54:37| INFO: mul_sld_bcts finished [took 80.1150s] 31/10/23 03:57:01| INFO: bin_sld finished [took 227.2338s] 31/10/23 03:57:06| INFO: bin_sld_bcts finished [took 229.7342s] 31/10/23 03:58:13| INFO: mul_sld_gs finished [took 293.4750s] 31/10/23 04:00:50| INFO: bin_sld_gs finished [took 451.3322s] 31/10/23 04:00:50| INFO: Dataset sample 0.30 of dataset rcv1_CCAT finished [took 456.9583s] 31/10/23 04:00:50| INFO: Dataset sample 0.20 of dataset rcv1_CCAT started 31/10/23 04:01:54| INFO: doc_feat finished [took 48.9670s] 31/10/23 04:01:54| INFO: ref finished [took 54.3281s] 31/10/23 04:01:55| INFO: kfcv finished [took 57.0798s] 31/10/23 04:01:59| INFO: atc_mc finished [took 57.5663s] 31/10/23 04:02:00| INFO: atc_ne finished [took 57.1756s] 31/10/23 04:02:07| INFO: mul_sld finished [took 74.8552s] 31/10/23 04:02:14| INFO: mul_sld_bcts finished [took 79.8097s] 31/10/23 04:04:43| INFO: bin_sld finished [took 231.6926s] 31/10/23 04:04:43| INFO: bin_sld_bcts finished [took 229.9267s] 31/10/23 04:05:23| INFO: mul_sld_gs finished [took 266.8226s] 31/10/23 04:08:36| INFO: bin_sld_gs finished [took 460.9384s] 31/10/23 04:08:36| INFO: Dataset sample 0.20 of dataset rcv1_CCAT finished [took 466.5653s] 31/10/23 04:08:36| INFO: Dataset sample 0.10 of dataset rcv1_CCAT started 31/10/23 04:08:46| WARNING: Method mul_sld_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 31/10/23 04:08:46| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 31/10/23 04:08:55| WARNING: Method mul_sld_bcts failed. Exception: fun: nan hess_inv: <5x5 LbfgsInvHessProduct with dtype=float64> jac: array([nan, nan, nan, nan, nan]) message: 'ABNORMAL_TERMINATION_IN_LNSRCH' nfev: 21 nit: 0 njev: 21 status: 2 success: False x: array([1., 0., 0., 0., 0.]) 31/10/23 04:09:33| INFO: doc_feat finished [took 42.6167s] 31/10/23 04:09:33| INFO: ref finished [took 46.6961s] 31/10/23 04:09:33| INFO: kfcv finished [took 48.7570s] 31/10/23 04:09:37| INFO: atc_mc finished [took 49.6198s] 31/10/23 04:09:38| INFO: atc_ne finished [took 49.1195s] 31/10/23 04:09:42| INFO: mul_sld finished [took 63.1364s] 31/10/23 04:11:02| WARNING: Method bin_sld_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 31/10/23 04:12:05| INFO: bin_sld finished [took 207.4063s] 31/10/23 04:12:05| INFO: Dataset sample 0.10 of dataset rcv1_CCAT finished [took 208.7423s] 31/10/23 04:12:16| ERROR: Configuration rcv1_CCAT_9prevs failed. Exception: 'DatasetReport' object has no attribute 'fit_scores' ---------------------------------------------------------------------------------------------------- 31/10/23 11:30:20| INFO: dataset rcv1_CCAT 31/10/23 11:30:26| INFO: Dataset sample 0.90 of dataset rcv1_CCAT started 31/10/23 11:31:32| INFO: doc_feat finished [took 48.1486s] 31/10/23 11:31:32| INFO: ref finished [took 53.9235s] 31/10/23 11:31:33| INFO: kfcv finished [took 56.4175s] 31/10/23 11:31:37| INFO: atc_mc finished [took 57.2963s] 31/10/23 11:31:39| INFO: atc_ne finished [took 56.1470s] 31/10/23 11:31:43| INFO: mul_sld finished [took 74.0703s] 31/10/23 11:31:50| INFO: mul_sld_bcts finished [took 78.8253s] 31/10/23 11:34:16| INFO: bin_sld_bcts finished [took 225.7409s] 31/10/23 11:34:18| INFO: bin_sld finished [took 229.9705s] 31/10/23 11:34:42| INFO: mul_sld_gs finished [took 247.4756s] 31/10/23 11:38:30| INFO: bin_sld_gs finished [took 477.2173s] 31/10/23 11:38:30| INFO: Dataset sample 0.90 of dataset rcv1_CCAT finished [took 483.7632s] 31/10/23 11:38:30| INFO: Dataset sample 0.80 of dataset rcv1_CCAT started 31/10/23 11:39:32| INFO: doc_feat finished [took 47.0343s] 31/10/23 11:39:33| INFO: ref finished [took 52.5674s] 31/10/23 11:39:33| INFO: kfcv finished [took 54.5521s] 31/10/23 11:39:38| INFO: atc_mc finished [took 55.5394s] 31/10/23 11:39:38| INFO: atc_ne finished [took 54.9616s] 31/10/23 11:39:48| INFO: mul_sld finished [took 75.9068s] 31/10/23 11:39:53| INFO: mul_sld_bcts finished [took 78.1581s] 31/10/23 11:42:22| INFO: bin_sld finished [took 230.5536s] 31/10/23 11:42:23| INFO: bin_sld_bcts finished [took 229.2262s] 31/10/23 11:43:29| INFO: mul_sld_gs finished [took 291.7013s] 31/10/23 11:46:14| INFO: bin_sld_gs finished [took 457.9059s] 31/10/23 11:46:14| INFO: Dataset sample 0.80 of dataset rcv1_CCAT finished [took 463.5174s] 31/10/23 11:46:14| INFO: Dataset sample 0.70 of dataset rcv1_CCAT started 31/10/23 11:47:17| INFO: doc_feat finished [took 46.4490s] 31/10/23 11:47:17| INFO: ref finished [took 52.6852s] 31/10/23 11:47:17| INFO: kfcv finished [took 55.0158s] 31/10/23 11:47:21| INFO: atc_mc finished [took 55.4861s] 31/10/23 11:47:22| INFO: atc_ne finished [took 54.9236s] 31/10/23 11:47:32| INFO: mul_sld finished [took 75.5717s] 31/10/23 11:47:38| INFO: mul_sld_bcts finished [took 80.0893s] 31/10/23 11:50:02| INFO: bin_sld finished [took 226.8402s] 31/10/23 11:50:05| INFO: bin_sld_bcts finished [took 227.7311s] 31/10/23 11:51:15| INFO: mul_sld_gs finished [took 294.0087s] 31/10/23 11:53:36| INFO: bin_sld_gs finished [took 436.3031s] 31/10/23 11:53:36| INFO: Dataset sample 0.70 of dataset rcv1_CCAT finished [took 441.8200s] 31/10/23 11:53:36| INFO: Dataset sample 0.60 of dataset rcv1_CCAT started 31/10/23 11:54:37| INFO: doc_feat finished [took 47.1550s] 31/10/23 11:54:38| INFO: ref finished [took 52.2980s] 31/10/23 11:54:39| INFO: kfcv finished [took 54.5489s] 31/10/23 11:54:42| INFO: atc_mc finished [took 55.2076s] 31/10/23 11:54:43| INFO: atc_ne finished [took 54.6137s] 31/10/23 11:54:53| INFO: mul_sld finished [took 74.8407s] 31/10/23 11:54:59| INFO: mul_sld_bcts finished [took 79.4977s] 31/10/23 11:57:24| INFO: bin_sld finished [took 226.9209s] 31/10/23 11:57:26| INFO: bin_sld_bcts finished [took 227.3112s] 31/10/23 11:58:29| INFO: mul_sld_gs finished [took 286.1947s] 31/10/23 12:01:41| INFO: bin_sld_gs finished [took 479.8610s] 31/10/23 12:01:41| INFO: Dataset sample 0.60 of dataset rcv1_CCAT finished [took 485.3472s] 31/10/23 12:01:41| INFO: Dataset sample 0.50 of dataset rcv1_CCAT started 31/10/23 12:02:42| INFO: doc_feat finished [took 46.7340s] 31/10/23 12:02:42| INFO: ref finished [took 51.5482s] 31/10/23 12:02:43| INFO: kfcv finished [took 53.9559s] 31/10/23 12:02:47| INFO: atc_mc finished [took 54.7558s] 31/10/23 12:02:48| INFO: atc_ne finished [took 54.5216s] 31/10/23 12:02:57| INFO: mul_sld finished [took 73.4013s] 31/10/23 12:03:04| INFO: mul_sld_bcts finished [took 78.9197s] 31/10/23 12:05:30| INFO: bin_sld finished [took 227.3887s] 31/10/23 12:05:31| INFO: bin_sld_bcts finished [took 226.6540s] 31/10/23 12:06:37| INFO: mul_sld_gs finished [took 289.2631s] 31/10/23 12:09:30| INFO: bin_sld_gs finished [took 463.2754s] 31/10/23 12:09:30| INFO: Dataset sample 0.50 of dataset rcv1_CCAT finished [took 468.6356s] 31/10/23 12:09:30| INFO: Dataset sample 0.40 of dataset rcv1_CCAT started 31/10/23 12:10:30| INFO: doc_feat finished [took 47.0178s] 31/10/23 12:10:31| INFO: ref finished [took 51.8808s] 31/10/23 12:10:31| INFO: kfcv finished [took 53.6165s] 31/10/23 12:10:36| INFO: atc_mc finished [took 55.8052s] 31/10/23 12:10:36| INFO: atc_ne finished [took 55.0541s] 31/10/23 12:10:44| INFO: mul_sld finished [took 72.1431s] 31/10/23 12:10:52| INFO: mul_sld_bcts finished [took 78.0435s] 31/10/23 12:13:18| INFO: bin_sld finished [took 227.6364s] 31/10/23 12:13:20| INFO: bin_sld_bcts finished [took 227.4485s] 31/10/23 12:14:23| INFO: mul_sld_gs finished [took 287.2824s] 31/10/23 12:17:20| INFO: bin_sld_gs finished [took 465.4084s] 31/10/23 12:17:20| INFO: Dataset sample 0.40 of dataset rcv1_CCAT finished [took 470.5362s] 31/10/23 12:17:20| INFO: Dataset sample 0.30 of dataset rcv1_CCAT started 31/10/23 12:18:22| INFO: doc_feat finished [took 46.7203s] 31/10/23 12:18:24| INFO: ref finished [took 52.8941s] 31/10/23 12:18:24| INFO: kfcv finished [took 55.1602s] 31/10/23 12:18:27| INFO: atc_mc finished [took 55.1296s] 31/10/23 12:18:29| INFO: atc_ne finished [took 54.8176s] 31/10/23 12:18:36| INFO: mul_sld finished [took 73.6368s] 31/10/23 12:18:44| INFO: mul_sld_bcts finished [took 79.2444s] 31/10/23 12:21:09| INFO: bin_sld finished [took 227.4633s] 31/10/23 12:21:11| INFO: bin_sld_bcts finished [took 227.8848s] 31/10/23 12:22:18| INFO: mul_sld_gs finished [took 290.8750s] 31/10/23 12:25:01| INFO: bin_sld_gs finished [took 455.0492s] 31/10/23 12:25:01| INFO: Dataset sample 0.30 of dataset rcv1_CCAT finished [took 460.7077s] 31/10/23 12:25:01| INFO: Dataset sample 0.20 of dataset rcv1_CCAT started 31/10/23 12:26:04| INFO: doc_feat finished [took 48.7419s] 31/10/23 12:26:05| INFO: ref finished [took 53.9956s] 31/10/23 12:26:06| INFO: kfcv finished [took 56.7159s] 31/10/23 12:26:10| INFO: atc_mc finished [took 57.0141s] 31/10/23 12:26:11| INFO: atc_ne finished [took 56.6235s] 31/10/23 12:26:18| INFO: mul_sld finished [took 74.9361s] 31/10/23 12:26:24| INFO: mul_sld_bcts finished [took 78.6411s] 31/10/23 12:28:51| INFO: bin_sld finished [took 228.5964s] 31/10/23 12:28:51| INFO: bin_sld_bcts finished [took 226.9077s] 31/10/23 12:29:34| INFO: mul_sld_gs finished [took 265.9319s] 31/10/23 12:32:39| INFO: bin_sld_gs finished [took 452.9439s] 31/10/23 12:32:39| INFO: Dataset sample 0.20 of dataset rcv1_CCAT finished [took 458.4924s] 31/10/23 12:32:39| INFO: Dataset sample 0.10 of dataset rcv1_CCAT started 31/10/23 12:32:49| WARNING: Method mul_sld_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 31/10/23 12:32:49| WARNING: Method bin_sld_bcts failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 31/10/23 12:32:57| WARNING: Method mul_sld_bcts failed. Exception: fun: nan hess_inv: <5x5 LbfgsInvHessProduct with dtype=float64> jac: array([nan, nan, nan, nan, nan]) message: 'ABNORMAL_TERMINATION_IN_LNSRCH' nfev: 21 nit: 0 njev: 21 status: 2 success: False x: array([1., 0., 0., 0., 0.]) 31/10/23 12:33:33| INFO: doc_feat finished [took 40.8855s] 31/10/23 12:33:34| INFO: ref finished [took 44.7933s] 31/10/23 12:33:34| INFO: kfcv finished [took 47.0146s] 31/10/23 12:33:38| INFO: atc_mc finished [took 47.7008s] 31/10/23 12:33:39| INFO: atc_ne finished [took 47.4664s] 31/10/23 12:33:42| INFO: mul_sld finished [took 60.5341s] 31/10/23 12:35:06| WARNING: Method bin_sld_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 31/10/23 12:36:11| INFO: bin_sld finished [took 210.5128s] 31/10/23 12:36:11| INFO: Dataset sample 0.10 of dataset rcv1_CCAT finished [took 211.7476s] ---------------------------------------------------------------------------------------------------- 31/10/23 13:07:34| INFO: dataset imdb_2prevs 31/10/23 13:07:41| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 13:07:55| INFO: ref finished [took 12.2932s] 31/10/23 13:07:58| INFO: atc_mc finished [took 15.8781s] 31/10/23 13:07:58| INFO: atc_ne finished [took 15.8256s] 31/10/23 13:08:08| INFO: mul_sld finished [took 25.6841s] 31/10/23 13:08:18| INFO: mul_sld_bcts finished [took 35.3498s] 31/10/23 13:08:18| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 36.3540s] 31/10/23 13:08:18| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 13:08:32| INFO: ref finished [took 12.8011s] 31/10/23 13:08:36| INFO: atc_mc finished [took 16.7266s] 31/10/23 13:08:36| INFO: atc_ne finished [took 16.9577s] 31/10/23 13:08:49| INFO: mul_sld finished [took 30.1948s] 31/10/23 13:09:00| INFO: mul_sld_bcts finished [took 41.0998s] 31/10/23 13:09:00| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 42.6008s] 31/10/23 13:09:00| ERROR: estimate comparison failed. Exceprion: unsupported operand type(s) for /: 'NoneType' and 'str' ---------------------------------------------------------------------------------------------------- 31/10/23 13:10:27| INFO: dataset imdb_2prevs 31/10/23 13:10:34| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 13:10:47| INFO: ref finished [took 11.6569s] 31/10/23 13:10:51| INFO: atc_mc finished [took 15.6380s] 31/10/23 13:10:51| INFO: atc_ne finished [took 15.5430s] 31/10/23 13:11:00| INFO: mul_sld finished [took 24.9236s] 31/10/23 13:11:10| INFO: mul_sld_bcts finished [took 34.5252s] 31/10/23 13:11:10| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 35.4874s] 31/10/23 13:11:10| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 13:11:23| INFO: ref finished [took 11.5602s] 31/10/23 13:11:26| INFO: atc_ne finished [took 14.3888s] 31/10/23 13:11:26| INFO: atc_mc finished [took 14.5643s] 31/10/23 13:11:39| INFO: mul_sld finished [took 27.8023s] 31/10/23 13:11:51| INFO: mul_sld_bcts finished [took 39.2892s] 31/10/23 13:11:51| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 40.6914s] 31/10/23 13:11:51| DEBUG: ['COMP_ESTIMATORS', 'DATASET_DIR_UPDATE', 'DATASET_NAME', 'DATASET_N_PREVS', 'DATASET_PREVS', 'DATASET_TARGET', 'METRICS', 'OUT_DIR', 'OUT_DIR_NAME', 'PLOT_DIR_NAME', 'PLOT_ESTIMATORS', 'PLOT_OUT_DIR', 'PLOT_STDEV', 'PROTOCOL_N_PREVS', 'PROTOCOL_REPEATS', 'SAMPLE_SIZE', '__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__getstate__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__slotnames__', '__str__', '__subclasshook__', '__weakref__', '_current_conf', '_default', '_environ__getdict', '_environ__setdict', '_instance', '_keys', 'confs', 'exec', 'get_confs', 'get_plot_confs', 'load_conf', 'plot_confs'] 31/10/23 13:11:51| ERROR: estimate comparison failed. Exceprion: unsupported operand type(s) for /: 'NoneType' and 'str' ---------------------------------------------------------------------------------------------------- 31/10/23 13:12:56| INFO: dataset imdb_2prevs 31/10/23 13:13:03| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 13:13:15| INFO: ref finished [took 11.2578s] 31/10/23 13:13:19| INFO: atc_mc finished [took 14.7895s] 31/10/23 13:13:19| INFO: atc_ne finished [took 14.8637s] 31/10/23 13:13:28| INFO: mul_sld finished [took 24.2622s] 31/10/23 13:13:38| INFO: mul_sld_bcts finished [took 34.0592s] 31/10/23 13:13:38| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 34.9907s] 31/10/23 13:13:38| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 13:13:52| INFO: ref finished [took 12.2334s] 31/10/23 13:13:56| INFO: atc_ne finished [took 16.1148s] 31/10/23 13:13:56| INFO: atc_mc finished [took 16.4135s] 31/10/23 13:14:10| INFO: mul_sld finished [took 30.7003s] 31/10/23 13:14:21| INFO: mul_sld_bcts finished [took 41.5915s] 31/10/23 13:14:21| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 43.0339s] 31/10/23 13:14:21| ERROR: estimate comparison failed. Exceprion: 'environ' object has no attribute '__getdict' ---------------------------------------------------------------------------------------------------- 31/10/23 14:05:25| ERROR: estimate comparison failed. Exceprion: 'environ' object has no attribute '_current_conf' ---------------------------------------------------------------------------------------------------- 31/10/23 14:06:00| INFO: dataset imdb_2prevs 31/10/23 14:06:07| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:06:19| INFO: ref finished [took 10.8776s] 31/10/23 14:06:23| INFO: atc_ne finished [took 14.0744s] 31/10/23 14:06:23| INFO: atc_mc finished [took 14.4000s] 31/10/23 14:06:33| INFO: mul_sld finished [took 24.5149s] 31/10/23 14:06:42| INFO: mul_sld_bcts finished [took 33.9116s] 31/10/23 14:06:42| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 34.8416s] 31/10/23 14:06:42| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:06:55| INFO: ref finished [took 11.2125s] 31/10/23 14:06:59| INFO: atc_ne finished [took 14.9235s] 31/10/23 14:06:59| INFO: atc_mc finished [took 15.1623s] 31/10/23 14:07:12| INFO: mul_sld finished [took 28.3463s] 31/10/23 14:07:23| INFO: mul_sld_bcts finished [took 39.0377s] 31/10/23 14:07:23| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 40.4312s] 31/10/23 14:07:23| ERROR: estimate comparison failed. Exceprion: 'environ' object has no attribute '__getdict' ---------------------------------------------------------------------------------------------------- 31/10/23 14:09:14| INFO: dataset imdb_2prevs 31/10/23 14:09:22| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:09:33| INFO: ref finished [took 10.6213s] 31/10/23 14:09:37| INFO: atc_mc finished [took 14.2004s] 31/10/23 14:09:37| INFO: atc_ne finished [took 14.2574s] 31/10/23 14:09:46| INFO: mul_sld finished [took 23.8084s] 31/10/23 14:09:56| INFO: mul_sld_bcts finished [took 33.4634s] 31/10/23 14:09:56| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 34.4023s] 31/10/23 14:09:56| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:10:09| INFO: ref finished [took 11.0452s] 31/10/23 14:10:12| INFO: atc_mc finished [took 14.0363s] 31/10/23 14:10:12| INFO: atc_ne finished [took 14.2492s] 31/10/23 14:10:25| INFO: mul_sld finished [took 27.1464s] 31/10/23 14:10:35| INFO: mul_sld_bcts finished [took 37.7957s] 31/10/23 14:10:35| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 39.1750s] 31/10/23 14:10:35| ERROR: estimate comparison failed. Exceprion: unsupported operand type(s) for /: 'NoneType' and 'str' ---------------------------------------------------------------------------------------------------- 31/10/23 14:14:00| INFO: dataset imdb_2prevs 31/10/23 14:14:07| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:14:19| INFO: ref finished [took 11.0176s] 31/10/23 14:14:22| INFO: atc_mc finished [took 14.0422s] 31/10/23 14:14:23| INFO: atc_ne finished [took 14.2169s] 31/10/23 14:14:31| INFO: mul_sld finished [took 23.7014s] 31/10/23 14:14:42| INFO: mul_sld_bcts finished [took 33.7536s] 31/10/23 14:14:42| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 34.7003s] 31/10/23 14:14:42| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:14:54| INFO: ref finished [took 11.0187s] 31/10/23 14:14:57| INFO: atc_mc finished [took 14.0175s] 31/10/23 14:14:58| INFO: atc_ne finished [took 14.4154s] 31/10/23 14:15:10| INFO: mul_sld finished [took 27.5946s] 31/10/23 14:15:21| INFO: mul_sld_bcts finished [took 38.0464s] 31/10/23 14:15:21| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 39.4594s] 31/10/23 14:15:21| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['atc_mc', 'mul_sld', 'atc_ne', 'mul_sld_bcts', 'ref'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': None, 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': None, 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 14:15:21| ERROR: estimate comparison failed. Exceprion: unsupported operand type(s) for /: 'NoneType' and 'str' ---------------------------------------------------------------------------------------------------- 31/10/23 14:30:59| INFO: dataset imdb_2prevs 31/10/23 14:31:10| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:31:33| INFO: ref finished [took 22.2885s] 31/10/23 14:31:41| INFO: atc_mc finished [took 29.8328s] 31/10/23 14:31:41| INFO: atc_ne finished [took 30.1421s] 31/10/23 14:31:46| INFO: mul_sld finished [took 35.8373s] 31/10/23 14:31:57| INFO: mul_sld_bcts finished [took 46.5130s] 31/10/23 14:31:57| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 47.5379s] 31/10/23 14:31:57| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:32:24| INFO: ref finished [took 24.3912s] 31/10/23 14:32:31| INFO: atc_mc finished [took 31.2488s] 31/10/23 14:32:31| INFO: atc_ne finished [took 31.5120s] 31/10/23 14:32:43| INFO: mul_sld finished [took 44.6372s] 31/10/23 14:32:54| INFO: mul_sld_bcts finished [took 54.5749s] 31/10/23 14:32:54| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 56.2358s] 31/10/23 14:32:54| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['mul_sld_bcts', 'atc_ne', 'atc_mc', 'ref', 'mul_sld'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 14:32:58| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['mul_sld_bcts', 'atc_ne', 'atc_mc', 'ref', 'mul_sld'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['mul_sld_bcts', 'mul_sld', 'ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': False} ---------------------------------------------------------------------------------------------------- 31/10/23 14:37:38| INFO: dataset imdb_2prevs 31/10/23 14:37:45| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:37:58| INFO: ref finished [took 11.4397s] 31/10/23 14:38:01| INFO: atc_mc finished [took 14.6411s] 31/10/23 14:38:01| INFO: atc_ne finished [took 14.8218s] 31/10/23 14:38:11| INFO: mul_sld finished [took 24.4862s] 31/10/23 14:38:20| INFO: mul_sld_bcts finished [took 33.9900s] 31/10/23 14:38:20| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 34.9816s] 31/10/23 14:38:20| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:38:33| INFO: ref finished [took 11.3787s] 31/10/23 14:38:36| INFO: atc_mc finished [took 14.4366s] 31/10/23 14:38:36| INFO: atc_ne finished [took 14.3365s] 31/10/23 14:38:50| INFO: mul_sld finished [took 28.1585s] 31/10/23 14:39:00| INFO: mul_sld_bcts finished [took 38.5508s] 31/10/23 14:39:00| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 40.0193s] 31/10/23 14:39:00| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['atc_ne', 'mul_sld', 'ref', 'mul_sld_bcts', 'atc_mc'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 14:39:03| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['atc_ne', 'mul_sld', 'ref', 'mul_sld_bcts', 'atc_mc'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['mul_sld_bcts', 'mul_sld', 'ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': False} ---------------------------------------------------------------------------------------------------- 31/10/23 14:44:15| INFO: dataset imdb_2prevs 31/10/23 14:44:22| INFO: Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:44:35| INFO: ref finished [took 11.5902s] 31/10/23 14:44:38| INFO: atc_mc finished [took 14.7915s] 31/10/23 14:44:39| INFO: atc_ne finished [took 14.8611s] 31/10/23 14:44:48| INFO: mul_sld finished [took 24.7670s] 31/10/23 14:44:58| INFO: mul_sld_bcts finished [took 34.3171s] 31/10/23 14:44:58| INFO: Dataset sample 0.10 of dataset imdb_2prevs finished [took 35.3088s] 31/10/23 14:44:58| INFO: Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:45:11| INFO: ref finished [took 11.8887s] 31/10/23 14:45:15| INFO: atc_mc finished [took 15.2624s] 31/10/23 14:45:15| INFO: atc_ne finished [took 15.2085s] 31/10/23 14:45:28| INFO: mul_sld finished [took 28.5408s] 31/10/23 14:45:38| INFO: mul_sld_bcts finished [took 38.9976s] 31/10/23 14:45:38| INFO: Dataset sample 0.50 of dataset imdb_2prevs finished [took 40.5854s] 31/10/23 14:45:38| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['atc_ne', 'mul_sld_bcts', 'atc_mc', 'ref', 'mul_sld'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 14:45:41| DEBUG: {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['atc_ne', 'mul_sld_bcts', 'atc_mc', 'ref', 'mul_sld'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['mul_sld_bcts', 'mul_sld', 'ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': False} ---------------------------------------------------------------------------------------------------- 31/10/23 14:55:18| INFO dataset imdb_2prevs 31/10/23 14:55:26| INFO Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 14:55:37| INFO ref finished [took 10.1990s] 31/10/23 14:55:40| INFO atc_mc finished [took 13.4778s] 31/10/23 14:55:41| INFO atc_ne finished [took 13.5559s] 31/10/23 14:55:50| INFO mul_sld finished [took 23.0450s] 31/10/23 14:55:59| INFO mul_sld_bcts finished [took 32.4582s] 31/10/23 14:55:59| INFO Dataset sample 0.10 of dataset imdb_2prevs finished [took 33.3679s] 31/10/23 14:55:59| INFO Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 14:56:11| INFO ref finished [took 10.3415s] 31/10/23 14:56:14| INFO atc_mc finished [took 13.4638s] 31/10/23 14:56:14| INFO atc_ne finished [took 13.4791s] 31/10/23 14:56:27| INFO mul_sld finished [took 26.3298s] 31/10/23 14:56:38| INFO mul_sld_bcts finished [took 37.2449s] 31/10/23 14:56:38| INFO Dataset sample 0.50 of dataset imdb_2prevs finished [took 38.6430s] 31/10/23 14:56:38| DEBUG {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['mul_sld_bcts', 'atc_mc', 'ref', 'mul_sld', 'atc_ne'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 14:56:41| DEBUG {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['mul_sld_bcts', 'atc_mc', 'ref', 'mul_sld', 'atc_ne'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['mul_sld_bcts', 'mul_sld', 'ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': False} ---------------------------------------------------------------------------------------------------- 31/10/23 15:00:19| INFO dataset imdb_2prevs 31/10/23 15:00:26| INFO Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 15:00:38| INFO ref finished [took 10.7099s] 31/10/23 15:00:41| INFO atc_ne finished [took 13.7392s] 31/10/23 15:00:41| INFO atc_mc finished [took 13.9108s] 31/10/23 15:00:50| INFO mul_sld finished [took 23.3628s] 31/10/23 15:01:00| INFO mul_sld_bcts finished [took 33.0440s] 31/10/23 15:01:00| INFO Dataset sample 0.10 of dataset imdb_2prevs finished [took 33.9805s] 31/10/23 15:01:00| INFO Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 15:01:12| INFO ref finished [took 10.7020s] 31/10/23 15:01:15| INFO atc_mc finished [took 13.9521s] 31/10/23 15:01:15| INFO atc_ne finished [took 13.8623s] 31/10/23 15:01:28| INFO mul_sld finished [took 26.8476s] 31/10/23 15:01:39| INFO mul_sld_bcts finished [took 37.4291s] 31/10/23 15:01:39| INFO Dataset sample 0.50 of dataset imdb_2prevs finished [took 38.8721s] 31/10/23 15:01:39| DEBUG {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['ref', 'atc_mc', 'mul_sld', 'atc_ne', 'mul_sld_bcts'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': True} 31/10/23 15:01:42| DEBUG {'DATASET_NAME': 'imdb', 'DATASET_TARGET': None, 'METRICS': ['acc'], 'COMP_ESTIMATORS': ['ref', 'atc_mc', 'mul_sld', 'atc_ne', 'mul_sld_bcts'], 'DATASET_N_PREVS': 5, 'DATASET_PREVS': [0.5, 0.1], 'OUT_DIR_NAME': 'output', 'OUT_DIR': WindowsPath('output/imdb_2prevs'), 'PLOT_DIR_NAME': 'plot', 'PLOT_OUT_DIR': WindowsPath('output/imdb_2prevs/plot'), 'DATASET_DIR_UPDATE': False, 'PROTOCOL_N_PREVS': 21, 'PROTOCOL_REPEATS': 100, 'SAMPLE_SIZE': 1000, 'PLOT_ESTIMATORS': ['mul_sld_bcts', 'mul_sld', 'ref', 'atc_mc', 'atc_ne'], 'PLOT_STDEV': False} ---------------------------------------------------------------------------------------------------- 31/10/23 15:02:43| INFO dataset imdb_2prevs 31/10/23 15:02:50| INFO Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 15:03:02| INFO ref finished [took 10.5528s] 31/10/23 15:03:05| INFO atc_mc finished [took 13.7838s] 31/10/23 15:03:05| INFO atc_ne finished [took 13.6736s] 31/10/23 15:03:14| INFO mul_sld finished [took 23.2705s] 31/10/23 15:03:24| INFO mul_sld_bcts finished [took 32.8493s] 31/10/23 15:03:24| INFO Dataset sample 0.10 of dataset imdb_2prevs finished [took 33.7917s] 31/10/23 15:03:24| INFO Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 15:03:36| INFO ref finished [took 10.4338s] 31/10/23 15:03:39| INFO atc_mc finished [took 13.5140s] 31/10/23 15:03:39| INFO atc_ne finished [took 13.5920s] 31/10/23 15:03:52| INFO mul_sld finished [took 26.7677s] 31/10/23 15:04:03| INFO mul_sld_bcts finished [took 37.2882s] 31/10/23 15:04:03| INFO Dataset sample 0.50 of dataset imdb_2prevs finished [took 38.7014s] ---------------------------------------------------------------------------------------------------- 31/10/23 17:01:56| INFO dataset imdb_2prevs 31/10/23 17:02:03| INFO Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 17:02:16| INFO ref finished [took 11.7260s] 31/10/23 17:02:19| INFO atc_mc finished [took 14.9332s] 31/10/23 17:02:20| INFO atc_ne finished [took 14.9267s] 31/10/23 17:02:29| INFO mul_sld finished [took 25.0825s] 31/10/23 17:02:39| INFO mul_sld_bcts finished [took 35.1456s] 31/10/23 17:02:39| INFO Dataset sample 0.10 of dataset imdb_2prevs finished [took 36.1167s] 31/10/23 17:02:39| INFO Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 17:02:53| INFO ref finished [took 12.1990s] 31/10/23 17:02:57| INFO atc_mc finished [took 15.9130s] 31/10/23 17:02:57| INFO atc_ne finished [took 15.8122s] 31/10/23 17:03:10| INFO mul_sld finished [took 29.0681s] 31/10/23 17:03:21| INFO mul_sld_bcts finished [took 40.0346s] 31/10/23 17:03:21| INFO Dataset sample 0.50 of dataset imdb_2prevs finished [took 41.6137s] ---------------------------------------------------------------------------------------------------- 31/10/23 17:04:35| INFO dataset imdb_2prevs 31/10/23 17:04:42| INFO Dataset sample 0.10 of dataset imdb_2prevs started 31/10/23 17:04:56| INFO ref finished [took 11.5027s] 31/10/23 17:05:00| INFO atc_mc finished [took 15.1600s] 31/10/23 17:05:00| INFO atc_ne finished [took 15.0072s] 31/10/23 17:05:09| INFO mul_sld finished [took 24.7931s] 31/10/23 17:05:19| INFO mul_sld_bcts finished [took 34.6305s] 31/10/23 17:05:19| INFO Dataset sample 0.10 of dataset imdb_2prevs finished [took 37.1778s] 31/10/23 17:05:19| INFO Dataset sample 0.50 of dataset imdb_2prevs started 31/10/23 17:05:33| INFO ref finished [took 12.2649s] 31/10/23 17:05:36| INFO atc_mc finished [took 15.5987s] 31/10/23 17:05:37| INFO atc_ne finished [took 15.8214s] 31/10/23 17:05:50| INFO mul_sld finished [took 29.3523s] 31/10/23 17:06:00| INFO mul_sld_bcts finished [took 39.8376s] 31/10/23 17:06:00| INFO Dataset sample 0.50 of dataset imdb_2prevs finished [took 41.2888s] ---------------------------------------------------------------------------------------------------- 31/10/23 20:19:37| INFO dataset imdb_1prevs 31/10/23 20:19:48| INFO Dataset sample 0.50 of dataset imdb_1prevs started 31/10/23 20:20:07| INFO ref finished [took 17.4125s] ---------------------------------------------------------------------------------------------------- 31/10/23 20:20:50| INFO dataset imdb_1prevs 31/10/23 20:21:01| INFO Dataset sample 0.50 of dataset imdb_1prevs started 31/10/23 20:21:19| INFO ref finished [took 17.0717s] ---------------------------------------------------------------------------------------------------- 31/10/23 20:22:05| INFO dataset imdb_1prevs 31/10/23 20:22:15| INFO Dataset sample 0.50 of dataset imdb_1prevs started 31/10/23 20:22:35| INFO ref finished [took 18.4752s] ---------------------------------------------------------------------------------------------------- 31/10/23 20:23:38| INFO dataset imdb_1prevs 31/10/23 20:23:48| INFO Dataset sample 0.50 of dataset imdb_1prevs started 31/10/23 20:24:08| INFO ref finished [took 18.3216s] ---------------------------------------------------------------------------------------------------- 01/11/23 13:07:19| INFO dataset imdb_1prevs 01/11/23 13:07:27| INFO Dataset sample 0.50 of dataset imdb_1prevs started 01/11/23 13:07:27| ERROR Evaluation over imdb_1prevs failed. Exception: 'Invalid estimator: estimator mul_sld_gs does not exist' 01/11/23 13:07:27| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: cannot access local variable 'dr' where it is not associated with a value ---------------------------------------------------------------------------------------------------- 03/11/23 20:54:19| INFO dataset rcv1_CCAT_9prevs 03/11/23 20:54:24| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 03/11/23 20:54:28| WARNING Method mul_sld_gs failed. Exception: Invalid parameter 'quantifier' for estimator EMQ(classifier=LogisticRegression()). Valid parameters are: ['classifier', 'exact_train_prev', 'recalib']. 03/11/23 20:54:29| WARNING Method mul_sld failed. Exception: evaluation_report() got an unexpected keyword argument 'protocor' 03/11/23 20:54:30| WARNING Method bin_sld_gs failed. Exception: Invalid parameter 'quantifier' for estimator EMQ(classifier=LogisticRegression()). Valid parameters are: ['classifier', 'exact_train_prev', 'recalib']. 03/11/23 20:55:09| INFO ref finished [took 38.5179s] ---------------------------------------------------------------------------------------------------- 03/11/23 21:28:36| INFO dataset rcv1_CCAT_9prevs 03/11/23 21:28:41| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 03/11/23 21:28:45| WARNING Method mul_sld failed. Exception: evaluation_report() got an unexpected keyword argument 'protocor' ---------------------------------------------------------------------------------------------------- 03/11/23 21:31:03| INFO dataset rcv1_CCAT_9prevs 03/11/23 21:31:08| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 03/11/23 21:31:59| INFO ref finished [took 45.6616s] 03/11/23 21:32:03| INFO atc_mc finished [took 48.4360s] 03/11/23 21:32:07| INFO atc_ne finished [took 51.0515s] 03/11/23 21:32:23| INFO mul_sld finished [took 72.9229s] 03/11/23 21:34:43| INFO bin_sld finished [took 213.9538s] 03/11/23 21:36:27| INFO mul_sld_gs finished [took 314.9357s] 03/11/23 21:40:50| INFO bin_sld_gs finished [took 579.2530s] 03/11/23 21:40:50| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 582.5876s] 03/11/23 21:40:50| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 03/11/23 21:41:39| INFO ref finished [took 43.7409s] 03/11/23 21:41:43| INFO atc_mc finished [took 46.4580s] 03/11/23 21:41:44| INFO atc_ne finished [took 46.4267s] 03/11/23 21:41:54| INFO mul_sld finished [took 61.3005s] 03/11/23 21:44:18| INFO bin_sld finished [took 206.3680s] 03/11/23 21:45:59| INFO mul_sld_gs finished [took 304.4726s] 03/11/23 21:50:33| INFO bin_sld_gs finished [took 579.3455s] 03/11/23 21:50:33| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 582.4808s] 03/11/23 21:50:33| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 03/11/23 21:51:22| INFO ref finished [took 43.6853s] 03/11/23 21:51:26| INFO atc_mc finished [took 47.1366s] 03/11/23 21:51:30| INFO atc_ne finished [took 49.4868s] 03/11/23 21:51:34| INFO mul_sld finished [took 59.0964s] 03/11/23 21:53:59| INFO bin_sld finished [took 205.0248s] 03/11/23 21:55:50| INFO mul_sld_gs finished [took 312.5630s] 03/11/23 22:00:27| INFO bin_sld_gs finished [took 591.1460s] 03/11/23 22:00:27| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 594.3163s] 03/11/23 22:00:27| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 03/11/23 22:01:15| INFO ref finished [took 43.3806s] 03/11/23 22:01:19| INFO atc_mc finished [took 46.6674s] 03/11/23 22:01:21| INFO atc_ne finished [took 47.1220s] 03/11/23 22:01:28| INFO mul_sld finished [took 58.6799s] 03/11/23 22:03:53| INFO bin_sld finished [took 204.7659s] 03/11/23 22:05:39| INFO mul_sld_gs finished [took 307.8811s] 03/11/23 22:10:32| INFO bin_sld_gs finished [took 601.9995s] 03/11/23 22:10:32| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 604.8406s] 03/11/23 22:10:32| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 03/11/23 22:11:20| INFO ref finished [took 42.8256s] 03/11/23 22:11:25| INFO atc_mc finished [took 46.9203s] 03/11/23 22:11:28| INFO atc_ne finished [took 49.3042s] 03/11/23 22:11:34| INFO mul_sld finished [took 60.2744s] 03/11/23 22:13:59| INFO bin_sld finished [took 205.7078s] 03/11/23 22:15:45| INFO mul_sld_gs finished [took 309.0888s] 03/11/23 22:20:32| INFO bin_sld_gs finished [took 596.5102s] 03/11/23 22:20:32| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 599.5067s] 03/11/23 22:20:32| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 03/11/23 22:21:20| INFO ref finished [took 43.1698s] 03/11/23 22:21:24| INFO atc_mc finished [took 46.5768s] 03/11/23 22:21:25| INFO atc_ne finished [took 46.3408s] 03/11/23 22:21:34| INFO mul_sld finished [took 60.8070s] 03/11/23 22:23:58| INFO bin_sld finished [took 205.3362s] 03/11/23 22:25:44| INFO mul_sld_gs finished [took 308.1859s] 03/11/23 22:30:44| INFO bin_sld_gs finished [took 609.5468s] 03/11/23 22:30:44| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 612.5803s] 03/11/23 22:30:44| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 03/11/23 22:31:32| INFO ref finished [took 43.2949s] 03/11/23 22:31:37| INFO atc_mc finished [took 46.3686s] 03/11/23 22:31:40| INFO atc_ne finished [took 49.2242s] 03/11/23 22:31:47| INFO mul_sld finished [took 60.9437s] 03/11/23 22:34:11| INFO bin_sld finished [took 205.9299s] 03/11/23 22:35:56| INFO mul_sld_gs finished [took 308.2738s] 03/11/23 22:40:36| INFO bin_sld_gs finished [took 588.7918s] 03/11/23 22:40:36| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 591.8830s] 03/11/23 22:40:36| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 03/11/23 22:41:24| INFO ref finished [took 43.3321s] 03/11/23 22:41:29| INFO atc_mc finished [took 46.8041s] 03/11/23 22:41:29| INFO atc_ne finished [took 46.5810s] 03/11/23 22:41:38| INFO mul_sld finished [took 60.2962s] 03/11/23 22:44:07| INFO bin_sld finished [took 209.6435s] 03/11/23 22:45:44| INFO mul_sld_gs finished [took 304.4809s] 03/11/23 22:50:39| INFO bin_sld_gs finished [took 599.5588s] 03/11/23 22:50:39| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 602.5720s] 03/11/23 22:50:39| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 03/11/23 22:51:26| INFO ref finished [took 42.4313s] 03/11/23 22:51:30| INFO atc_mc finished [took 45.5261s] 03/11/23 22:51:34| INFO atc_ne finished [took 48.4488s] 03/11/23 22:51:47| INFO mul_sld finished [took 66.4801s] 03/11/23 22:54:08| INFO bin_sld finished [took 208.4272s] 03/11/23 22:55:49| INFO mul_sld_gs finished [took 306.4505s] 03/11/23 23:00:15| INFO bin_sld_gs finished [took 573.7761s] 03/11/23 23:00:15| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 576.7586s] ---------------------------------------------------------------------------------------------------- 03/11/23 23:33:15| INFO dataset imdb_1prevs 03/11/23 23:33:22| INFO Dataset sample 0.50 of dataset imdb_1prevs started 03/11/23 23:33:22| ERROR Evaluation over imdb_1prevs failed. Exception: 'function' object is not iterable 03/11/23 23:33:22| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: cannot access local variable 'dr' where it is not associated with a value ---------------------------------------------------------------------------------------------------- 03/11/23 23:34:15| INFO dataset imdb_1prevs 03/11/23 23:34:23| INFO Dataset sample 0.50 of dataset imdb_1prevs started 03/11/23 23:34:35| INFO atc_mc finished [took 11.5081s] 03/11/23 23:34:45| INFO ref finished [took 8.7754s] 03/11/23 23:34:47| INFO mul_sld finished [took 22.9651s] 03/11/23 23:34:47| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 23.9721s] 03/11/23 23:34:47| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: 'ref' ---------------------------------------------------------------------------------------------------- 03/11/23 23:36:10| INFO dataset imdb_1prevs 03/11/23 23:36:30| INFO Dataset sample 0.50 of dataset imdb_1prevs started 03/11/23 23:38:02| INFO atc_mc finished [took 56.2957s] 03/11/23 23:38:03| INFO mul_sld finished [took 57.6237s] 03/11/23 23:38:40| INFO ref finished [took 37.7811s] 03/11/23 23:38:40| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 130.9031s] 03/11/23 23:38:42| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: 'ref' ---------------------------------------------------------------------------------------------------- 03/11/23 23:39:32| INFO dataset imdb_1prevs 03/11/23 23:39:42| INFO Dataset sample 0.50 of dataset imdb_1prevs started 03/11/23 23:40:08| INFO atc_mc finished [took 24.7110s] 03/11/23 23:40:23| INFO mul_sld finished [took 40.2345s] 03/11/23 23:40:26| INFO ref finished [took 17.8417s] 03/11/23 23:40:26| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 44.8087s] ---------------------------------------------------------------------------------------------------- 03/11/23 23:41:18| INFO dataset imdb_1prevs 03/11/23 23:41:28| INFO Dataset sample 0.50 of dataset imdb_1prevs started 03/11/23 23:41:54| INFO atc_mc finished [took 24.0569s] 03/11/23 23:42:03| INFO mul_sld finished [took 33.3390s] 03/11/23 23:42:12| INFO ref finished [took 16.9551s] 03/11/23 23:42:12| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 43.2484s] ---------------------------------------------------------------------------------------------------- 04/11/23 00:03:17| ERROR Evaluation over imdb_1prevs failed. Exception: CompEstimatorName_.__init__() missing 1 required positional argument: 'ce' 04/11/23 00:03:17| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: cannot access local variable 'dr' where it is not associated with a value ---------------------------------------------------------------------------------------------------- 04/11/23 00:03:50| ERROR Evaluation over imdb_1prevs failed. Exception: 'CompEstimator' object has no attribute '_CompEstimatorName___get' 04/11/23 00:03:50| ERROR Failed while saving configuration imdb_debug of imdb_1prevs. Exception: cannot access local variable 'dr' where it is not associated with a value ---------------------------------------------------------------------------------------------------- 04/11/23 00:04:42| INFO dataset imdb_1prevs 04/11/23 00:04:53| INFO Dataset sample 0.50 of dataset imdb_1prevs started 04/11/23 00:05:13| INFO ref finished [took 19.2363s] 04/11/23 00:05:20| INFO atc_mc finished [took 26.4278s] 04/11/23 00:05:29| INFO mul_sld finished [took 35.3110s] 04/11/23 00:05:29| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 36.4422s] ---------------------------------------------------------------------------------------------------- 04/11/23 00:19:43| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:19:49| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:19:53| WARNING Method bin_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:19:55| WARNING Method mul_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:19:57| WARNING Method bin_pacc failed. Exception: PACC.__init__() got an unexpected keyword argument 'recalib' 04/11/23 00:19:59| WARNING Method mul_pacc failed. Exception: PACC.__init__() got an unexpected keyword argument 'recalib' 04/11/23 00:20:00| WARNING Method bin_pacc_gs failed. Exception: Invalid parameter 'recalib' for estimator PACC(classifier=LogisticRegression(), n_jobs=1). Valid parameters are: ['classifier', 'n_jobs', 'val_split']. 04/11/23 00:20:01| WARNING Method mul_pacc_gs failed. Exception: Invalid parameter 'recalib' for estimator PACC(classifier=LogisticRegression(), n_jobs=1). Valid parameters are: ['classifier', 'n_jobs', 'val_split']. ---------------------------------------------------------------------------------------------------- 04/11/23 00:22:45| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:22:50| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:22:54| WARNING Method bin_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:22:55| WARNING Method mul_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. ---------------------------------------------------------------------------------------------------- 04/11/23 00:28:11| INFO dataset rcv1_CCAT_9prevs ---------------------------------------------------------------------------------------------------- 04/11/23 00:29:39| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:29:45| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:29:49| WARNING Method bin_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:29:51| WARNING Method mul_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:30:39| WARNING Method mul_pacc_gs failed. Exception: evaluation_report() got an unexpected keyword argument 'method_name' 04/11/23 00:31:00| INFO ref finished [took 60.5788s] 04/11/23 00:31:09| INFO atc_mc finished [took 64.6156s] 04/11/23 00:31:09| INFO mul_pacc finished [took 75.1821s] 04/11/23 00:31:12| INFO atc_ne finished [took 62.8665s] 04/11/23 00:31:24| INFO mul_sld finished [took 96.8624s] ---------------------------------------------------------------------------------------------------- 04/11/23 00:33:26| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:33:31| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:33:35| WARNING Method bin_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. 04/11/23 00:33:37| WARNING Method mul_sld_qgs failed. Exception: X has 47236 features, but LogisticRegression is expecting 47238 features as input. ---------------------------------------------------------------------------------------------------- 04/11/23 00:38:42| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:38:48| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:38:51| WARNING Method bin_sld_qgs failed. Exception: ExtendedCollection.extend_collection() missing 1 required positional argument: 'pred_proba' 04/11/23 00:38:52| WARNING Method mul_sld_qgs failed. Exception: ExtendedCollection.extend_collection() missing 1 required positional argument: 'pred_proba' 04/11/23 00:39:41| WARNING Method mul_pacc_gs failed. Exception: evaluation_report() got an unexpected keyword argument 'method_name' ---------------------------------------------------------------------------------------------------- 04/11/23 00:46:33| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:46:39| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:46:40| WARNING Method bin_sld failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:41| WARNING Method mul_sld failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:42| WARNING Method bin_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' 04/11/23 00:46:43| WARNING Method mul_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' 04/11/23 00:46:44| WARNING Method bin_sld_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:45| WARNING Method mul_sld_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:46| WARNING Method bin_pacc failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:47| WARNING Method mul_pacc failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:47| WARNING Method bin_pacc_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:46:48| WARNING Method mul_pacc_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:27| INFO ref finished [took 37.5294s] 04/11/23 00:47:31| INFO atc_mc finished [took 40.5777s] 04/11/23 00:47:32| INFO atc_ne finished [took 40.7565s] 04/11/23 00:47:32| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 52.8106s] 04/11/23 00:47:32| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 00:47:33| WARNING Method bin_sld failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:34| WARNING Method mul_sld failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:35| WARNING Method bin_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' 04/11/23 00:47:36| WARNING Method mul_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' 04/11/23 00:47:37| WARNING Method bin_sld_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:38| WARNING Method mul_sld_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:39| WARNING Method bin_pacc failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:39| WARNING Method mul_pacc failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:40| WARNING Method bin_pacc_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() 04/11/23 00:47:41| WARNING Method mul_pacc_gs failed. Exception: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() ---------------------------------------------------------------------------------------------------- 04/11/23 00:48:05| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:48:10| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:48:13| WARNING Method bin_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' 04/11/23 00:48:14| WARNING Method mul_sld_qgs failed. Exception: 'LogisticRegression' object has no attribute 'pred_proba' ---------------------------------------------------------------------------------------------------- 04/11/23 00:49:18| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:49:24| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:49:27| WARNING Method bin_sld_qgs failed. Exception: GridSearchQ.__init__() missing 1 required positional argument: 'model' 04/11/23 00:49:28| WARNING Method mul_sld_qgs failed. Exception: X has 47238 features, but LogisticRegression is expecting 47236 features as input. ---------------------------------------------------------------------------------------------------- 04/11/23 00:51:27| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:51:32| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:51:36| WARNING Method bin_sld_qgs failed. Exception: X has 47238 features, but LogisticRegression is expecting 47236 features as input. 04/11/23 00:51:37| WARNING Method mul_sld_qgs failed. Exception: X has 47238 features, but LogisticRegression is expecting 47236 features as input. ---------------------------------------------------------------------------------------------------- 04/11/23 00:54:47| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:54:53| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 00:54:57| WARNING Method bin_sld_qgs failed. Exception: a must be greater than 0 unless no samples are taken 04/11/23 00:54:58| WARNING Method mul_sld_qgs failed. Exception: a must be greater than 0 unless no samples are taken ---------------------------------------------------------------------------------------------------- 04/11/23 00:58:47| INFO dataset rcv1_CCAT_9prevs 04/11/23 00:58:52| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 01:00:04| INFO ref finished [took 61.6328s] 04/11/23 01:00:11| INFO atc_mc finished [took 65.4916s] 04/11/23 01:00:13| INFO atc_ne finished [took 63.2288s] 04/11/23 01:00:14| INFO mul_pacc finished [took 75.5101s] 04/11/23 01:00:30| INFO mul_sld finished [took 96.6656s] 04/11/23 01:00:41| INFO mul_pacc_gs finished [took 99.7211s] 04/11/23 01:03:02| INFO bin_pacc finished [took 244.6260s] 04/11/23 01:03:07| INFO bin_sld finished [took 254.3478s] 04/11/23 01:04:51| INFO mul_sld_gs finished [took 354.7477s] 04/11/23 01:05:02| INFO bin_pacc_gs finished [took 362.1808s] 04/11/23 01:09:24| INFO bin_sld_gs finished [took 628.6714s] 04/11/23 01:09:24| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 631.8421s] 04/11/23 01:09:24| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 01:10:39| INFO ref finished [took 63.5158s] 04/11/23 01:10:44| INFO atc_mc finished [took 66.4279s] 04/11/23 01:10:46| INFO mul_pacc finished [took 75.3281s] 04/11/23 01:10:47| INFO atc_ne finished [took 67.5374s] 04/11/23 01:10:52| INFO mul_sld finished [took 86.6592s] 04/11/23 01:11:19| INFO mul_pacc_gs finished [took 104.6374s] 04/11/23 01:13:58| INFO bin_sld finished [took 273.4932s] 04/11/23 01:14:01| INFO bin_pacc finished [took 271.3481s] 04/11/23 01:15:42| INFO mul_sld_gs finished [took 374.2416s] 04/11/23 01:16:01| INFO bin_pacc_gs finished [took 388.0839s] 04/11/23 01:20:29| INFO bin_sld_gs finished [took 661.9729s] 04/11/23 01:20:29| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 665.2874s] 04/11/23 01:20:29| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 04/11/23 01:21:46| INFO ref finished [took 63.8544s] 04/11/23 01:21:50| INFO atc_mc finished [took 66.6917s] 04/11/23 01:21:52| INFO atc_ne finished [took 65.0860s] 04/11/23 01:21:53| INFO mul_pacc finished [took 77.2630s] 04/11/23 01:21:55| INFO mul_sld finished [took 83.3146s] 04/11/23 01:22:23| INFO mul_pacc_gs finished [took 102.3761s] 04/11/23 01:24:47| INFO bin_pacc finished [took 252.0964s] 04/11/23 01:24:49| INFO bin_sld finished [took 258.6998s] 04/11/23 01:26:37| INFO mul_sld_gs finished [took 363.7500s] 04/11/23 01:26:49| INFO bin_pacc_gs finished [took 370.5817s] 04/11/23 01:31:27| INFO bin_sld_gs finished [took 654.3921s] 04/11/23 01:31:27| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 658.0041s] 04/11/23 01:31:27| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 04/11/23 01:32:33| INFO ref finished [took 55.7749s] 04/11/23 01:32:38| INFO atc_mc finished [took 59.4190s] 04/11/23 01:32:40| INFO atc_ne finished [took 59.5155s] 04/11/23 01:32:42| INFO mul_pacc finished [took 68.8994s] 04/11/23 01:32:44| INFO mul_sld finished [took 74.6470s] 04/11/23 01:33:09| INFO mul_pacc_gs finished [took 92.6473s] 04/11/23 01:35:32| INFO bin_pacc finished [took 239.7541s] 04/11/23 01:35:34| INFO bin_sld finished [took 245.7504s] 04/11/23 01:37:19| INFO mul_sld_gs finished [took 348.1188s] 04/11/23 01:37:30| INFO bin_pacc_gs finished [took 355.4729s] 04/11/23 01:42:07| INFO bin_sld_gs finished [took 636.8598s] 04/11/23 01:42:07| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 639.9201s] 04/11/23 01:42:07| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 04/11/23 01:43:14| INFO ref finished [took 56.1531s] 04/11/23 01:43:19| INFO atc_mc finished [took 59.7473s] 04/11/23 01:43:20| INFO atc_ne finished [took 59.0606s] 04/11/23 01:43:23| INFO mul_pacc finished [took 69.4266s] 04/11/23 01:43:25| INFO mul_sld finished [took 76.3328s] 04/11/23 01:43:49| INFO mul_pacc_gs finished [took 92.3926s] 04/11/23 01:46:05| INFO bin_pacc finished [took 233.1877s] 04/11/23 01:46:08| INFO bin_sld finished [took 239.8757s] 04/11/23 01:47:51| INFO mul_sld_gs finished [took 339.5911s] 04/11/23 01:48:00| INFO bin_pacc_gs finished [took 345.7788s] 04/11/23 01:52:44| INFO bin_sld_gs finished [took 633.8407s] 04/11/23 01:52:44| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 637.0648s] 04/11/23 01:52:44| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 04/11/23 01:53:52| INFO ref finished [took 57.4958s] 04/11/23 01:53:57| INFO atc_mc finished [took 60.9998s] 04/11/23 01:53:58| INFO atc_ne finished [took 60.4847s] 04/11/23 01:54:01| INFO mul_pacc finished [took 70.5216s] 04/11/23 01:54:04| INFO mul_sld finished [took 78.2910s] 04/11/23 01:54:27| INFO mul_pacc_gs finished [took 94.4726s] 04/11/23 01:56:48| INFO bin_pacc finished [took 238.5969s] 04/11/23 01:56:50| INFO bin_sld finished [took 244.5679s] 04/11/23 01:58:31| INFO mul_sld_gs finished [took 342.4843s] 04/11/23 01:58:44| INFO bin_pacc_gs finished [took 352.8264s] 04/11/23 02:03:32| INFO bin_sld_gs finished [took 644.7046s] 04/11/23 02:03:32| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 647.8055s] 04/11/23 02:03:32| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 04/11/23 02:04:37| INFO ref finished [took 55.4488s] 04/11/23 02:04:42| INFO atc_mc finished [took 59.2634s] 04/11/23 02:04:44| INFO atc_ne finished [took 59.1371s] 04/11/23 02:04:46| INFO mul_pacc finished [took 68.0960s] 04/11/23 02:04:50| INFO mul_sld finished [took 76.4282s] 04/11/23 02:05:12| INFO mul_pacc_gs finished [took 91.7735s] 04/11/23 02:07:30| INFO bin_pacc finished [took 232.7650s] 04/11/23 02:07:36| INFO bin_sld finished [took 242.4077s] 04/11/23 02:09:14| INFO mul_sld_gs finished [took 338.1418s] 04/11/23 02:09:26| INFO bin_pacc_gs finished [took 347.2033s] 04/11/23 02:13:59| INFO bin_sld_gs finished [took 624.6098s] 04/11/23 02:13:59| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 627.7979s] 04/11/23 02:13:59| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 04/11/23 02:15:05| INFO ref finished [took 55.1962s] 04/11/23 02:15:10| INFO atc_mc finished [took 59.0907s] 04/11/23 02:15:11| INFO atc_ne finished [took 59.1531s] 04/11/23 02:15:13| INFO mul_pacc finished [took 67.6705s] 04/11/23 02:15:17| INFO mul_sld finished [took 75.4559s] 04/11/23 02:15:41| INFO mul_pacc_gs finished [took 92.4901s] 04/11/23 02:17:59| INFO bin_pacc finished [took 233.8600s] 04/11/23 02:18:04| INFO bin_sld finished [took 243.2382s] 04/11/23 02:19:40| INFO mul_sld_gs finished [took 336.0961s] 04/11/23 02:19:51| INFO bin_pacc_gs finished [took 344.4075s] 04/11/23 02:24:30| INFO bin_sld_gs finished [took 627.6209s] 04/11/23 02:24:30| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 630.8251s] 04/11/23 02:24:30| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 04/11/23 02:25:35| INFO ref finished [took 54.8513s] 04/11/23 02:25:40| INFO atc_mc finished [took 58.8528s] 04/11/23 02:25:41| INFO atc_ne finished [took 58.6035s] 04/11/23 02:25:43| INFO mul_pacc finished [took 66.9030s] 04/11/23 02:25:57| INFO mul_sld finished [took 84.2072s] 04/11/23 02:26:10| INFO mul_pacc_gs finished [took 91.0973s] 04/11/23 02:28:31| INFO bin_pacc finished [took 235.7331s] 04/11/23 02:28:35| INFO bin_sld finished [took 243.6260s] 04/11/23 02:30:09| INFO mul_sld_gs finished [took 334.4842s] 04/11/23 02:30:22| INFO bin_pacc_gs finished [took 344.6874s] 04/11/23 02:34:46| INFO bin_sld_gs finished [took 612.1219s] 04/11/23 02:34:46| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 615.2004s] ---------------------------------------------------------------------------------------------------- 04/11/23 02:57:35| INFO dataset rcv1_CCAT_9prevs 04/11/23 02:57:39| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 02:57:47| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 02:58:59| INFO ref finished [took 64.5948s] 04/11/23 02:59:06| INFO atc_mc finished [took 69.5808s] 04/11/23 02:59:12| INFO mul_pacc finished [took 82.8518s] 04/11/23 02:59:13| INFO atc_ne finished [took 72.1303s] 04/11/23 02:59:26| INFO mul_sld finished [took 103.4201s] 04/11/23 02:59:30| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 04/11/23 02:59:41| INFO mul_pacc_gs finished [took 109.4672s] 04/11/23 03:01:59| INFO bin_pacc finished [took 251.3945s] 04/11/23 03:02:02| INFO bin_sld finished [took 260.0226s] 04/11/23 03:03:35| INFO mul_sld_gs finished [took 350.1705s] 04/11/23 03:03:48| INFO bin_pacc_gs finished [took 357.9668s] 04/11/23 03:07:59| INFO bin_sld_gs finished [took 615.8087s] 04/11/23 03:07:59| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 620.4985s] 04/11/23 03:07:59| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 03:08:06| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 03:09:17| INFO ref finished [took 64.4692s] 04/11/23 03:09:25| INFO atc_mc finished [took 71.3766s] 04/11/23 03:09:27| INFO atc_ne finished [took 71.0947s] 04/11/23 03:09:28| INFO mul_pacc finished [took 80.0201s] 04/11/23 03:09:31| INFO mul_sld finished [took 89.4295s] 04/11/23 03:09:55| INFO mul_pacc_gs finished [took 104.7292s] 04/11/23 03:12:25| INFO bin_sld finished [took 263.6824s] 04/11/23 03:12:25| INFO bin_pacc finished [took 258.6502s] 04/11/23 03:14:01| INFO mul_sld_gs finished [took 357.3344s] 04/11/23 03:14:14| INFO bin_sld_gsq finished [took 369.1636s] 04/11/23 03:14:22| INFO bin_pacc_gs finished [took 372.8646s] 04/11/23 03:18:40| INFO bin_sld_gs finished [took 636.9190s] 04/11/23 03:18:40| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 640.2322s] 04/11/23 03:18:40| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 04/11/23 03:18:46| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 03:19:58| INFO ref finished [took 65.9462s] 04/11/23 03:20:02| INFO atc_mc finished [took 68.5710s] 04/11/23 03:20:04| INFO atc_ne finished [took 68.9466s] 04/11/23 03:20:06| INFO mul_pacc finished [took 77.9039s] 04/11/23 03:20:06| INFO mul_sld finished [took 84.0917s] 04/11/23 03:20:37| INFO mul_pacc_gs finished [took 106.2536s] 04/11/23 03:23:04| INFO bin_pacc finished [took 257.4211s] 04/11/23 03:23:05| INFO bin_sld finished [took 264.3442s] 04/11/23 03:24:49| INFO mul_sld_gs finished [took 365.1691s] 04/11/23 03:25:01| INFO bin_pacc_gs finished [took 371.9184s] 04/11/23 03:25:02| INFO bin_sld_gsq finished [took 377.0442s] 04/11/23 03:29:37| INFO bin_sld_gs finished [took 654.0366s] 04/11/23 03:29:37| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 657.0840s] 04/11/23 03:29:37| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 04/11/23 03:29:42| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 03:30:51| INFO ref finished [took 62.7217s] 04/11/23 03:30:58| INFO atc_mc finished [took 67.8613s] 04/11/23 03:31:00| INFO atc_ne finished [took 68.5026s] 04/11/23 03:31:03| INFO mul_sld finished [took 83.8857s] 04/11/23 03:31:03| INFO mul_pacc finished [took 78.6340s] 04/11/23 03:31:30| INFO mul_pacc_gs finished [took 103.4683s] 04/11/23 03:34:00| INFO bin_sld finished [took 262.4457s] 04/11/23 03:34:02| INFO bin_pacc finished [took 258.2247s] 04/11/23 03:35:44| INFO mul_sld_gs finished [took 363.8135s] 04/11/23 03:35:58| INFO bin_pacc_gs finished [took 372.0485s] 04/11/23 03:36:05| INFO bin_sld_gsq finished [took 382.9585s] 04/11/23 03:40:39| INFO bin_sld_gs finished [took 659.6222s] 04/11/23 03:40:39| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 662.5763s] 04/11/23 03:40:39| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 04/11/23 03:40:45| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 03:41:56| INFO ref finished [took 64.5923s] 04/11/23 03:42:01| INFO atc_mc finished [took 68.0148s] 04/11/23 03:42:03| INFO atc_ne finished [took 68.3119s] 04/11/23 03:42:04| INFO mul_pacc finished [took 76.9397s] 04/11/23 03:42:07| INFO mul_sld finished [took 85.5363s] 04/11/23 03:42:34| INFO mul_pacc_gs finished [took 103.4448s] 04/11/23 03:45:01| INFO bin_sld finished [took 260.0814s] 04/11/23 03:45:03| INFO bin_pacc finished [took 256.9386s] 04/11/23 03:46:45| INFO mul_sld_gs finished [took 361.5910s] 04/11/23 03:47:01| INFO bin_pacc_gs finished [took 371.9657s] 04/11/23 03:47:13| INFO bin_sld_gsq finished [took 388.2498s] 04/11/23 03:51:40| INFO bin_sld_gs finished [took 657.4008s] 04/11/23 03:51:40| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 660.5115s] 04/11/23 03:51:40| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 04/11/23 03:51:46| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 03:52:54| INFO ref finished [took 61.9225s] 04/11/23 03:53:00| INFO atc_mc finished [took 66.3156s] 04/11/23 03:53:02| INFO atc_ne finished [took 66.5025s] 04/11/23 03:53:04| INFO mul_pacc finished [took 75.8808s] 04/11/23 03:53:06| INFO mul_sld finished [took 84.3204s] 04/11/23 03:53:33| INFO mul_pacc_gs finished [took 102.5763s] 04/11/23 03:56:04| INFO bin_sld finished [took 263.2781s] 04/11/23 03:56:04| INFO bin_pacc finished [took 257.7298s] 04/11/23 03:57:44| INFO mul_sld_gs finished [took 359.7910s] 04/11/23 03:58:00| INFO bin_pacc_gs finished [took 371.3848s] 04/11/23 03:58:11| INFO bin_sld_gsq finished [took 386.0904s] 04/11/23 04:02:50| INFO bin_sld_gs finished [took 667.6623s] 04/11/23 04:02:50| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 670.7255s] 04/11/23 04:02:50| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 04/11/23 04:02:57| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 04:04:05| INFO ref finished [took 62.3256s] 04/11/23 04:04:13| INFO atc_mc finished [took 68.9525s] 04/11/23 04:04:15| INFO atc_ne finished [took 68.8750s] 04/11/23 04:04:16| INFO mul_pacc finished [took 77.5049s] 04/11/23 04:04:19| INFO mul_sld finished [took 86.0694s] 04/11/23 04:04:45| INFO mul_pacc_gs finished [took 103.3513s] 04/11/23 04:07:15| INFO bin_pacc finished [took 257.6456s] 04/11/23 04:07:16| INFO bin_sld finished [took 263.9914s] 04/11/23 04:08:55| INFO mul_sld_gs finished [took 360.5634s] 04/11/23 04:09:12| INFO bin_pacc_gs finished [took 372.2665s] 04/11/23 04:09:18| INFO bin_sld_gsq finished [took 381.8311s] 04/11/23 04:13:39| INFO bin_sld_gs finished [took 645.3599s] 04/11/23 04:13:39| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 648.5328s] 04/11/23 04:13:39| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 04/11/23 04:13:45| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 04:14:51| INFO ref finished [took 59.8110s] 04/11/23 04:14:58| INFO atc_mc finished [took 65.2666s] 04/11/23 04:14:59| INFO atc_ne finished [took 64.5173s] 04/11/23 04:15:01| INFO mul_pacc finished [took 73.8332s] 04/11/23 04:15:04| INFO mul_sld finished [took 82.3509s] 04/11/23 04:15:29| INFO mul_pacc_gs finished [took 99.3541s] 04/11/23 04:18:00| INFO bin_pacc finished [took 254.3308s] 04/11/23 04:18:03| INFO bin_sld finished [took 262.3008s] 04/11/23 04:19:40| INFO mul_sld_gs finished [took 357.1229s] 04/11/23 04:19:57| INFO bin_pacc_gs finished [took 368.4516s] 04/11/23 04:20:03| INFO bin_sld_gsq finished [took 378.7658s] 04/11/23 04:24:37| INFO bin_sld_gs finished [took 655.1931s] 04/11/23 04:24:37| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 658.3505s] 04/11/23 04:24:37| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 04/11/23 04:24:43| WARNING Method mul_sld_gsq failed. Exception: MultiClassAccuracyEstimator.__init__() got an unexpected keyword argument 'param_grid' 04/11/23 04:25:49| INFO ref finished [took 59.4546s] 04/11/23 04:25:55| INFO atc_mc finished [took 63.5805s] 04/11/23 04:25:58| INFO atc_ne finished [took 63.2985s] 04/11/23 04:25:58| INFO mul_pacc finished [took 72.5198s] 04/11/23 04:26:11| INFO mul_sld finished [took 91.7136s] 04/11/23 04:26:27| INFO mul_pacc_gs finished [took 98.8722s] 04/11/23 04:28:57| INFO bin_pacc finished [took 252.8144s] 04/11/23 04:29:02| INFO bin_sld finished [took 263.8013s] 04/11/23 04:30:35| INFO mul_sld_gs finished [took 353.3693s] 04/11/23 04:30:51| INFO bin_sld_gsq finished [took 368.8564s] 04/11/23 04:30:54| INFO bin_pacc_gs finished [took 367.5592s] 04/11/23 04:35:11| INFO bin_sld_gs finished [took 630.6700s] 04/11/23 04:35:11| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 633.7494s] ---------------------------------------------------------------------------------------------------- 04/11/23 19:09:42| INFO dataset rcv1_CCAT_9prevs 04/11/23 19:09:47| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 19:10:28| INFO ref finished [took 36.0351s] 04/11/23 19:10:32| INFO atc_mc finished [took 38.9507s] 04/11/23 19:10:35| INFO mulmc_sld finished [took 43.7869s] 04/11/23 19:10:50| INFO mul_sld finished [took 60.8007s] 04/11/23 19:10:50| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 62.9600s] 04/11/23 19:10:50| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 19:11:29| INFO ref finished [took 36.3632s] 04/11/23 19:11:34| INFO atc_mc finished [took 39.5928s] 04/11/23 19:11:36| INFO mulmc_sld finished [took 44.2915s] 04/11/23 19:11:44| INFO mul_sld finished [took 52.6727s] 04/11/23 19:11:44| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 54.0362s] 04/11/23 19:11:44| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 04/11/23 19:12:24| INFO ref finished [took 36.4303s] 04/11/23 19:12:27| INFO atc_mc finished [took 39.2329s] 04/11/23 19:12:30| INFO mulmc_sld finished [took 43.6247s] 04/11/23 19:12:36| INFO mul_sld finished [took 50.2041s] 04/11/23 19:12:36| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 51.6412s] 04/11/23 19:12:36| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 04/11/23 19:13:16| INFO ref finished [took 36.7551s] 04/11/23 19:13:19| INFO atc_mc finished [took 39.2806s] 04/11/23 19:13:21| INFO mulmc_sld finished [took 43.6120s] 04/11/23 19:13:27| INFO mul_sld finished [took 50.4446s] 04/11/23 19:13:27| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 51.6672s] 04/11/23 19:13:27| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 04/11/23 19:14:07| INFO ref finished [took 35.8789s] 04/11/23 19:14:11| INFO atc_mc finished [took 39.2168s] 04/11/23 19:14:13| INFO mulmc_sld finished [took 43.4580s] 04/11/23 19:14:20| INFO mul_sld finished [took 51.2902s] 04/11/23 19:14:20| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 52.6303s] 04/11/23 19:14:20| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 04/11/23 19:15:00| INFO ref finished [took 36.3735s] 04/11/23 19:15:04| INFO atc_mc finished [took 39.7035s] 04/11/23 19:15:06| INFO mulmc_sld finished [took 43.6364s] 04/11/23 19:15:13| INFO mul_sld finished [took 52.0138s] 04/11/23 19:15:13| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 53.3303s] 04/11/23 19:15:13| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 04/11/23 19:15:54| INFO ref finished [took 37.3366s] 04/11/23 19:15:57| INFO atc_mc finished [took 39.8921s] 04/11/23 19:16:00| INFO mulmc_sld finished [took 44.5159s] 04/11/23 19:16:08| INFO mul_sld finished [took 53.0806s] 04/11/23 19:16:08| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 54.4117s] 04/11/23 19:16:08| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 04/11/23 19:16:47| INFO ref finished [took 35.7800s] 04/11/23 19:16:50| INFO atc_mc finished [took 38.4484s] 04/11/23 19:16:53| INFO mulmc_sld finished [took 42.7405s] 04/11/23 19:17:01| INFO mul_sld finished [took 51.5556s] 04/11/23 19:17:01| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 52.9684s] 04/11/23 19:17:01| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 04/11/23 19:17:39| INFO ref finished [took 35.0919s] 04/11/23 19:17:43| INFO atc_mc finished [took 38.1718s] 04/11/23 19:17:45| INFO mulmc_sld finished [took 42.4413s] 04/11/23 19:17:59| INFO mul_sld finished [took 57.0766s] 04/11/23 19:17:59| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 58.3668s] ---------------------------------------------------------------------------------------------------- 04/11/23 19:42:38| INFO dataset rcv1_CCAT_9prevs 04/11/23 19:42:43| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 19:43:27| INFO ref finished [took 38.7664s] 04/11/23 19:43:31| INFO atc_mc finished [took 42.4000s] 04/11/23 19:43:33| INFO mulmc_sld finished [took 47.0913s] 04/11/23 19:43:34| INFO binmc_sld finished [took 47.1675s] 04/11/23 19:43:49| INFO mul_sld finished [took 64.1382s] 04/11/23 19:46:00| INFO bin_sld finished [took 195.9822s] 04/11/23 19:46:00| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 197.2916s] 04/11/23 19:46:00| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 19:46:44| INFO ref finished [took 38.5976s] 04/11/23 19:46:48| INFO atc_mc finished [took 41.9465s] 04/11/23 19:46:49| INFO mulmc_sld finished [took 46.2205s] 04/11/23 19:46:51| INFO binmc_sld finished [took 46.7475s] 04/11/23 19:46:58| INFO mul_sld finished [took 56.3552s] 04/11/23 19:49:14| INFO bin_sld finished [took 193.2923s] 04/11/23 19:49:14| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 194.6251s] 04/11/23 19:49:14| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 04/11/23 19:49:58| INFO ref finished [took 38.3754s] 04/11/23 19:50:02| INFO atc_mc finished [took 41.0091s] 04/11/23 19:50:03| INFO mulmc_sld finished [took 45.6205s] 04/11/23 19:50:05| INFO binmc_sld finished [took 46.1852s] 04/11/23 19:50:10| INFO mul_sld finished [took 52.9704s] 04/11/23 19:52:27| INFO bin_sld finished [took 190.6101s] 04/11/23 19:52:27| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 192.0378s] 04/11/23 19:52:27| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 04/11/23 19:53:10| INFO ref finished [took 38.4467s] 04/11/23 19:53:13| INFO atc_mc finished [took 41.2602s] 04/11/23 19:53:15| INFO mulmc_sld finished [took 45.7496s] 04/11/23 19:53:16| INFO binmc_sld finished [took 45.5531s] 04/11/23 19:53:21| INFO mul_sld finished [took 52.5067s] 04/11/23 19:55:38| INFO bin_sld finished [took 190.7744s] 04/11/23 19:55:38| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 191.9715s] 04/11/23 19:55:39| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 04/11/23 19:56:21| INFO ref finished [took 37.9420s] 04/11/23 19:56:26| INFO atc_mc finished [took 41.2056s] 04/11/23 19:56:27| INFO mulmc_sld finished [took 45.7577s] 04/11/23 19:56:28| INFO binmc_sld finished [took 45.6411s] 04/11/23 19:56:34| INFO mul_sld finished [took 53.5219s] 04/11/23 19:58:51| INFO bin_sld finished [took 191.1772s] 04/11/23 19:58:51| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 192.4566s] 04/11/23 19:58:51| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 04/11/23 19:59:34| INFO ref finished [took 37.8604s] 04/11/23 19:59:38| INFO atc_mc finished [took 41.0334s] 04/11/23 19:59:39| INFO mulmc_sld finished [took 45.1999s] 04/11/23 19:59:40| INFO binmc_sld finished [took 45.4846s] 04/11/23 19:59:47| INFO mul_sld finished [took 54.3166s] 04/11/23 20:02:04| INFO bin_sld finished [took 191.4002s] 04/11/23 20:02:04| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 192.6275s] 04/11/23 20:02:04| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 04/11/23 20:02:48| INFO ref finished [took 38.8313s] 04/11/23 20:02:52| INFO atc_mc finished [took 42.1162s] 04/11/23 20:02:54| INFO mulmc_sld finished [took 47.0413s] 04/11/23 20:02:55| INFO binmc_sld finished [took 46.8891s] 04/11/23 20:03:02| INFO mul_sld finished [took 55.8821s] 04/11/23 20:05:19| INFO bin_sld finished [took 193.7571s] 04/11/23 20:05:19| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 195.2404s] 04/11/23 20:05:19| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 04/11/23 20:06:03| INFO ref finished [took 38.7982s] 04/11/23 20:06:06| INFO atc_mc finished [took 41.6213s] 04/11/23 20:06:08| INFO mulmc_sld finished [took 46.2646s] 04/11/23 20:06:09| INFO binmc_sld finished [took 46.2453s] 04/11/23 20:06:16| INFO mul_sld finished [took 54.8621s] 04/11/23 20:08:35| INFO bin_sld finished [took 194.5226s] 04/11/23 20:08:35| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 195.9251s] 04/11/23 20:08:35| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 04/11/23 20:09:18| INFO ref finished [took 38.3873s] 04/11/23 20:09:22| INFO atc_mc finished [took 41.2537s] 04/11/23 20:09:24| INFO mulmc_sld finished [took 46.2211s] 04/11/23 20:09:25| INFO binmc_sld finished [took 46.6421s] 04/11/23 20:09:38| INFO mul_sld finished [took 60.9539s] 04/11/23 20:11:51| INFO bin_sld finished [took 195.1888s] 04/11/23 20:11:51| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 196.4776s] ---------------------------------------------------------------------------------------------------- 04/11/23 20:56:32| INFO dataset rcv1_CCAT_9prevs 04/11/23 20:56:37| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 04/11/23 20:57:33| INFO ref finished [took 49.2697s] 04/11/23 20:57:38| INFO atc_mc finished [took 53.2068s] 04/11/23 20:57:39| INFO mulmc_sld finished [took 58.6224s] 04/11/23 20:58:59| INFO mulmc_sld_gs finished [took 136.0930s] 04/11/23 21:00:30| INFO binmc_sld finished [took 230.3290s] 04/11/23 21:02:12| INFO mul_sld_gs finished [took 333.4899s] 04/11/23 21:06:49| INFO bin_sld_gs finished [took 610.5751s] 04/11/23 21:06:54| INFO binmc_sld_gs finished [took 612.8900s] 04/11/23 21:06:55| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 617.6873s] 04/11/23 21:06:55| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 04/11/23 21:07:52| INFO ref finished [took 49.8077s] 04/11/23 21:07:56| INFO atc_mc finished [took 53.3303s] 04/11/23 21:07:57| INFO mulmc_sld finished [took 58.9345s] 04/11/23 21:09:17| INFO mulmc_sld_gs finished [took 136.5258s] 04/11/23 21:10:51| INFO binmc_sld finished [took 233.4049s] 04/11/23 21:12:35| INFO mul_sld_gs finished [took 338.2751s] 04/11/23 21:17:38| INFO bin_sld_gs finished [took 641.8524s] 04/11/23 21:18:19| INFO binmc_sld_gs finished [took 679.9471s] 04/11/23 21:18:19| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 684.7098s] 04/11/23 21:18:19| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 04/11/23 21:19:24| INFO ref finished [took 55.3767s] 04/11/23 21:19:28| INFO mulmc_sld finished [took 64.2789s] 04/11/23 21:19:29| INFO atc_mc finished [took 59.5610s] 04/11/23 21:20:57| INFO mulmc_sld_gs finished [took 150.1392s] 04/11/23 21:22:36| INFO binmc_sld finished [took 253.0960s] 04/11/23 21:24:16| INFO mul_sld_gs finished [took 354.6283s] 04/11/23 21:29:15| INFO bin_sld_gs finished [took 654.3325s] 04/11/23 21:29:50| INFO binmc_sld_gs finished [took 684.5074s] 04/11/23 21:29:50| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 690.4897s] 04/11/23 21:29:50| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 04/11/23 21:30:45| INFO ref finished [took 48.2647s] 04/11/23 21:30:51| INFO atc_mc finished [took 52.2724s] 04/11/23 21:30:51| INFO mulmc_sld finished [took 57.5142s] 04/11/23 21:32:07| INFO mulmc_sld_gs finished [took 131.4908s] 04/11/23 21:33:38| INFO binmc_sld finished [took 224.9620s] 04/11/23 21:35:22| INFO mul_sld_gs finished [took 329.9053s] 04/11/23 21:40:25| INFO bin_sld_gs finished [took 634.4342s] 04/11/23 21:41:08| INFO binmc_sld_gs finished [took 673.6071s] 04/11/23 21:41:08| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 678.4725s] 04/11/23 21:41:08| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 04/11/23 21:42:03| INFO ref finished [took 47.4381s] 04/11/23 21:42:08| INFO atc_mc finished [took 51.3566s] 04/11/23 21:42:09| INFO mulmc_sld finished [took 56.6180s] 04/11/23 21:43:23| INFO mulmc_sld_gs finished [took 128.6413s] 04/11/23 21:44:54| INFO binmc_sld finished [took 222.7951s] 04/11/23 21:46:39| INFO mul_sld_gs finished [took 328.8118s] 04/11/23 21:51:37| INFO bin_sld_gs finished [took 627.4937s] 04/11/23 21:52:17| INFO binmc_sld_gs finished [took 663.8116s] 04/11/23 21:52:17| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 668.8948s] 04/11/23 21:52:17| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 04/11/23 21:53:12| INFO ref finished [took 47.6269s] 04/11/23 21:53:16| INFO atc_mc finished [took 51.1109s] 04/11/23 21:53:17| INFO mulmc_sld finished [took 56.5728s] 04/11/23 21:54:31| INFO mulmc_sld_gs finished [took 128.0358s] 04/11/23 21:56:00| INFO binmc_sld finished [took 220.0811s] 04/11/23 21:57:46| INFO mul_sld_gs finished [took 327.0856s] 04/11/23 22:02:58| INFO bin_sld_gs finished [took 639.3432s] 04/11/23 22:03:48| INFO binmc_sld_gs finished [took 686.2326s] 04/11/23 22:03:48| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 690.9677s] 04/11/23 22:03:48| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 04/11/23 22:04:42| INFO ref finished [took 47.2804s] 04/11/23 22:04:48| INFO atc_mc finished [took 51.6888s] 04/11/23 22:04:48| INFO mulmc_sld finished [took 56.1465s] 04/11/23 22:06:06| INFO mulmc_sld_gs finished [took 132.4278s] 04/11/23 22:07:33| INFO binmc_sld finished [took 221.9299s] 04/11/23 22:09:19| INFO mul_sld_gs finished [took 329.1446s] 04/11/23 22:14:09| INFO bin_sld_gs finished [took 619.3584s] 04/11/23 22:14:32| INFO binmc_sld_gs finished [took 638.7326s] 04/11/23 22:14:32| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 643.6278s] 04/11/23 22:14:32| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 04/11/23 22:15:26| INFO ref finished [took 47.3139s] 04/11/23 22:15:30| INFO atc_mc finished [took 50.8602s] 04/11/23 22:15:32| INFO mulmc_sld finished [took 56.5107s] 04/11/23 22:16:47| INFO mulmc_sld_gs finished [took 129.5292s] 04/11/23 22:18:22| INFO binmc_sld finished [took 226.9238s] 04/11/23 22:20:02| INFO mul_sld_gs finished [took 327.7014s] 04/11/23 22:24:57| INFO bin_sld_gs finished [took 624.4254s] 04/11/23 22:25:13| INFO binmc_sld_gs finished [took 636.2675s] 04/11/23 22:25:13| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 641.0382s] 04/11/23 22:25:13| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 04/11/23 22:26:07| INFO ref finished [took 47.3224s] 04/11/23 22:26:12| INFO atc_mc finished [took 51.1828s] 04/11/23 22:26:13| INFO mulmc_sld finished [took 56.6133s] 04/11/23 22:27:30| INFO mulmc_sld_gs finished [took 131.3662s] 04/11/23 22:29:05| INFO binmc_sld finished [took 229.3002s] 04/11/23 22:30:38| INFO mul_sld_gs finished [took 323.5271s] 04/11/23 22:35:21| INFO bin_sld_gs finished [took 606.6430s] 04/11/23 22:35:30| INFO binmc_sld_gs finished [took 612.5966s] 04/11/23 22:35:30| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 617.3109s] ---------------------------------------------------------------------------------------------------- 04/11/23 22:49:37| ERROR Evaluation over rcv1_CCAT_3prevs failed. Exception: 'Invalid estimator: estimator binmc_sld_gs does not exist' 04/11/23 22:49:37| ERROR Failed while saving configuration rcv1_CCAT_debug of rcv1_CCAT_3prevs. Exception: cannot access local variable 'dr' where it is not associated with a value ---------------------------------------------------------------------------------------------------- 04/11/23 22:50:07| INFO dataset rcv1_CCAT_3prevs 04/11/23 22:50:12| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started ---------------------------------------------------------------------------------------------------- 04/11/23 22:55:55| INFO dataset rcv1_CCAT_3prevs 04/11/23 22:55:59| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 22:56:48| INFO ref finished [took 44.4275s] ---------------------------------------------------------------------------------------------------- 04/11/23 22:56:59| INFO dataset rcv1_CCAT_3prevs 04/11/23 22:57:03| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 22:57:09| WARNING Method mul_sld_gs failed. Exception: '>=' not supported between instances of 'TypeError' and 'int' 04/11/23 22:57:17| WARNING Method bin_sld_gs failed. Exception: '>=' not supported between instances of 'TypeError' and 'int' ---------------------------------------------------------------------------------------------------- 04/11/23 22:58:04| INFO dataset rcv1_CCAT_3prevs 04/11/23 22:58:09| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 22:58:58| INFO ref finished [took 43.7541s] 04/11/23 22:59:05| INFO atc_mc finished [took 50.0628s] ---------------------------------------------------------------------------------------------------- 04/11/23 23:01:22| INFO dataset rcv1_CCAT_3prevs 04/11/23 23:01:27| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 23:02:16| INFO ref finished [took 43.9765s] 04/11/23 23:02:23| INFO atc_mc finished [took 50.5568s] ---------------------------------------------------------------------------------------------------- 04/11/23 23:09:33| INFO dataset rcv1_CCAT_3prevs 04/11/23 23:09:37| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 23:09:38| WARNING Method binmc_sld failed. Exception: classifier and pred_proba cannot be both None 04/11/23 23:09:39| WARNING Method mulmc_sld failed. Exception: classifier and pred_proba cannot be both None 04/11/23 23:09:40| WARNING Method bin_sld_gs failed. Exception: no combination of hyperparameters seem to work 04/11/23 23:09:41| WARNING Method mul_sld_gs failed. Exception: no combination of hyperparameters seem to work ---------------------------------------------------------------------------------------------------- 04/11/23 23:10:23| INFO dataset rcv1_CCAT_3prevs 04/11/23 23:10:28| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 23:11:15| INFO ref finished [took 42.4887s] 04/11/23 23:11:20| INFO atc_mc finished [took 45.6262s] 04/11/23 23:11:21| INFO mulmc_sld finished [took 50.9790s] 04/11/23 23:13:57| INFO binmc_sld finished [took 208.3159s] ---------------------------------------------------------------------------------------------------- 04/11/23 23:16:22| INFO dataset rcv1_CCAT_3prevs 04/11/23 23:16:26| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started 04/11/23 23:17:12| INFO ref finished [took 40.5978s] 04/11/23 23:17:16| INFO atc_mc finished [took 43.6933s] 04/11/23 23:17:17| INFO mulmc_sld finished [took 49.0808s] 04/11/23 23:19:53| INFO binmc_sld finished [took 205.5731s] 04/11/23 23:22:24| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00672) [took 354.1411s] 04/11/23 23:23:05| INFO mul_sld_gs finished [took 394.8240s] 04/11/23 23:30:41| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00891) [took 852.1465s] 04/11/23 23:33:44| INFO bin_sld_gs finished [took 1035.2071s] 04/11/23 23:33:44| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs finished [took 1038.1845s] 04/11/23 23:33:44| INFO Dataset sample 0.50 of dataset rcv1_CCAT_3prevs started 04/11/23 23:34:33| INFO ref finished [took 43.6409s] 04/11/23 23:34:37| INFO atc_mc finished [took 46.7818s] 04/11/23 23:34:38| INFO mulmc_sld finished [took 51.3459s] 04/11/23 23:37:15| INFO binmc_sld finished [took 209.5746s] 04/11/23 23:39:48| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00553) [took 359.3210s] 04/11/23 23:40:28| INFO mul_sld_gs finished [took 399.5320s] 04/11/23 23:48:02| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': None} (score=0.01058) [took 855.1289s] 04/11/23 23:51:06| INFO bin_sld_gs finished [took 1038.6344s] 04/11/23 23:51:06| INFO Dataset sample 0.50 of dataset rcv1_CCAT_3prevs finished [took 1041.6478s] 04/11/23 23:51:06| INFO Dataset sample 0.60 of dataset rcv1_CCAT_3prevs started 04/11/23 23:51:51| INFO ref finished [took 40.0694s] 04/11/23 23:51:55| INFO atc_mc finished [took 42.4882s] 04/11/23 23:51:56| INFO mulmc_sld finished [took 47.7936s] 04/11/23 23:54:29| INFO binmc_sld finished [took 201.3777s] 04/11/23 23:57:03| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00429) [took 352.7820s] 04/11/23 23:57:43| INFO mul_sld_gs finished [took 392.5201s] 05/11/23 00:05:21| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': None} (score=0.00552) [took 851.9361s] 05/11/23 00:08:24| INFO bin_sld_gs finished [took 1034.7353s] 05/11/23 00:08:24| INFO Dataset sample 0.60 of dataset rcv1_CCAT_3prevs finished [took 1037.8033s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:11:07| INFO dataset rcv1_CCAT_3prevs 05/11/23 00:11:12| INFO Dataset sample 0.40 of dataset rcv1_CCAT_3prevs started ---------------------------------------------------------------------------------------------------- 05/11/23 00:28:39| INFO dataset imdb_3prevs 05/11/23 00:28:46| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 00:28:55| INFO ref finished [took 8.7347s] 05/11/23 00:28:58| INFO atc_mc finished [took 11.6376s] 05/11/23 00:28:59| INFO mulmc_sld finished [took 13.5476s] 05/11/23 00:28:59| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 13.9513s] 05/11/23 00:28:59| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 00:29:09| INFO ref finished [took 8.7049s] 05/11/23 00:29:12| INFO atc_mc finished [took 11.6170s] 05/11/23 00:29:14| INFO mulmc_sld finished [took 13.7416s] 05/11/23 00:29:14| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 14.2842s] 05/11/23 00:29:14| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 00:29:23| INFO ref finished [took 8.6894s] 05/11/23 00:29:26| INFO atc_mc finished [took 11.5275s] 05/11/23 00:29:28| INFO mulmc_sld finished [took 13.6977s] 05/11/23 00:29:28| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 14.2742s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:34:12| INFO dataset imdb_3prevs 05/11/23 00:34:22| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 00:34:41| INFO ref finished [took 17.6558s] 05/11/23 00:34:46| INFO mulmc_sld finished [took 22.9646s] 05/11/23 00:34:48| INFO atc_mc finished [took 24.5871s] 05/11/23 00:34:48| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 25.3179s] 05/11/23 00:34:48| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 00:35:05| INFO ref finished [took 17.2188s] 05/11/23 00:35:10| INFO mulmc_sld finished [took 22.2420s] 05/11/23 00:35:12| INFO atc_mc finished [took 23.9752s] 05/11/23 00:35:12| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 24.7688s] 05/11/23 00:35:12| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 00:35:33| INFO ref finished [took 20.0731s] 05/11/23 00:35:38| INFO mulmc_sld finished [took 24.8736s] 05/11/23 00:35:40| INFO atc_mc finished [took 27.0318s] 05/11/23 00:35:40| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 27.8108s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:39:57| INFO dataset imdb_1prevs 05/11/23 00:40:07| INFO Dataset sample 0.50 of dataset imdb_1prevs started 05/11/23 00:40:26| INFO ref finished [took 17.4863s] 05/11/23 00:40:31| INFO mulmc_sld finished [took 22.5384s] 05/11/23 00:40:33| INFO atc_mc finished [took 24.2747s] 05/11/23 00:40:33| INFO Dataset sample 0.50 of dataset imdb_1prevs finished [took 25.6430s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:41:36| INFO dataset imdb_2prevs 05/11/23 00:41:46| INFO Dataset sample 0.20 of dataset imdb_2prevs started 05/11/23 00:42:05| INFO ref finished [took 17.6637s] 05/11/23 00:42:10| INFO mulmc_sld finished [took 22.6956s] 05/11/23 00:42:11| INFO atc_mc finished [took 24.3529s] 05/11/23 00:42:11| INFO Dataset sample 0.20 of dataset imdb_2prevs finished [took 25.0708s] 05/11/23 00:42:11| INFO Dataset sample 0.80 of dataset imdb_2prevs started 05/11/23 00:42:29| INFO ref finished [took 17.2818s] 05/11/23 00:42:34| INFO mulmc_sld finished [took 22.4054s] 05/11/23 00:42:36| INFO atc_mc finished [took 23.9392s] 05/11/23 00:42:36| INFO Dataset sample 0.80 of dataset imdb_2prevs finished [took 24.7193s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:45:54| INFO dataset imdb_2prevs 05/11/23 00:46:04| INFO Dataset sample 0.20 of dataset imdb_2prevs started 05/11/23 00:46:22| INFO ref finished [took 17.2217s] 05/11/23 00:46:27| INFO mulmc_sld finished [took 22.2712s] 05/11/23 00:46:28| INFO atc_mc finished [took 23.7770s] 05/11/23 00:46:28| INFO Dataset sample 0.20 of dataset imdb_2prevs finished [took 24.5092s] 05/11/23 00:46:28| INFO Dataset sample 0.80 of dataset imdb_2prevs started 05/11/23 00:46:46| INFO ref finished [took 17.1303s] 05/11/23 00:46:51| INFO mulmc_sld finished [took 22.5084s] 05/11/23 00:46:53| INFO atc_mc finished [took 23.9160s] 05/11/23 00:46:53| INFO Dataset sample 0.80 of dataset imdb_2prevs finished [took 24.6992s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:51:06| INFO dataset imdb_2prevs 05/11/23 00:51:16| INFO Dataset sample 0.20 of dataset imdb_2prevs started 05/11/23 00:51:33| INFO ref finished [took 17.0670s] 05/11/23 00:51:38| INFO mulmc_sld finished [took 22.3141s] 05/11/23 00:51:40| INFO atc_mc finished [took 23.7219s] 05/11/23 00:51:40| INFO Dataset sample 0.20 of dataset imdb_2prevs finished [took 24.4385s] 05/11/23 00:51:40| INFO Dataset sample 0.80 of dataset imdb_2prevs started 05/11/23 00:51:58| INFO ref finished [took 17.1894s] 05/11/23 00:52:03| INFO mulmc_sld finished [took 22.4247s] 05/11/23 00:52:04| INFO atc_mc finished [took 23.6032s] 05/11/23 00:52:04| INFO Dataset sample 0.80 of dataset imdb_2prevs finished [took 24.3674s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:53:32| INFO dataset imdb_3prevs 05/11/23 00:53:39| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 00:53:48| INFO ref finished [took 8.8062s] 05/11/23 00:53:51| INFO atc_mc finished [took 11.7173s] 05/11/23 00:53:53| INFO mulmc_sld finished [took 13.8761s] 05/11/23 00:53:53| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 14.3147s] 05/11/23 00:53:53| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 00:54:03| INFO ref finished [took 8.9071s] 05/11/23 00:54:06| INFO atc_mc finished [took 11.7005s] 05/11/23 00:54:08| INFO mulmc_sld finished [took 13.6266s] 05/11/23 00:54:08| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 14.1625s] 05/11/23 00:54:08| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 00:54:17| INFO ref finished [took 8.7680s] 05/11/23 00:54:20| INFO atc_mc finished [took 11.4957s] 05/11/23 00:54:22| INFO mulmc_sld finished [took 13.5719s] 05/11/23 00:54:22| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 14.1564s] ---------------------------------------------------------------------------------------------------- 05/11/23 00:57:53| INFO dataset imdb_3prevs 05/11/23 00:57:59| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 00:58:08| INFO ref finished [took 8.7497s] 05/11/23 00:58:12| INFO atc_mc finished [took 11.6903s] 05/11/23 00:58:13| INFO mulmc_sld finished [took 13.6731s] 05/11/23 00:58:13| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 14.1073s] 05/11/23 00:58:13| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 00:58:23| INFO ref finished [took 8.7718s] 05/11/23 00:58:26| INFO atc_mc finished [took 11.7653s] 05/11/23 00:58:28| INFO mulmc_sld finished [took 13.9184s] 05/11/23 00:58:28| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 14.4270s] 05/11/23 00:58:28| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 00:58:37| INFO ref finished [took 8.8129s] 05/11/23 00:58:40| INFO atc_mc finished [took 11.7267s] 05/11/23 00:58:42| INFO mulmc_sld finished [took 13.6726s] 05/11/23 00:58:42| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 14.2387s] ---------------------------------------------------------------------------------------------------- 05/11/23 01:04:04| INFO dataset imdb_3prevs 05/11/23 01:04:10| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 01:04:20| INFO ref finished [took 8.7879s] 05/11/23 01:04:23| INFO atc_mc finished [took 11.8757s] 05/11/23 01:04:25| INFO mulmc_sld finished [took 13.8698s] 05/11/23 01:04:25| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 14.2927s] 05/11/23 01:04:25| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 01:04:34| INFO ref finished [took 8.9200s] 05/11/23 01:04:37| INFO atc_mc finished [took 11.9555s] 05/11/23 01:04:39| INFO mulmc_sld finished [took 13.9860s] 05/11/23 01:04:39| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 14.5339s] 05/11/23 01:04:39| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 01:04:49| INFO ref finished [took 8.8757s] 05/11/23 01:04:52| INFO atc_mc finished [took 11.8222s] 05/11/23 01:04:53| INFO mulmc_sld finished [took 13.7034s] 05/11/23 01:04:53| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 14.2710s] ---------------------------------------------------------------------------------------------------- 05/11/23 01:08:05| INFO dataset rcv1_CCAT_9prevs 05/11/23 01:08:09| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 01:08:55| INFO ref finished [took 40.9427s] 05/11/23 01:09:00| INFO atc_mc finished [took 44.2152s] 05/11/23 01:09:01| INFO mulmc_sld finished [took 49.6089s] 05/11/23 01:11:38| INFO bin_sld finished [took 207.5917s] 05/11/23 01:13:47| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.00663) [took 333.7044s] 05/11/23 01:14:30| INFO mul_sld_gs finished [took 376.3503s] 05/11/23 01:20:44| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.00619) [took 751.2730s] 05/11/23 01:23:45| INFO bin_sld_gs finished [took 932.2941s] 05/11/23 01:23:45| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 935.3228s] 05/11/23 01:23:45| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 01:24:30| INFO ref finished [took 39.9821s] 05/11/23 01:24:34| INFO atc_mc finished [took 43.3585s] 05/11/23 01:24:36| INFO mulmc_sld finished [took 48.6404s] 05/11/23 01:27:08| INFO bin_sld finished [took 202.3970s] 05/11/23 01:29:17| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00699) [took 328.6883s] 05/11/23 01:30:00| INFO mul_sld_gs finished [took 371.2150s] 05/11/23 01:36:40| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.00780) [took 771.8150s] 05/11/23 01:39:44| INFO bin_sld_gs finished [took 956.5831s] 05/11/23 01:39:44| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 959.5214s] 05/11/23 01:39:44| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 01:40:38| INFO ref finished [took 46.9727s] 05/11/23 01:40:42| INFO atc_mc finished [took 49.6456s] 05/11/23 01:40:43| INFO mulmc_sld finished [took 55.1784s] 05/11/23 01:43:16| INFO bin_sld finished [took 209.5653s] 05/11/23 01:45:30| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00720) [took 340.0613s] 05/11/23 01:46:09| INFO mul_sld_gs finished [took 379.3695s] 05/11/23 01:53:22| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00810) [took 813.3118s] 05/11/23 01:56:25| INFO bin_sld_gs finished [took 996.4380s] 05/11/23 01:56:25| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 1000.8297s] 05/11/23 01:56:25| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 01:57:11| INFO ref finished [took 40.2515s] 05/11/23 01:57:15| INFO atc_mc finished [took 43.5348s] 05/11/23 01:57:15| INFO mulmc_sld finished [took 48.1622s] 05/11/23 01:59:46| INFO bin_sld finished [took 200.0955s] 05/11/23 02:02:00| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00644) [took 331.2368s] 05/11/23 02:02:40| INFO mul_sld_gs finished [took 370.8879s] 05/11/23 02:10:02| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': None} (score=0.01269) [took 813.7272s] 05/11/23 02:13:04| INFO bin_sld_gs finished [took 995.6098s] 05/11/23 02:13:04| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 998.5647s] 05/11/23 02:13:04| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 02:13:50| INFO ref finished [took 41.4181s] 05/11/23 02:13:55| INFO atc_mc finished [took 44.8414s] 05/11/23 02:13:55| INFO mulmc_sld finished [took 49.5767s] 05/11/23 02:16:27| INFO bin_sld finished [took 201.8696s] 05/11/23 02:18:33| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00636) [took 325.5401s] 05/11/23 02:19:17| INFO mul_sld_gs finished [took 368.9682s] 05/11/23 02:26:26| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.00670) [took 799.7618s] 05/11/23 02:29:29| INFO bin_sld_gs finished [took 982.2921s] 05/11/23 02:29:29| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 985.2925s] 05/11/23 02:29:29| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 02:30:14| INFO ref finished [took 40.3341s] 05/11/23 02:30:18| INFO atc_mc finished [took 43.3032s] 05/11/23 02:30:19| INFO mulmc_sld finished [took 47.8507s] 05/11/23 02:32:51| INFO bin_sld finished [took 200.9647s] 05/11/23 02:34:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00596) [took 321.5172s] 05/11/23 02:35:33| INFO mul_sld_gs finished [took 360.5222s] 05/11/23 02:43:22| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': None} (score=0.00544) [took 829.7314s] 05/11/23 02:46:23| INFO bin_sld_gs finished [took 1011.3917s] 05/11/23 02:46:23| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 1014.2514s] 05/11/23 02:46:23| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 02:47:09| INFO ref finished [took 40.4272s] 05/11/23 02:47:13| INFO atc_mc finished [took 43.8966s] 05/11/23 02:47:14| INFO mulmc_sld finished [took 48.4437s] 05/11/23 02:49:47| INFO bin_sld finished [took 202.6013s] 05/11/23 02:51:57| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00653) [took 329.4236s] 05/11/23 02:52:36| INFO mul_sld_gs finished [took 368.7426s] 05/11/23 02:59:51| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.01370) [took 804.3215s] 05/11/23 03:02:54| INFO bin_sld_gs finished [took 987.5377s] 05/11/23 03:02:54| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 990.4607s] 05/11/23 03:02:54| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 03:03:40| INFO ref finished [took 41.5104s] 05/11/23 03:03:44| INFO atc_mc finished [took 44.1770s] 05/11/23 03:03:46| INFO mulmc_sld finished [took 49.7176s] 05/11/23 03:06:27| INFO bin_sld finished [took 211.4985s] 05/11/23 03:08:32| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00822) [took 334.7029s] 05/11/23 03:09:16| INFO mul_sld_gs finished [took 377.8219s] 05/11/23 03:16:22| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.00984) [took 805.4146s] 05/11/23 03:19:28| INFO bin_sld_gs finished [took 991.0520s] 05/11/23 03:19:28| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 994.1016s] 05/11/23 03:19:28| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 03:20:18| INFO ref finished [took 44.1663s] 05/11/23 03:20:22| INFO atc_mc finished [took 47.3231s] 05/11/23 03:20:23| INFO mulmc_sld finished [took 53.1243s] 05/11/23 03:23:10| INFO bin_sld finished [took 220.4921s] 05/11/23 03:25:11| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00811) [took 338.9143s] 05/11/23 03:25:56| INFO mul_sld_gs finished [took 383.9350s] 05/11/23 03:32:44| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': None} (score=0.00954) [took 792.6190s] 05/11/23 03:35:44| INFO bin_sld_gs finished [took 973.2397s] 05/11/23 03:35:44| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 976.4502s] 05/11/23 03:35:57| INFO dataset imbd_9prevs 05/11/23 03:35:57| ERROR Evaluation over imbd_9prevs failed. Exception: 'imbd' ---------------------------------------------------------------------------------------------------- 05/11/23 09:42:24| INFO dataset imdb_9prevs 05/11/23 09:42:30| INFO Dataset sample 0.10 of dataset imdb_9prevs started 05/11/23 09:42:44| INFO ref finished [took 10.6450s] 05/11/23 09:42:47| INFO atc_mc finished [took 13.9369s] 05/11/23 09:42:49| INFO mulmc_sld finished [took 16.6526s] 05/11/23 09:42:56| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 05/11/23 09:45:26| INFO bin_sld finished [took 173.8798s] 05/11/23 09:47:18| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': None} (score=0.03792) [took 285.1339s] 05/11/23 09:47:33| INFO mul_sld_gs finished [took 300.3243s] 05/11/23 09:47:33| INFO Dataset sample 0.10 of dataset imdb_9prevs finished [took 302.7180s] 05/11/23 09:47:33| INFO Dataset sample 0.20 of dataset imdb_9prevs started 05/11/23 09:47:46| INFO ref finished [took 12.0501s] 05/11/23 09:47:50| INFO atc_mc finished [took 15.0907s] 05/11/23 09:47:52| INFO mulmc_sld finished [took 17.8502s] 05/11/23 09:50:42| INFO bin_sld finished [took 188.2533s] 05/11/23 09:53:03| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.01067) [took 328.6088s] 05/11/23 09:53:19| INFO mul_sld_gs finished [took 345.1926s] 05/11/23 10:00:52| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00923) [took 798.1316s] 05/11/23 10:03:34| INFO bin_sld_gs finished [took 960.1696s] 05/11/23 10:03:34| INFO Dataset sample 0.20 of dataset imdb_9prevs finished [took 960.9823s] 05/11/23 10:03:34| INFO Dataset sample 0.30 of dataset imdb_9prevs started 05/11/23 10:03:46| INFO ref finished [took 10.8585s] 05/11/23 10:03:49| INFO atc_mc finished [took 13.6836s] 05/11/23 10:03:51| INFO mulmc_sld finished [took 15.8085s] 05/11/23 10:06:39| INFO bin_sld finished [took 183.7435s] 05/11/23 10:09:02| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00707) [took 326.5308s] 05/11/23 10:09:15| INFO mul_sld_gs finished [took 339.3412s] 05/11/23 10:16:51| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.01094) [took 796.0895s] 05/11/23 10:19:27| INFO bin_sld_gs finished [took 952.0793s] 05/11/23 10:19:27| INFO Dataset sample 0.30 of dataset imdb_9prevs finished [took 953.0580s] 05/11/23 10:19:27| INFO Dataset sample 0.40 of dataset imdb_9prevs started 05/11/23 10:19:39| INFO ref finished [took 10.8707s] 05/11/23 10:19:42| INFO atc_mc finished [took 13.9089s] 05/11/23 10:19:44| INFO mulmc_sld finished [took 15.9994s] 05/11/23 10:22:17| INFO bin_sld finished [took 168.9998s] 05/11/23 10:24:35| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00999) [took 306.5297s] 05/11/23 10:24:47| INFO mul_sld_gs finished [took 318.6584s] 05/11/23 10:32:31| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': None} (score=0.01176) [took 782.7189s] 05/11/23 10:35:07| INFO bin_sld_gs finished [took 939.3830s] 05/11/23 10:35:07| INFO Dataset sample 0.40 of dataset imdb_9prevs finished [took 940.2365s] 05/11/23 10:35:07| INFO Dataset sample 0.50 of dataset imdb_9prevs started 05/11/23 10:35:19| INFO ref finished [took 10.1160s] 05/11/23 10:35:22| INFO atc_mc finished [took 13.6292s] 05/11/23 10:35:24| INFO mulmc_sld finished [took 15.7949s] 05/11/23 10:38:04| INFO bin_sld finished [took 176.0746s] 05/11/23 10:40:28| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.01008) [took 319.8045s] 05/11/23 10:40:45| INFO mul_sld_gs finished [took 336.8792s] 05/11/23 10:48:31| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00942) [took 802.9266s] 05/11/23 10:51:09| INFO bin_sld_gs finished [took 961.0002s] 05/11/23 10:51:09| INFO Dataset sample 0.50 of dataset imdb_9prevs finished [took 961.8311s] 05/11/23 10:51:09| INFO Dataset sample 0.60 of dataset imdb_9prevs started 05/11/23 10:51:21| INFO ref finished [took 10.7059s] 05/11/23 10:51:24| INFO atc_mc finished [took 13.8934s] 05/11/23 10:51:26| INFO mulmc_sld finished [took 16.0295s] 05/11/23 10:54:09| INFO bin_sld finished [took 179.1806s] 05/11/23 10:56:31| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00906) [took 320.5350s] 05/11/23 10:56:45| INFO mul_sld_gs finished [took 334.5485s] 05/11/23 11:04:55| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': None} (score=0.01228) [took 824.5702s] 05/11/23 11:07:33| INFO bin_sld_gs finished [took 983.3806s] 05/11/23 11:07:33| INFO Dataset sample 0.60 of dataset imdb_9prevs finished [took 984.1981s] 05/11/23 11:07:34| INFO Dataset sample 0.70 of dataset imdb_9prevs started 05/11/23 11:07:45| INFO ref finished [took 10.7034s] 05/11/23 11:07:49| INFO atc_mc finished [took 14.0668s] 05/11/23 11:07:51| INFO mulmc_sld finished [took 16.2499s] ---------------------------------------------------------------------------------------------------- 05/11/23 11:09:19| INFO dataset rcv1_CCAT_9prevs 05/11/23 11:09:24| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started ---------------------------------------------------------------------------------------------------- 05/11/23 11:10:40| INFO dataset rcv1_CCAT_9prevs 05/11/23 11:10:44| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 11:11:21| INFO ref finished [took 34.7944s] 05/11/23 11:11:25| INFO atc_mc finished [took 37.6168s] 05/11/23 11:11:36| INFO mulmc_sld finished [took 51.0883s] 05/11/23 11:11:36| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 52.3442s] 05/11/23 11:11:36| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 11:12:14| INFO ref finished [took 35.0033s] 05/11/23 11:12:17| INFO atc_mc finished [took 37.7761s] 05/11/23 11:12:24| INFO mulmc_sld finished [took 46.2195s] 05/11/23 11:12:24| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 47.5446s] 05/11/23 11:12:24| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 11:13:01| INFO ref finished [took 35.1077s] 05/11/23 11:13:05| INFO atc_mc finished [took 37.7889s] 05/11/23 11:13:12| INFO mulmc_sld finished [took 46.6515s] 05/11/23 11:13:12| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 48.0359s] 05/11/23 11:13:12| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 11:13:49| INFO ref finished [took 35.0214s] 05/11/23 11:13:53| INFO atc_mc finished [took 37.9480s] 05/11/23 11:14:00| INFO mulmc_sld finished [took 46.4140s] 05/11/23 11:14:00| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 47.5164s] 05/11/23 11:14:00| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 11:14:37| INFO ref finished [took 35.2699s] 05/11/23 11:14:41| INFO atc_mc finished [took 37.9490s] 05/11/23 11:14:49| INFO mulmc_sld finished [took 47.7005s] 05/11/23 11:14:49| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 49.0189s] 05/11/23 11:14:49| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 11:15:26| INFO ref finished [took 35.2350s] 05/11/23 11:15:30| INFO atc_mc finished [took 38.6364s] 05/11/23 11:15:39| INFO mulmc_sld finished [took 48.8860s] 05/11/23 11:15:39| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 50.1097s] 05/11/23 11:15:39| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 11:16:16| INFO ref finished [took 35.0322s] 05/11/23 11:16:20| INFO atc_mc finished [took 38.4809s] 05/11/23 11:16:29| INFO mulmc_sld finished [took 48.6466s] 05/11/23 11:16:29| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 50.0372s] 05/11/23 11:16:29| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 11:17:06| INFO ref finished [took 35.2988s] 05/11/23 11:17:10| INFO atc_mc finished [took 38.3390s] 05/11/23 11:17:18| INFO mulmc_sld finished [took 47.8829s] 05/11/23 11:17:18| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 49.2700s] 05/11/23 11:17:18| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 11:17:56| INFO ref finished [took 35.2614s] 05/11/23 11:17:59| INFO atc_mc finished [took 38.1131s] 05/11/23 11:18:08| INFO mulmc_sld finished [took 49.0925s] 05/11/23 11:18:09| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 50.4765s] ---------------------------------------------------------------------------------------------------- 05/11/23 11:26:35| INFO dataset rcv1_CCAT_9prevs 05/11/23 11:26:39| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 11:27:17| INFO ref finished [took 35.3305s] 05/11/23 11:27:21| INFO atc_mc finished [took 37.9469s] 05/11/23 11:27:28| INFO mulmc_sld finished [took 46.9769s] 05/11/23 11:27:28| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 48.3022s] 05/11/23 11:27:28| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 11:28:05| INFO ref finished [took 35.2459s] 05/11/23 11:28:09| INFO atc_mc finished [took 38.1660s] 05/11/23 11:28:15| INFO mulmc_sld finished [took 46.3832s] 05/11/23 11:28:15| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 47.7328s] 05/11/23 11:28:15| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 11:28:53| INFO ref finished [took 35.4919s] 05/11/23 11:28:57| INFO atc_mc finished [took 38.1023s] 05/11/23 11:29:03| INFO mulmc_sld finished [took 46.4657s] 05/11/23 11:29:03| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 47.8578s] 05/11/23 11:29:03| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 11:29:41| INFO ref finished [took 35.3209s] 05/11/23 11:29:45| INFO atc_mc finished [took 38.3693s] 05/11/23 11:29:51| INFO mulmc_sld finished [took 46.5707s] 05/11/23 11:29:51| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 47.7036s] 05/11/23 11:29:51| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 11:30:28| INFO ref finished [took 35.0276s] 05/11/23 11:30:32| INFO atc_mc finished [took 38.1508s] 05/11/23 11:30:40| INFO mulmc_sld finished [took 47.6215s] 05/11/23 11:30:40| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 48.9244s] 05/11/23 11:30:40| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 11:31:17| INFO ref finished [took 35.3308s] 05/11/23 11:31:21| INFO atc_mc finished [took 38.0629s] 05/11/23 11:31:29| INFO mulmc_sld finished [took 47.8783s] 05/11/23 11:31:29| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 49.1655s] 05/11/23 11:31:29| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 11:32:07| INFO ref finished [took 35.1485s] 05/11/23 11:32:10| INFO atc_mc finished [took 38.1974s] 05/11/23 11:32:18| INFO mulmc_sld finished [took 47.6056s] 05/11/23 11:32:18| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 48.9545s] 05/11/23 11:32:18| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 11:32:56| INFO ref finished [took 35.1879s] 05/11/23 11:32:59| INFO atc_mc finished [took 38.1684s] 05/11/23 11:33:07| INFO mulmc_sld finished [took 47.5635s] 05/11/23 11:33:07| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 48.9364s] 05/11/23 11:33:07| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 11:33:45| INFO ref finished [took 35.5855s] 05/11/23 11:33:48| INFO atc_mc finished [took 38.1206s] 05/11/23 11:33:54| INFO mulmc_sld finished [took 45.1957s] 05/11/23 11:33:54| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 46.5129s] ---------------------------------------------------------------------------------------------------- 05/11/23 12:02:53| INFO dataset rcv1_CCAT_9prevs 05/11/23 12:02:58| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 12:03:01| WARNING Method mulne_sld failed. Exception: axis 1 is out of bounds for array of dimension 1 05/11/23 12:03:37| INFO ref finished [took 34.9513s] 05/11/23 12:03:41| INFO atc_mc finished [took 37.7710s] 05/11/23 12:03:47| INFO mulmc_sld finished [took 47.2144s] 05/11/23 12:03:56| INFO mul_sld finished [took 56.8347s] 05/11/23 12:03:56| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 58.1052s] 05/11/23 12:03:56| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 12:03:59| WARNING Method mulne_sld failed. Exception: axis 1 is out of bounds for array of dimension 1 05/11/23 12:04:36| INFO ref finished [took 35.5921s] 05/11/23 12:04:40| INFO atc_mc finished [took 38.4587s] 05/11/23 12:04:46| INFO mulmc_sld finished [took 47.5756s] 05/11/23 12:04:47| INFO mul_sld finished [took 50.0690s] 05/11/23 12:04:47| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 51.3609s] 05/11/23 12:04:47| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 12:04:50| WARNING Method mulne_sld failed. Exception: axis 1 is out of bounds for array of dimension 1 05/11/23 12:05:28| INFO ref finished [took 36.0399s] 05/11/23 12:05:31| INFO atc_mc finished [took 38.9414s] 05/11/23 12:05:38| INFO mulmc_sld finished [took 48.4594s] 05/11/23 12:05:38| INFO mul_sld finished [took 49.4355s] 05/11/23 12:05:38| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 50.7799s] 05/11/23 12:05:38| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 12:05:41| WARNING Method mulne_sld failed. Exception: axis 1 is out of bounds for array of dimension 1 ---------------------------------------------------------------------------------------------------- 05/11/23 12:06:13| INFO dataset rcv1_CCAT_9prevs 05/11/23 12:06:18| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 12:07:03| INFO ref finished [took 41.7793s] 05/11/23 12:07:10| INFO atc_mc finished [took 48.0537s] 05/11/23 12:07:38| WARNING Method mulne_sld failed. Exception: axis 1 is out of bounds for array of dimension 1 ---------------------------------------------------------------------------------------------------- 05/11/23 12:08:00| INFO dataset rcv1_CCAT_9prevs 05/11/23 12:08:04| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 12:08:47| INFO ref finished [took 37.5352s] 05/11/23 12:08:50| INFO atc_mc finished [took 40.2843s] 05/11/23 12:08:55| INFO mulne_sld finished [took 47.4558s] 05/11/23 12:08:56| INFO mulmc_sld finished [took 49.8247s] 05/11/23 12:09:05| INFO mul_sld finished [took 59.5033s] 05/11/23 12:09:05| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 60.7605s] 05/11/23 12:09:05| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 12:09:47| INFO ref finished [took 37.4891s] 05/11/23 12:09:52| INFO atc_mc finished [took 40.9763s] 05/11/23 12:09:58| INFO mulmc_sld finished [took 50.3687s] 05/11/23 12:09:59| INFO mulne_sld finished [took 50.8494s] 05/11/23 12:10:00| INFO mul_sld finished [took 53.7955s] 05/11/23 12:10:00| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 55.1095s] 05/11/23 12:10:00| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 12:10:44| INFO ref finished [took 39.3665s] 05/11/23 12:10:49| INFO atc_mc finished [took 43.1884s] 05/11/23 12:10:55| INFO mul_sld finished [took 53.2533s] 05/11/23 12:10:55| INFO mulmc_sld finished [took 52.6179s] 05/11/23 12:10:56| INFO mulne_sld finished [took 52.7117s] 05/11/23 12:10:56| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 56.0058s] 05/11/23 12:10:56| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 12:11:40| INFO ref finished [took 39.1357s] 05/11/23 12:11:44| INFO atc_mc finished [took 42.7168s] 05/11/23 12:11:50| INFO mul_sld finished [took 53.1250s] 05/11/23 12:11:51| INFO mulmc_sld finished [took 52.6875s] 05/11/23 12:11:51| INFO mulne_sld finished [took 51.9871s] 05/11/23 12:11:51| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 55.0715s] 05/11/23 12:11:51| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 12:12:34| INFO ref finished [took 38.0624s] 05/11/23 12:12:38| INFO atc_mc finished [took 40.9414s] 05/11/23 12:12:45| INFO mul_sld finished [took 52.0220s] 05/11/23 12:12:46| INFO mulmc_sld finished [took 52.0904s] 05/11/23 12:12:47| INFO mulne_sld finished [took 52.2011s] 05/11/23 12:12:47| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 55.6901s] 05/11/23 12:12:47| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 12:13:29| INFO ref finished [took 37.9734s] 05/11/23 12:13:34| INFO atc_mc finished [took 41.4316s] 05/11/23 12:13:41| INFO mulmc_sld finished [took 51.9276s] 05/11/23 12:13:42| INFO mul_sld finished [took 53.8232s] 05/11/23 12:13:43| INFO mulne_sld finished [took 52.4359s] 05/11/23 12:13:43| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 55.5737s] 05/11/23 12:13:43| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 12:14:25| INFO ref finished [took 38.1687s] 05/11/23 12:14:29| INFO atc_mc finished [took 40.6142s] 05/11/23 12:14:37| INFO mulmc_sld finished [took 52.4191s] 05/11/23 12:14:38| INFO mul_sld finished [took 53.7962s] 05/11/23 12:14:38| INFO mulne_sld finished [took 52.1544s] 05/11/23 12:14:38| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 55.4465s] 05/11/23 12:14:38| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 12:15:21| INFO ref finished [took 38.4494s] 05/11/23 12:15:25| INFO atc_mc finished [took 40.9944s] 05/11/23 12:15:32| INFO mulmc_sld finished [took 51.8551s] 05/11/23 12:15:33| INFO mul_sld finished [took 53.4409s] 05/11/23 12:15:33| INFO mulne_sld finished [took 51.7256s] 05/11/23 12:15:33| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 55.1132s] 05/11/23 12:15:33| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 12:16:16| INFO ref finished [took 38.2838s] 05/11/23 12:16:20| INFO atc_mc finished [took 41.3532s] 05/11/23 12:16:24| INFO mulmc_sld finished [took 49.1257s] 05/11/23 12:16:26| INFO mulne_sld finished [took 49.8205s] 05/11/23 12:16:34| INFO mul_sld finished [took 59.1323s] 05/11/23 12:16:34| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 60.4191s] ---------------------------------------------------------------------------------------------------- 05/11/23 12:23:45| INFO dataset rcv1_CCAT_9prevs 05/11/23 12:23:50| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 12:24:32| INFO ref finished [took 38.5638s] 05/11/23 12:24:36| INFO atc_mc finished [took 41.5043s] 05/11/23 12:27:13| INFO binmc_sld finished [took 201.7673s] 05/11/23 12:27:14| INFO bin_sld finished [took 203.3515s] 05/11/23 12:27:17| INFO binne_sld finished [took 204.1403s] 05/11/23 12:27:17| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 207.1212s] 05/11/23 12:27:17| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 12:27:59| INFO ref finished [took 37.8990s] 05/11/23 12:28:02| INFO atc_mc finished [took 40.1947s] 05/11/23 12:30:36| INFO bin_sld finished [took 197.7408s] 05/11/23 12:30:37| INFO binne_sld finished [took 197.0819s] 05/11/23 12:30:37| INFO binmc_sld finished [took 198.5545s] 05/11/23 12:30:37| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 200.7762s] 05/11/23 12:30:37| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 12:31:19| INFO ref finished [took 37.3749s] 05/11/23 12:31:23| INFO atc_mc finished [took 40.9120s] 05/11/23 12:33:54| INFO binmc_sld finished [took 194.5722s] 05/11/23 12:33:55| INFO bin_sld finished [took 195.8961s] 05/11/23 12:33:56| INFO binne_sld finished [took 194.9605s] 05/11/23 12:33:56| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 198.1296s] 05/11/23 12:33:56| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 12:34:37| INFO ref finished [took 37.5561s] 05/11/23 12:34:40| INFO atc_mc finished [took 40.3775s] 05/11/23 12:37:09| INFO bin_sld finished [took 192.3652s] 05/11/23 12:37:12| INFO binne_sld finished [took 193.4666s] 05/11/23 12:37:12| INFO binmc_sld finished [took 194.3499s] 05/11/23 12:37:12| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 196.3675s] 05/11/23 12:37:12| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 12:37:53| INFO ref finished [took 36.5043s] 05/11/23 12:37:57| INFO atc_mc finished [took 40.0038s] 05/11/23 12:40:26| INFO bin_sld finished [took 192.4518s] 05/11/23 12:40:26| INFO binne_sld finished [took 191.2727s] 05/11/23 12:40:26| INFO binmc_sld finished [took 192.3339s] 05/11/23 12:40:26| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 194.5333s] 05/11/23 12:40:27| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 12:41:07| INFO ref finished [took 36.6809s] 05/11/23 12:41:11| INFO atc_mc finished [took 39.9520s] 05/11/23 12:43:40| INFO bin_sld finished [took 192.1873s] 05/11/23 12:43:40| INFO binmc_sld finished [took 191.7820s] 05/11/23 12:43:41| INFO binne_sld finished [took 191.9164s] 05/11/23 12:43:41| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 194.8818s] 05/11/23 12:43:41| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 12:44:22| INFO ref finished [took 36.9564s] 05/11/23 12:44:26| INFO atc_mc finished [took 40.1293s] 05/11/23 12:46:55| INFO bin_sld finished [took 192.4960s] 05/11/23 12:46:56| INFO binmc_sld finished [took 192.8281s] 05/11/23 12:46:58| INFO binne_sld finished [took 193.1524s] 05/11/23 12:46:58| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 196.2697s] 05/11/23 12:46:58| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 12:47:39| INFO ref finished [took 37.2831s] 05/11/23 12:47:42| INFO atc_mc finished [took 39.7258s] 05/11/23 12:50:16| INFO binmc_sld finished [took 195.9783s] 05/11/23 12:50:16| INFO binne_sld finished [took 195.2592s] 05/11/23 12:50:16| INFO bin_sld finished [took 197.4676s] 05/11/23 12:50:16| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 198.8232s] 05/11/23 12:50:16| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 12:50:58| INFO ref finished [took 37.4054s] 05/11/23 12:51:02| INFO atc_mc finished [took 40.4573s] 05/11/23 12:53:36| INFO bin_sld finished [took 198.0953s] 05/11/23 12:53:36| INFO binmc_sld finished [took 197.8028s] 05/11/23 12:53:37| INFO binne_sld finished [took 197.3027s] 05/11/23 12:53:37| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 200.2560s] ---------------------------------------------------------------------------------------------------- 05/11/23 13:29:43| INFO dataset rcv1_CCAT_9prevs 05/11/23 13:29:47| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 05/11/23 13:30:43| INFO ref finished [took 47.3558s] 05/11/23 13:30:48| INFO atc_mc finished [took 50.8788s] 05/11/23 13:30:52| INFO mulne_sld finished [took 60.4851s] 05/11/23 13:30:53| INFO mulmc_sld finished [took 63.4717s] 05/11/23 13:33:31| INFO binmc_sld finished [took 222.0328s] 05/11/23 13:33:33| INFO binne_sld finished [took 223.0449s] 05/11/23 13:43:18| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': 'max_conf'} (score=0.00644) [took 803.9708s] 05/11/23 13:44:01| INFO mul_sld_gs finished [took 847.1261s] 05/11/23 13:49:04| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00589) [took 1151.2473s] 05/11/23 13:52:06| INFO bin_sld_gs finished [took 1333.4736s] 05/11/23 13:52:06| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 1338.9046s] 05/11/23 13:52:06| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 05/11/23 13:53:00| INFO ref finished [took 45.3095s] 05/11/23 13:53:04| INFO atc_mc finished [took 48.2659s] 05/11/23 13:53:08| INFO mulmc_sld finished [took 58.9237s] 05/11/23 13:53:11| INFO mulne_sld finished [took 59.5712s] 05/11/23 13:55:46| INFO binmc_sld finished [took 218.1315s] 05/11/23 13:55:51| INFO binne_sld finished [took 220.8543s] 05/11/23 14:05:34| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00699) [took 800.6256s] 05/11/23 14:06:16| INFO mul_sld_gs finished [took 842.1616s] 05/11/23 14:12:14| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00768) [took 1201.3712s] 05/11/23 14:15:15| INFO bin_sld_gs finished [took 1382.8113s] 05/11/23 14:15:15| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 1388.8622s] 05/11/23 14:15:15| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 05/11/23 14:16:11| INFO ref finished [took 46.8666s] 05/11/23 14:16:15| INFO atc_mc finished [took 49.6779s] 05/11/23 14:16:19| INFO mulmc_sld finished [took 61.0610s] 05/11/23 14:16:22| INFO mulne_sld finished [took 62.2089s] 05/11/23 14:19:02| INFO binmc_sld finished [took 225.5737s] 05/11/23 14:19:03| INFO binne_sld finished [took 223.9017s] 05/11/23 14:28:50| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00756) [took 806.7930s] 05/11/23 14:29:32| INFO mul_sld_gs finished [took 848.7630s] 05/11/23 14:36:02| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00781) [took 1240.9138s] 05/11/23 14:39:04| INFO bin_sld_gs finished [took 1422.5520s] 05/11/23 14:39:04| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 1428.8824s] 05/11/23 14:39:04| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 05/11/23 14:39:58| INFO ref finished [took 45.7514s] 05/11/23 14:40:02| INFO atc_mc finished [took 48.3888s] 05/11/23 14:40:05| INFO mulmc_sld finished [took 59.0537s] 05/11/23 14:40:09| INFO mulne_sld finished [took 60.9189s] 05/11/23 14:42:42| INFO binne_sld finished [took 214.5464s] 05/11/23 14:42:44| INFO binmc_sld finished [took 218.8429s] 05/11/23 14:52:23| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00984) [took 792.5474s] 05/11/23 14:53:05| INFO mul_sld_gs finished [took 834.1824s] 05/11/23 14:59:56| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.01112) [took 1247.0092s] 05/11/23 15:02:57| INFO bin_sld_gs finished [took 1427.5051s] 05/11/23 15:02:57| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 1432.9172s] 05/11/23 15:02:57| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 05/11/23 15:03:49| INFO ref finished [took 44.4148s] 05/11/23 15:03:54| INFO atc_mc finished [took 47.7566s] 05/11/23 15:04:00| INFO mulmc_sld finished [took 60.5480s] 05/11/23 15:04:03| INFO mulne_sld finished [took 61.2226s] 05/11/23 15:06:30| INFO binmc_sld finished [took 211.9647s] 05/11/23 15:06:32| INFO binne_sld finished [took 211.4312s] 05/11/23 15:16:00| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'max_conf'} (score=0.00571) [took 776.6085s] 05/11/23 15:16:42| INFO mul_sld_gs finished [took 817.9358s] 05/11/23 15:23:24| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'vs', 'confidence': 'entropy'} (score=0.00653) [took 1221.6531s] 05/11/23 15:26:23| INFO bin_sld_gs finished [took 1400.9688s] 05/11/23 15:26:23| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 1406.4620s] 05/11/23 15:26:23| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 05/11/23 15:27:16| INFO ref finished [took 44.3988s] 05/11/23 15:27:21| INFO atc_mc finished [took 48.5589s] 05/11/23 15:27:27| INFO mulmc_sld finished [took 61.4269s] 05/11/23 15:27:29| INFO mulne_sld finished [took 61.8292s] 05/11/23 15:29:55| INFO binmc_sld finished [took 210.1585s] 05/11/23 15:29:59| INFO binne_sld finished [took 212.0930s] 05/11/23 15:39:22| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'max_conf'} (score=0.00616) [took 771.6071s] 05/11/23 15:40:03| INFO mul_sld_gs finished [took 813.2905s] 05/11/23 15:47:04| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': None} (score=0.00544) [took 1234.9832s] 05/11/23 15:50:10| INFO bin_sld_gs finished [took 1421.7775s] 05/11/23 15:50:10| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 1427.0062s] 05/11/23 15:50:10| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 05/11/23 15:51:11| INFO ref finished [took 49.7682s] 05/11/23 15:51:19| INFO atc_mc finished [took 54.2855s] 05/11/23 15:51:22| INFO mulmc_sld finished [took 68.7688s] 05/11/23 15:51:26| INFO mulne_sld finished [took 69.3711s] 05/11/23 15:54:07| INFO binmc_sld finished [took 234.7962s] 05/11/23 15:54:09| INFO binne_sld finished [took 234.6444s] 05/11/23 16:03:51| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'confidence': 'entropy'} (score=0.00765) [took 811.6704s] 05/11/23 16:04:34| INFO mul_sld_gs finished [took 854.8196s] 05/11/23 16:11:10| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': 'max_conf'} (score=0.01234) [took 1252.4784s] 05/11/23 16:14:10| INFO bin_sld_gs finished [took 1431.7446s] 05/11/23 16:14:10| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 1439.1145s] 05/11/23 16:14:10| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 05/11/23 16:15:02| INFO ref finished [took 44.0970s] 05/11/23 16:15:07| INFO atc_mc finished [took 48.2871s] 05/11/23 16:15:13| INFO mulmc_sld finished [took 61.0461s] 05/11/23 16:15:15| INFO mulne_sld finished [took 60.6375s] 05/11/23 16:17:46| INFO binmc_sld finished [took 215.1734s] 05/11/23 16:17:49| INFO binne_sld finished [took 215.7846s] 05/11/23 16:27:15| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'confidence': None} (score=0.00822) [took 778.5688s] 05/11/23 16:27:56| INFO mul_sld_gs finished [took 819.2615s] 05/11/23 16:34:16| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'entropy'} (score=0.00894) [took 1200.6639s] 05/11/23 16:37:21| INFO bin_sld_gs finished [took 1385.9035s] 05/11/23 16:37:21| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 1391.5055s] 05/11/23 16:37:21| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 05/11/23 16:38:13| INFO ref finished [took 44.7046s] 05/11/23 16:38:18| INFO atc_mc finished [took 48.7802s] 05/11/23 16:38:21| INFO mulmc_sld finished [took 57.4163s] 05/11/23 16:38:24| INFO mulne_sld finished [took 58.9847s] 05/11/23 16:40:59| INFO binmc_sld finished [took 216.7311s] 05/11/23 16:41:01| INFO binne_sld finished [took 216.5312s] 05/11/23 16:50:06| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'confidence': 'max_conf'} (score=0.00808) [took 758.6896s] 05/11/23 16:50:46| INFO mul_sld_gs finished [took 798.8038s] 05/11/23 16:56:41| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'confidence': 'entropy'} (score=0.00604) [took 1154.7043s] 05/11/23 16:59:39| INFO bin_sld_gs finished [took 1332.5521s] 05/11/23 16:59:39| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 1337.7947s] ---------------------------------------------------------------------------------------------------- 05/11/23 20:08:46| ERROR estimate comparison failed. Exceprion: 'environ' object has no attribute 'OUT_PATH' ---------------------------------------------------------------------------------------------------- 05/11/23 20:09:08| ERROR estimate comparison failed. Exceprion: 'environ' object has no attribute 'OUT_PATH' ---------------------------------------------------------------------------------------------------- 05/11/23 20:09:27| INFO dataset imdb_3prevs 05/11/23 20:09:34| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 20:09:44| INFO ref finished [took 8.9550s] 05/11/23 20:09:47| INFO atc_mc finished [took 11.8923s] 05/11/23 20:09:56| INFO mulmc_sld finished [took 21.3196s] 05/11/23 20:09:56| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 21.7709s] 05/11/23 20:09:56| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 20:10:05| INFO ref finished [took 8.6116s] 05/11/23 20:10:08| INFO atc_mc finished [took 11.6880s] 05/11/23 20:10:16| INFO mulmc_sld finished [took 19.7793s] 05/11/23 20:10:16| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 20.3246s] 05/11/23 20:10:16| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 20:10:26| INFO ref finished [took 8.6654s] 05/11/23 20:10:29| INFO atc_mc finished [took 11.6975s] 05/11/23 20:10:35| INFO mulmc_sld finished [took 18.1478s] 05/11/23 20:10:35| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 18.7200s] ---------------------------------------------------------------------------------------------------- 05/11/23 20:11:42| INFO dataset imdb_3prevs 05/11/23 20:11:49| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 20:11:58| INFO ref finished [took 8.7146s] 05/11/23 20:12:02| INFO atc_mc finished [took 11.9672s] 05/11/23 20:12:10| INFO mulmc_sld finished [took 20.7824s] 05/11/23 20:12:10| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 21.2293s] 05/11/23 20:12:10| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 20:12:19| INFO ref finished [took 8.5867s] 05/11/23 20:12:23| INFO atc_mc finished [took 11.6542s] 05/11/23 20:12:30| INFO mulmc_sld finished [took 19.6709s] 05/11/23 20:12:30| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 20.1802s] 05/11/23 20:12:30| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 20:12:40| INFO ref finished [took 8.7231s] 05/11/23 20:12:43| INFO atc_mc finished [took 11.8244s] 05/11/23 20:12:49| INFO mulmc_sld finished [took 18.0420s] 05/11/23 20:12:49| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 18.6102s] ---------------------------------------------------------------------------------------------------- 05/11/23 20:14:32| INFO dataset imdb_3prevs 05/11/23 20:14:39| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 20:14:48| INFO ref finished [took 8.6247s] 05/11/23 20:14:51| INFO atc_mc finished [took 11.6363s] 05/11/23 20:15:00| INFO mulmc_sld finished [took 20.4634s] 05/11/23 20:15:00| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 20.9026s] 05/11/23 20:15:00| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 20:15:09| INFO ref finished [took 8.5219s] 05/11/23 20:15:12| INFO atc_mc finished [took 11.6739s] 05/11/23 20:15:20| INFO mulmc_sld finished [took 19.8454s] 05/11/23 20:15:20| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 20.3705s] 05/11/23 20:15:20| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 20:15:29| INFO ref finished [took 8.5948s] 05/11/23 20:15:32| INFO atc_mc finished [took 11.7465s] 05/11/23 20:15:39| INFO mulmc_sld finished [took 17.9276s] 05/11/23 20:15:39| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 18.4893s] ---------------------------------------------------------------------------------------------------- 05/11/23 20:16:10| INFO dataset imdb_3prevs 05/11/23 20:16:17| INFO Dataset sample 0.20 of dataset imdb_3prevs started 05/11/23 20:16:26| INFO ref finished [took 8.3736s] 05/11/23 20:16:29| INFO atc_mc finished [took 11.3995s] 05/11/23 20:16:38| INFO mulmc_sld finished [took 20.4916s] 05/11/23 20:16:38| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 20.9187s] 05/11/23 20:16:38| INFO Dataset sample 0.50 of dataset imdb_3prevs started 05/11/23 20:16:47| INFO ref finished [took 8.4368s] 05/11/23 20:16:50| INFO atc_mc finished [took 11.4889s] 05/11/23 20:16:58| INFO mulmc_sld finished [took 19.6803s] 05/11/23 20:16:58| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 20.2091s] 05/11/23 20:16:58| INFO Dataset sample 0.80 of dataset imdb_3prevs started 05/11/23 20:17:08| INFO ref finished [took 8.9281s] 05/11/23 20:17:11| INFO atc_mc finished [took 11.9333s] 05/11/23 20:17:17| INFO mulmc_sld finished [took 18.2367s] 05/11/23 20:17:17| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 18.8309s] ---------------------------------------------------------------------------------------------------- 06/11/23 01:34:48| INFO dataset imdb_3prevs 06/11/23 01:34:59| INFO Dataset sample 0.20 of dataset imdb_3prevs started 06/11/23 01:35:18| INFO ref finished [took 18.0987s] 06/11/23 01:35:24| INFO atc_mc finished [took 24.9118s] 06/11/23 01:35:31| INFO mulmc_sld finished [took 32.0631s] 06/11/23 01:35:31| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 32.6119s] 06/11/23 01:35:31| INFO Dataset sample 0.50 of dataset imdb_3prevs started 06/11/23 01:35:51| INFO ref finished [took 18.7770s] 06/11/23 01:35:58| INFO atc_mc finished [took 25.5592s] 06/11/23 01:36:04| INFO mulmc_sld finished [took 31.9103s] 06/11/23 01:36:04| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 32.5205s] 06/11/23 01:36:04| INFO Dataset sample 0.80 of dataset imdb_3prevs started 06/11/23 01:36:23| INFO ref finished [took 18.5730s] 06/11/23 01:36:31| INFO atc_mc finished [took 25.8019s] 06/11/23 01:36:33| INFO mulmc_sld finished [took 28.9526s] 06/11/23 01:36:33| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 29.5292s] ---------------------------------------------------------------------------------------------------- 06/11/23 02:06:40| INFO dataset imdb_3prevs 06/11/23 02:06:47| INFO Dataset sample 0.20 of dataset imdb_3prevs started 06/11/23 02:06:56| INFO ref finished [took 9.0989s] 06/11/23 02:06:59| INFO atc_mc finished [took 12.2513s] 06/11/23 03:01:43| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'vs', 'quantifier__exact_train_prev': False, 'confidence': 'max_conf'} (score=0.00738) [took 3296.0714s] 06/11/23 03:01:56| INFO mul_sld_gs finished [took 3309.2417s] 06/11/23 03:01:56| INFO Dataset sample 0.20 of dataset imdb_3prevs finished [took 3309.7038s] 06/11/23 03:01:56| INFO Dataset sample 0.50 of dataset imdb_3prevs started 06/11/23 03:02:06| INFO ref finished [took 8.5518s] 06/11/23 03:02:09| INFO atc_mc finished [took 11.4390s] 06/11/23 03:54:23| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00899) [took 3146.2364s] 06/11/23 03:54:37| INFO mul_sld_gs finished [took 3159.8209s] 06/11/23 03:54:37| INFO Dataset sample 0.50 of dataset imdb_3prevs finished [took 3160.3546s] 06/11/23 03:54:37| INFO Dataset sample 0.80 of dataset imdb_3prevs started 06/11/23 03:54:46| INFO ref finished [took 8.2678s] 06/11/23 03:54:48| INFO atc_mc finished [took 11.0430s] 06/11/23 04:47:50| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': False, 'confidence': 'entropy'} (score=0.00770) [took 3193.1812s] 06/11/23 04:48:04| INFO mul_sld_gs finished [took 3206.9550s] 06/11/23 04:48:04| INFO Dataset sample 0.80 of dataset imdb_3prevs finished [took 3207.5040s] ---------------------------------------------------------------------------------------------------- 06/11/23 05:14:48| INFO dataset rcv1_CCAT_9prevs 06/11/23 05:14:53| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 06/11/23 05:15:55| INFO ref finished [took 48.0242s] 06/11/23 05:16:01| INFO atc_mc finished [took 51.7851s] 06/11/23 05:16:04| INFO mul_pacc finished [took 58.4704s] 06/11/23 05:16:04| INFO mulne_sld finished [took 62.7354s] 06/11/23 05:16:04| INFO mulmc_sld finished [took 66.2593s] 06/11/23 05:16:14| INFO mul_sld finished [took 78.2483s] 06/11/23 05:18:40| INFO bin_pacc finished [took 217.0012s] 06/11/23 05:18:43| INFO bin_sld finished [took 227.8835s] 06/11/23 05:18:43| INFO binne_sld finished [took 223.2764s] 06/11/23 05:18:44| INFO binmc_sld finished [took 226.7324s] 06/11/23 05:18:44| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 230.5906s] 06/11/23 05:18:44| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 06/11/23 05:19:44| INFO ref finished [took 49.5147s] 06/11/23 05:19:51| INFO atc_mc finished [took 54.8022s] 06/11/23 05:19:53| INFO mul_pacc finished [took 60.3260s] 06/11/23 05:19:55| INFO mulmc_sld finished [took 67.0280s] 06/11/23 05:19:56| INFO mul_sld finished [took 70.4092s] 06/11/23 05:19:58| INFO mulne_sld finished [took 67.3468s] 06/11/23 05:22:30| INFO bin_sld finished [took 224.7344s] 06/11/23 05:22:30| INFO bin_pacc finished [took 218.3044s] 06/11/23 05:22:30| INFO binmc_sld finished [took 223.3607s] 06/11/23 05:22:33| INFO binne_sld finished [took 223.6042s] 06/11/23 05:22:33| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 229.0745s] 06/11/23 05:22:33| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 06/11/23 05:23:32| INFO ref finished [took 48.1565s] 06/11/23 05:23:37| INFO atc_mc finished [took 52.1124s] 06/11/23 05:23:40| INFO mul_pacc finished [took 58.0112s] 06/11/23 05:23:40| INFO mul_sld finished [took 65.2727s] 06/11/23 05:23:42| INFO mulmc_sld finished [took 64.5943s] 06/11/23 05:23:43| INFO mulne_sld finished [took 63.9053s] 06/11/23 05:26:13| INFO bin_sld finished [took 218.6511s] 06/11/23 05:26:16| INFO bin_pacc finished [took 215.1485s] 06/11/23 05:26:17| INFO binne_sld finished [took 218.6855s] 06/11/23 05:26:17| INFO binmc_sld finished [took 221.2605s] 06/11/23 05:26:17| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 224.5608s] 06/11/23 05:26:17| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 06/11/23 05:27:15| INFO ref finished [took 48.2181s] 06/11/23 05:27:21| INFO atc_mc finished [took 52.3420s] 06/11/23 05:27:23| INFO mul_pacc finished [took 57.1950s] 06/11/23 05:27:24| INFO mul_sld finished [took 64.4722s] 06/11/23 05:27:26| INFO mulmc_sld finished [took 64.1870s] 06/11/23 05:27:27| INFO mulne_sld finished [took 63.7407s] 06/11/23 05:29:52| INFO bin_sld finished [took 213.1913s] 06/11/23 05:29:53| INFO bin_pacc finished [took 208.1322s] 06/11/23 05:29:53| INFO binmc_sld finished [took 212.6473s] 06/11/23 05:29:57| INFO binne_sld finished [took 214.5243s] 06/11/23 05:29:57| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 219.5765s] 06/11/23 05:29:57| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 06/11/23 05:30:55| INFO ref finished [took 47.7289s] 06/11/23 05:31:01| INFO atc_mc finished [took 52.1531s] 06/11/23 05:31:03| INFO mul_pacc finished [took 57.3804s] 06/11/23 05:31:06| INFO mul_sld finished [took 66.9237s] 06/11/23 05:31:06| INFO mulmc_sld finished [took 65.3230s] 06/11/23 05:31:09| INFO mulne_sld finished [took 65.6645s] 06/11/23 05:33:33| INFO bin_sld finished [took 214.3242s] 06/11/23 05:33:34| INFO bin_pacc finished [took 209.3862s] 06/11/23 05:33:35| INFO binmc_sld finished [took 214.4687s] 06/11/23 05:33:37| INFO binne_sld finished [took 214.7267s] 06/11/23 05:33:37| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 220.0212s] 06/11/23 05:33:37| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 06/11/23 05:34:35| INFO ref finished [took 48.0021s] 06/11/23 05:34:41| INFO atc_mc finished [took 52.2171s] 06/11/23 05:34:43| INFO mul_pacc finished [took 57.2348s] 06/11/23 05:34:46| INFO mul_sld finished [took 67.0899s] 06/11/23 05:34:47| INFO mulmc_sld finished [took 66.1078s] 06/11/23 05:34:49| INFO mulne_sld finished [took 66.0237s] 06/11/23 05:37:13| INFO bin_sld finished [took 214.9942s] 06/11/23 05:37:13| INFO binmc_sld finished [took 213.1574s] 06/11/23 05:37:14| INFO bin_pacc finished [took 209.1347s] 06/11/23 05:37:17| INFO binne_sld finished [took 214.9703s] 06/11/23 05:37:17| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 220.1235s] 06/11/23 05:37:17| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 06/11/23 05:38:15| INFO ref finished [took 47.8227s] 06/11/23 05:38:20| INFO atc_mc finished [took 51.9364s] 06/11/23 05:38:23| INFO mul_pacc finished [took 56.9053s] 06/11/23 05:38:27| INFO mul_sld finished [took 67.4535s] 06/11/23 05:38:27| INFO mulmc_sld finished [took 65.5956s] 06/11/23 05:38:30| INFO mulne_sld finished [took 66.0476s] 06/11/23 05:40:55| INFO bin_pacc finished [took 210.0633s] 06/11/23 05:40:56| INFO binmc_sld finished [took 215.3452s] 06/11/23 05:40:56| INFO bin_sld finished [took 217.8091s] 06/11/23 05:40:59| INFO binne_sld finished [took 216.8970s] 06/11/23 05:40:59| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 222.2971s] 06/11/23 05:40:59| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 06/11/23 05:41:57| INFO ref finished [took 47.6970s] 06/11/23 05:42:03| INFO atc_mc finished [took 52.0893s] 06/11/23 05:42:05| INFO mul_pacc finished [took 56.6428s] 06/11/23 05:42:09| INFO mul_sld finished [took 66.8810s] 06/11/23 05:42:09| INFO mulmc_sld finished [took 65.8427s] 06/11/23 05:42:11| INFO mulne_sld finished [took 64.8594s] 06/11/23 05:44:36| INFO bin_pacc finished [took 208.7884s] 06/11/23 05:44:38| INFO bin_sld finished [took 216.6052s] 06/11/23 05:44:38| INFO binmc_sld finished [took 215.5486s] 06/11/23 05:44:43| INFO binne_sld finished [took 217.9926s] 06/11/23 05:44:43| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 223.2270s] 06/11/23 05:44:43| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 06/11/23 05:45:40| INFO ref finished [took 48.0710s] 06/11/23 05:45:46| INFO atc_mc finished [took 52.0992s] 06/11/23 05:45:48| INFO mul_pacc finished [took 56.6568s] 06/11/23 05:45:49| INFO mulmc_sld finished [took 61.7314s] 06/11/23 05:45:52| INFO mulne_sld finished [took 62.7505s] 06/11/23 05:45:59| INFO mul_sld finished [took 73.7681s] 06/11/23 05:48:18| INFO bin_pacc finished [took 208.2267s] 06/11/23 05:48:23| INFO bin_sld finished [took 218.9333s] 06/11/23 05:48:24| INFO binmc_sld finished [took 218.0032s] 06/11/23 05:48:27| INFO binne_sld finished [took 219.2450s] 06/11/23 05:48:27| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 224.3446s] 06/11/23 05:49:49| INFO dataset imdb_9prevs 06/11/23 05:49:57| INFO Dataset sample 0.10 of dataset imdb_9prevs started 06/11/23 05:50:12| INFO ref finished [took 13.3064s] 06/11/23 05:50:17| INFO atc_mc finished [took 17.3508s] 06/11/23 05:50:19| INFO mul_pacc finished [took 20.0802s] 06/11/23 05:50:22| INFO mulne_sld finished [took 23.6723s] 06/11/23 05:50:24| INFO mulmc_sld finished [took 25.5159s] 06/11/23 05:50:39| INFO mul_sld finished [took 40.7099s] 06/11/23 05:52:55| INFO bin_pacc finished [took 176.3728s] 06/11/23 05:53:05| INFO binmc_sld finished [took 186.8240s] 06/11/23 05:53:06| INFO binne_sld finished [took 187.6585s] 06/11/23 05:53:07| INFO bin_sld finished [took 189.1728s] 06/11/23 05:53:07| INFO Dataset sample 0.10 of dataset imdb_9prevs finished [took 189.6034s] 06/11/23 05:53:07| INFO Dataset sample 0.20 of dataset imdb_9prevs started 06/11/23 05:53:22| INFO ref finished [took 13.2778s] 06/11/23 05:53:26| INFO atc_mc finished [took 17.4491s] 06/11/23 05:53:28| INFO mul_pacc finished [took 19.9359s] 06/11/23 05:53:40| INFO mulmc_sld finished [took 31.6686s] 06/11/23 05:53:44| INFO mulne_sld finished [took 35.2085s] 06/11/23 05:53:44| INFO mul_sld finished [took 36.2502s] 06/11/23 05:56:05| INFO bin_pacc finished [took 177.0225s] 06/11/23 05:56:13| INFO binmc_sld finished [took 185.4811s] 06/11/23 05:56:15| INFO bin_sld finished [took 187.1039s] 06/11/23 05:56:16| INFO binne_sld finished [took 187.3163s] 06/11/23 05:56:16| INFO Dataset sample 0.20 of dataset imdb_9prevs finished [took 188.4781s] 06/11/23 05:56:16| INFO Dataset sample 0.30 of dataset imdb_9prevs started 06/11/23 05:56:31| INFO ref finished [took 13.4513s] 06/11/23 05:56:36| INFO atc_mc finished [took 18.1025s] 06/11/23 05:56:38| INFO mul_pacc finished [took 20.3997s] 06/11/23 05:56:45| INFO mulmc_sld finished [took 28.4298s] 06/11/23 05:56:46| INFO mulne_sld finished [took 28.8678s] 06/11/23 05:56:46| INFO mul_sld finished [took 29.5573s] 06/11/23 05:59:11| INFO bin_pacc finished [took 174.0262s] 06/11/23 05:59:17| INFO binmc_sld finished [took 180.1998s] 06/11/23 05:59:18| INFO binne_sld finished [took 181.2200s] 06/11/23 05:59:19| INFO bin_sld finished [took 182.1672s] 06/11/23 05:59:19| INFO Dataset sample 0.30 of dataset imdb_9prevs finished [took 183.0515s] 06/11/23 05:59:19| INFO Dataset sample 0.40 of dataset imdb_9prevs started 06/11/23 05:59:34| INFO ref finished [took 13.5163s] 06/11/23 05:59:39| INFO atc_mc finished [took 17.9856s] 06/11/23 05:59:41| INFO mul_pacc finished [took 20.7441s] 06/11/23 05:59:49| INFO mulmc_sld finished [took 29.2747s] 06/11/23 05:59:50| INFO mulne_sld finished [took 29.6624s] 06/11/23 05:59:50| INFO mul_sld finished [took 30.3432s] 06/11/23 06:02:17| INFO bin_pacc finished [took 176.7354s] 06/11/23 06:02:19| INFO binmc_sld finished [took 179.9981s] 06/11/23 06:02:21| INFO bin_sld finished [took 181.6844s] 06/11/23 06:02:22| INFO binne_sld finished [took 182.0846s] 06/11/23 06:02:22| INFO Dataset sample 0.40 of dataset imdb_9prevs finished [took 183.2033s] 06/11/23 06:02:22| INFO Dataset sample 0.50 of dataset imdb_9prevs started 06/11/23 06:02:37| INFO ref finished [took 13.4688s] 06/11/23 06:02:42| INFO atc_mc finished [took 18.0218s] 06/11/23 06:02:44| INFO mul_pacc finished [took 20.5800s] 06/11/23 06:02:52| INFO mulmc_sld finished [took 29.0192s] 06/11/23 06:02:52| INFO mul_sld finished [took 29.4403s] 06/11/23 06:02:52| INFO mulne_sld finished [took 29.1611s] 06/11/23 06:05:19| INFO bin_pacc finished [took 175.5125s] 06/11/23 06:05:23| INFO binmc_sld finished [took 180.0427s] 06/11/23 06:05:25| INFO binne_sld finished [took 182.5814s] 06/11/23 06:05:26| INFO bin_sld finished [took 183.2892s] 06/11/23 06:05:26| INFO Dataset sample 0.50 of dataset imdb_9prevs finished [took 183.8611s] 06/11/23 06:05:26| INFO Dataset sample 0.60 of dataset imdb_9prevs started 06/11/23 06:05:41| INFO ref finished [took 13.4643s] 06/11/23 06:05:45| INFO atc_mc finished [took 17.9768s] 06/11/23 06:05:48| INFO mul_pacc finished [took 20.7525s] 06/11/23 06:05:55| INFO mulmc_sld finished [took 28.8234s] 06/11/23 06:05:55| INFO mulne_sld finished [took 28.6537s] 06/11/23 06:05:56| INFO mul_sld finished [took 29.6167s] 06/11/23 06:08:24| INFO bin_pacc finished [took 176.5335s] 06/11/23 06:08:27| INFO binmc_sld finished [took 180.4803s] 06/11/23 06:08:28| INFO bin_sld finished [took 181.6676s] 06/11/23 06:08:29| INFO binne_sld finished [took 182.0534s] 06/11/23 06:08:29| INFO Dataset sample 0.60 of dataset imdb_9prevs finished [took 183.0240s] 06/11/23 06:08:29| INFO Dataset sample 0.70 of dataset imdb_9prevs started 06/11/23 06:08:44| INFO ref finished [took 13.7566s] 06/11/23 06:08:49| INFO atc_mc finished [took 17.9495s] 06/11/23 06:08:51| INFO mul_pacc finished [took 20.5859s] 06/11/23 06:08:57| INFO mulmc_sld finished [took 27.4370s] 06/11/23 06:08:58| INFO mul_sld finished [took 28.3224s] 06/11/23 06:08:58| INFO mulne_sld finished [took 28.1390s] 06/11/23 06:11:26| INFO bin_pacc finished [took 175.7412s] 06/11/23 06:11:31| INFO binmc_sld finished [took 181.4310s] 06/11/23 06:11:32| INFO binne_sld finished [took 182.0095s] 06/11/23 06:11:33| INFO bin_sld finished [took 183.6520s] 06/11/23 06:11:33| INFO Dataset sample 0.70 of dataset imdb_9prevs finished [took 184.2005s] 06/11/23 06:11:33| INFO Dataset sample 0.80 of dataset imdb_9prevs started 06/11/23 06:11:48| INFO ref finished [took 13.5418s] 06/11/23 06:11:53| INFO atc_mc finished [took 17.8150s] 06/11/23 06:11:55| INFO mul_pacc finished [took 20.4761s] 06/11/23 06:12:01| INFO mulmc_sld finished [took 27.2741s] 06/11/23 06:12:02| INFO mulne_sld finished [took 27.2693s] 06/11/23 06:12:02| INFO mul_sld finished [took 28.3364s] 06/11/23 06:14:30| INFO bin_pacc finished [took 175.7637s] 06/11/23 06:14:37| INFO binmc_sld finished [took 183.2422s] 06/11/23 06:14:38| INFO bin_sld finished [took 184.1064s] 06/11/23 06:14:39| INFO binne_sld finished [took 184.9073s] 06/11/23 06:14:39| INFO Dataset sample 0.80 of dataset imdb_9prevs finished [took 186.2580s] 06/11/23 06:14:39| INFO Dataset sample 0.90 of dataset imdb_9prevs started 06/11/23 06:14:41| WARNING Method mul_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 06:14:41| WARNING Method bin_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 06:14:52| INFO ref finished [took 11.6315s] 06/11/23 06:14:56| INFO atc_mc finished [took 15.3068s] 06/11/23 06:15:01| INFO mulne_sld finished [took 21.1133s] 06/11/23 06:15:02| INFO mulmc_sld finished [took 22.2375s] 06/11/23 06:15:08| INFO mul_sld finished [took 27.8149s] 06/11/23 06:17:32| INFO binne_sld finished [took 171.8722s] 06/11/23 06:17:32| INFO bin_sld finished [took 172.4710s] 06/11/23 06:17:33| INFO binmc_sld finished [took 172.8193s] 06/11/23 06:17:33| INFO Dataset sample 0.90 of dataset imdb_9prevs finished [took 173.4411s] 06/11/23 06:18:54| INFO dataset rcv1_GCAT_9prevs 06/11/23 06:18:59| INFO Dataset sample 0.10 of dataset rcv1_GCAT_9prevs started 06/11/23 06:19:11| WARNING Method bin_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 06:19:11| WARNING Method mul_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 06:19:54| INFO ref finished [took 42.0769s] 06/11/23 06:19:59| INFO atc_mc finished [took 45.5011s] 06/11/23 06:20:14| INFO mulne_sld finished [took 66.0516s] 06/11/23 06:20:15| INFO mul_sld finished [took 73.1171s] 06/11/23 06:20:17| INFO mulmc_sld finished [took 72.1930s] 06/11/23 06:22:23| INFO bin_sld finished [took 203.0368s] 06/11/23 06:22:27| INFO binmc_sld finished [took 203.2975s] 06/11/23 06:22:29| INFO binne_sld finished [took 202.7501s] 06/11/23 06:22:29| INFO Dataset sample 0.10 of dataset rcv1_GCAT_9prevs finished [took 210.2201s] 06/11/23 06:22:29| INFO Dataset sample 0.20 of dataset rcv1_GCAT_9prevs started 06/11/23 06:23:26| INFO ref finished [took 46.6022s] 06/11/23 06:23:31| INFO atc_mc finished [took 50.3293s] 06/11/23 06:23:33| INFO mul_pacc finished [took 54.9265s] 06/11/23 06:23:46| INFO mul_sld finished [took 74.9035s] 06/11/23 06:23:52| INFO mulne_sld finished [took 76.2697s] 06/11/23 06:23:54| INFO mulmc_sld finished [took 80.8754s] 06/11/23 06:26:06| INFO bin_pacc finished [took 209.7751s] 06/11/23 06:26:08| INFO bin_sld finished [took 217.8889s] 06/11/23 06:26:13| INFO binmc_sld finished [took 220.7753s] 06/11/23 06:26:14| INFO binne_sld finished [took 219.7510s] 06/11/23 06:26:14| INFO Dataset sample 0.20 of dataset rcv1_GCAT_9prevs finished [took 224.9268s] 06/11/23 06:26:14| INFO Dataset sample 0.30 of dataset rcv1_GCAT_9prevs started 06/11/23 06:27:10| INFO ref finished [took 46.4938s] 06/11/23 06:27:16| INFO atc_mc finished [took 50.5904s] 06/11/23 06:27:18| INFO mul_pacc finished [took 55.4949s] 06/11/23 06:27:26| INFO mulmc_sld finished [took 67.7140s] 06/11/23 06:27:26| INFO mul_sld finished [took 70.0891s] 06/11/23 06:27:28| INFO mulne_sld finished [took 68.1806s] 06/11/23 06:29:50| INFO bin_pacc finished [took 208.6091s] 06/11/23 06:29:51| INFO binmc_sld finished [took 213.7985s] 06/11/23 06:29:51| INFO bin_sld finished [took 215.8158s] 06/11/23 06:29:55| INFO binne_sld finished [took 215.5523s] 06/11/23 06:29:55| INFO Dataset sample 0.30 of dataset rcv1_GCAT_9prevs finished [took 220.4589s] 06/11/23 06:29:55| INFO Dataset sample 0.40 of dataset rcv1_GCAT_9prevs started 06/11/23 06:30:51| INFO ref finished [took 46.3752s] 06/11/23 06:30:56| INFO atc_mc finished [took 50.7062s] 06/11/23 06:30:58| INFO mul_pacc finished [took 55.2260s] 06/11/23 06:31:01| INFO mul_sld finished [took 64.2359s] 06/11/23 06:31:02| INFO mulmc_sld finished [took 63.5099s] 06/11/23 06:31:04| INFO mulne_sld finished [took 62.9188s] 06/11/23 06:33:29| INFO bin_sld finished [took 213.2716s] 06/11/23 06:33:30| INFO bin_pacc finished [took 208.6574s] 06/11/23 06:33:31| INFO binmc_sld finished [took 213.1856s] 06/11/23 06:33:33| INFO binne_sld finished [took 213.2771s] 06/11/23 06:33:33| INFO Dataset sample 0.40 of dataset rcv1_GCAT_9prevs finished [took 218.1742s] 06/11/23 06:33:33| INFO Dataset sample 0.50 of dataset rcv1_GCAT_9prevs started 06/11/23 06:34:29| INFO ref finished [took 46.6793s] 06/11/23 06:34:34| INFO atc_mc finished [took 50.9915s] 06/11/23 06:34:37| INFO mul_pacc finished [took 55.9725s] 06/11/23 06:34:38| INFO mul_sld finished [took 63.1317s] 06/11/23 06:34:40| INFO mulmc_sld finished [took 62.7473s] 06/11/23 06:34:41| INFO mulne_sld finished [took 62.1303s] 06/11/23 06:37:08| INFO bin_pacc finished [took 207.7854s] 06/11/23 06:37:08| INFO bin_sld finished [took 213.7945s] 06/11/23 06:37:08| INFO binmc_sld finished [took 212.6207s] 06/11/23 06:37:12| INFO binne_sld finished [took 213.8742s] 06/11/23 06:37:12| INFO Dataset sample 0.50 of dataset rcv1_GCAT_9prevs finished [took 218.7265s] 06/11/23 06:37:12| INFO Dataset sample 0.60 of dataset rcv1_GCAT_9prevs started 06/11/23 06:38:08| INFO ref finished [took 46.6057s] 06/11/23 06:38:14| INFO atc_mc finished [took 51.1055s] 06/11/23 06:38:15| INFO mul_pacc finished [took 55.5338s] 06/11/23 06:38:17| INFO mul_sld finished [took 63.2113s] 06/11/23 06:38:18| INFO mulmc_sld finished [took 62.2265s] 06/11/23 06:38:20| INFO mulne_sld finished [took 61.9918s] 06/11/23 06:40:46| INFO bin_pacc finished [took 207.5094s] 06/11/23 06:40:46| INFO bin_sld finished [took 213.6350s] 06/11/23 06:40:47| INFO binmc_sld finished [took 212.8363s] 06/11/23 06:40:49| INFO binne_sld finished [took 212.2587s] 06/11/23 06:40:49| INFO Dataset sample 0.60 of dataset rcv1_GCAT_9prevs finished [took 217.1976s] 06/11/23 06:40:49| INFO Dataset sample 0.70 of dataset rcv1_GCAT_9prevs started 06/11/23 06:41:44| INFO ref finished [took 45.9582s] 06/11/23 06:41:50| INFO atc_mc finished [took 50.0401s] 06/11/23 06:41:54| INFO mul_sld finished [took 62.6045s] 06/11/23 06:41:54| INFO mulmc_sld finished [took 61.4168s] 06/11/23 06:41:56| INFO mulne_sld finished [took 61.3708s] 06/11/23 06:42:00| INFO mul_pacc finished [took 62.6486s] 06/11/23 06:44:23| INFO bin_sld finished [took 212.5992s] 06/11/23 06:44:23| INFO bin_pacc finished [took 207.5241s] 06/11/23 06:44:24| INFO binmc_sld finished [took 212.2794s] 06/11/23 06:44:27| INFO binne_sld finished [took 212.8325s] 06/11/23 06:44:27| INFO Dataset sample 0.70 of dataset rcv1_GCAT_9prevs finished [took 217.7909s] 06/11/23 06:44:27| INFO Dataset sample 0.80 of dataset rcv1_GCAT_9prevs started 06/11/23 06:45:23| INFO ref finished [took 46.6997s] 06/11/23 06:45:28| INFO atc_mc finished [took 50.6417s] 06/11/23 06:45:30| INFO mul_sld finished [took 61.5352s] 06/11/23 06:45:31| INFO mul_pacc finished [took 55.9055s] 06/11/23 06:45:31| INFO mulmc_sld finished [took 60.6608s] 06/11/23 06:45:33| INFO mulne_sld finished [took 60.1616s] 06/11/23 06:48:01| INFO bin_pacc finished [took 207.7543s] 06/11/23 06:48:02| INFO bin_sld finished [took 213.7056s] 06/11/23 06:48:03| INFO binmc_sld finished [took 213.7901s] 06/11/23 06:48:04| INFO binne_sld finished [took 212.4421s] 06/11/23 06:48:04| INFO Dataset sample 0.80 of dataset rcv1_GCAT_9prevs finished [took 217.4465s] 06/11/23 06:48:04| INFO Dataset sample 0.90 of dataset rcv1_GCAT_9prevs started 06/11/23 06:48:06| WARNING Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 06:48:07| WARNING Method binmc_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 06:48:09| WARNING Method binne_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 06:48:11| WARNING Method bin_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 06:48:13| WARNING Method mul_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 06:48:49| INFO ref finished [took 36.4085s] 06/11/23 06:48:53| INFO atc_mc finished [took 39.1380s] 06/11/23 06:48:54| INFO mulmc_sld finished [took 46.0254s] 06/11/23 06:48:55| INFO mulne_sld finished [took 45.1935s] 06/11/23 06:49:00| INFO mul_sld finished [took 53.9145s] 06/11/23 06:49:00| INFO Dataset sample 0.90 of dataset rcv1_GCAT_9prevs finished [took 55.9159s] 06/11/23 06:50:22| INFO dataset rcv1_MCAT_9prevs 06/11/23 06:50:27| INFO Dataset sample 0.10 of dataset rcv1_MCAT_9prevs started 06/11/23 06:51:29| INFO ref finished [took 47.8430s] 06/11/23 06:51:34| INFO atc_mc finished [took 51.2418s] 06/11/23 06:51:36| INFO mul_pacc finished [took 56.8770s] 06/11/23 06:52:00| INFO mulne_sld finished [took 85.8579s] 06/11/23 06:52:00| INFO mul_sld finished [took 90.6401s] 06/11/23 06:52:12| INFO mulmc_sld finished [took 100.3728s] 06/11/23 06:54:15| INFO bin_pacc finished [took 217.8843s] 06/11/23 06:54:15| INFO bin_sld finished [took 226.6925s] 06/11/23 06:54:17| INFO binne_sld finished [took 224.5785s] 06/11/23 06:54:17| INFO binmc_sld finished [took 226.9490s] 06/11/23 06:54:17| INFO Dataset sample 0.10 of dataset rcv1_MCAT_9prevs finished [took 229.9256s] 06/11/23 06:54:17| INFO Dataset sample 0.20 of dataset rcv1_MCAT_9prevs started 06/11/23 06:55:14| INFO ref finished [took 46.7323s] 06/11/23 06:55:20| INFO atc_mc finished [took 51.0126s] 06/11/23 06:55:22| INFO mul_pacc finished [took 55.8357s] 06/11/23 06:55:23| INFO mulmc_sld finished [took 62.0464s] 06/11/23 06:55:24| INFO mul_sld finished [took 64.8106s] 06/11/23 06:55:25| INFO mulne_sld finished [took 61.6750s] 06/11/23 06:57:56| INFO bin_pacc finished [took 210.8901s] 06/11/23 06:57:56| INFO bin_sld finished [took 217.3461s] 06/11/23 06:57:57| INFO binmc_sld finished [took 216.6599s] 06/11/23 06:58:00| INFO binne_sld finished [took 216.9668s] 06/11/23 06:58:00| INFO Dataset sample 0.20 of dataset rcv1_MCAT_9prevs finished [took 222.3450s] 06/11/23 06:58:00| INFO Dataset sample 0.30 of dataset rcv1_MCAT_9prevs started 06/11/23 06:58:57| INFO ref finished [took 47.5989s] 06/11/23 06:59:02| INFO atc_mc finished [took 51.5080s] 06/11/23 06:59:04| INFO mul_pacc finished [took 56.1671s] 06/11/23 06:59:09| INFO mulmc_sld finished [took 65.0229s] 06/11/23 06:59:10| INFO mul_sld finished [took 68.8366s] 06/11/23 06:59:11| INFO mulne_sld finished [took 65.2964s] 06/11/23 07:01:39| INFO bin_pacc finished [took 212.3570s] 06/11/23 07:01:40| INFO bin_sld finished [took 219.3886s] 06/11/23 07:01:42| INFO binmc_sld finished [took 219.1471s] 06/11/23 07:01:43| INFO binne_sld finished [took 218.3714s] 06/11/23 07:01:43| INFO Dataset sample 0.30 of dataset rcv1_MCAT_9prevs finished [took 223.2305s] 06/11/23 07:01:43| INFO Dataset sample 0.40 of dataset rcv1_MCAT_9prevs started 06/11/23 07:02:40| INFO ref finished [took 47.3513s] 06/11/23 07:02:45| INFO atc_mc finished [took 51.3858s] 06/11/23 07:02:47| INFO mul_pacc finished [took 56.3829s] 06/11/23 07:02:50| INFO mul_sld finished [took 64.9257s] 06/11/23 07:02:50| INFO mulmc_sld finished [took 63.6515s] 06/11/23 07:02:52| INFO mulne_sld finished [took 63.8008s] 06/11/23 07:05:22| INFO bin_pacc finished [took 211.8418s] 06/11/23 07:05:22| INFO binmc_sld finished [took 216.4950s] 06/11/23 07:05:22| INFO bin_sld finished [took 218.2730s] 06/11/23 07:05:25| INFO binne_sld finished [took 217.6016s] 06/11/23 07:05:25| INFO Dataset sample 0.40 of dataset rcv1_MCAT_9prevs finished [took 222.4416s] 06/11/23 07:05:25| INFO Dataset sample 0.50 of dataset rcv1_MCAT_9prevs started 06/11/23 07:06:22| INFO ref finished [took 47.3783s] 06/11/23 07:06:27| INFO atc_mc finished [took 51.1924s] 06/11/23 07:06:30| INFO mul_pacc finished [took 56.3115s] 06/11/23 07:06:34| INFO mul_sld finished [took 66.6559s] 06/11/23 07:06:34| INFO mulmc_sld finished [took 65.2448s] 06/11/23 07:06:37| INFO mulne_sld finished [took 65.6557s] 06/11/23 07:09:03| INFO binmc_sld finished [took 214.4549s] 06/11/23 07:09:03| INFO bin_sld finished [took 216.8097s] 06/11/23 07:09:04| INFO bin_pacc finished [took 211.9484s] 06/11/23 07:09:06| INFO binne_sld finished [took 215.5010s] 06/11/23 07:09:06| INFO Dataset sample 0.50 of dataset rcv1_MCAT_9prevs finished [took 220.4788s] 06/11/23 07:09:06| INFO Dataset sample 0.60 of dataset rcv1_MCAT_9prevs started 06/11/23 07:10:03| INFO ref finished [took 47.0882s] 06/11/23 07:10:08| INFO atc_mc finished [took 51.1826s] 06/11/23 07:10:10| INFO mul_pacc finished [took 55.8766s] 06/11/23 07:10:14| INFO mulmc_sld finished [took 64.7175s] 06/11/23 07:10:15| INFO mul_sld finished [took 67.2892s] 06/11/23 07:10:17| INFO mulne_sld finished [took 64.9305s] 06/11/23 07:12:40| INFO bin_pacc finished [took 207.6921s] 06/11/23 07:12:41| INFO binmc_sld finished [took 212.3821s] 06/11/23 07:12:41| INFO bin_sld finished [took 214.5241s] 06/11/23 07:12:43| INFO binne_sld finished [took 212.5115s] 06/11/23 07:12:43| INFO Dataset sample 0.60 of dataset rcv1_MCAT_9prevs finished [took 217.3597s] 06/11/23 07:12:43| INFO Dataset sample 0.70 of dataset rcv1_MCAT_9prevs started 06/11/23 07:13:39| INFO ref finished [took 46.5374s] 06/11/23 07:13:45| INFO atc_mc finished [took 51.0121s] 06/11/23 07:13:47| INFO mul_pacc finished [took 55.4950s] 06/11/23 07:13:52| INFO mulmc_sld finished [took 64.7651s] 06/11/23 07:13:52| INFO mul_sld finished [took 67.0632s] 06/11/23 07:13:54| INFO mulne_sld finished [took 65.2533s] 06/11/23 07:16:18| INFO bin_pacc finished [took 207.9541s] 06/11/23 07:16:19| INFO bin_sld finished [took 214.6495s] 06/11/23 07:16:19| INFO binmc_sld finished [took 213.2167s] 06/11/23 07:16:24| INFO binne_sld finished [took 215.5646s] 06/11/23 07:16:24| INFO Dataset sample 0.70 of dataset rcv1_MCAT_9prevs finished [took 220.4851s] 06/11/23 07:16:24| INFO Dataset sample 0.80 of dataset rcv1_MCAT_9prevs started 06/11/23 07:17:20| INFO ref finished [took 46.7655s] 06/11/23 07:17:25| INFO atc_mc finished [took 50.9430s] 06/11/23 07:17:27| INFO mul_pacc finished [took 55.4948s] 06/11/23 07:17:44| INFO mul_sld finished [took 78.5002s] 06/11/23 07:17:46| INFO mulmc_sld finished [took 78.7519s] 06/11/23 07:17:48| INFO mulne_sld finished [took 78.4293s] 06/11/23 07:19:59| INFO bin_pacc finished [took 208.5200s] 06/11/23 07:20:02| INFO bin_sld finished [took 216.9046s] 06/11/23 07:20:03| INFO binmc_sld finished [took 216.2736s] 06/11/23 07:20:03| INFO binne_sld finished [took 214.9573s] 06/11/23 07:20:03| INFO Dataset sample 0.80 of dataset rcv1_MCAT_9prevs finished [took 219.7592s] 06/11/23 07:20:03| INFO Dataset sample 0.90 of dataset rcv1_MCAT_9prevs started 06/11/23 07:20:05| WARNING Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 07:20:06| WARNING Method binmc_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 07:20:08| WARNING Method binne_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 07:20:10| WARNING Method bin_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 07:20:12| WARNING Method mul_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 07:20:48| INFO ref finished [took 36.6985s] 06/11/23 07:20:52| INFO atc_mc finished [took 39.8292s] 06/11/23 07:20:55| INFO mulmc_sld finished [took 48.0943s] 06/11/23 07:20:56| INFO mul_sld finished [took 50.2138s] 06/11/23 07:20:57| INFO mulne_sld finished [took 47.9755s] 06/11/23 07:20:57| INFO Dataset sample 0.90 of dataset rcv1_MCAT_9prevs finished [took 53.5645s] ---------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------- 06/11/23 10:25:08| INFO dataset rcv1_CCAT_1prevs 06/11/23 10:25:12| INFO Dataset sample 0.50 of dataset rcv1_CCAT_1prevs started 06/11/23 10:26:02| INFO ref finished [took 43.6300s] 06/11/23 10:26:05| INFO atc_mc finished [took 46.2297s] 06/11/23 10:26:46| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00906) [took 88.7593s] 06/11/23 10:27:29| INFO mul_pacc_gs finished [took 132.4595s] 06/11/23 10:31:36| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00900) [took 379.8213s] 06/11/23 10:34:52| INFO bin_pacc_gs finished [took 576.1136s] ---------------------------------------------------------------------------------------------------- 06/11/23 10:55:40| INFO dataset rcv1_CCAT_1prevs 06/11/23 10:55:44| INFO Dataset sample 0.50 of dataset rcv1_CCAT_1prevs started 06/11/23 10:56:36| INFO ref finished [took 44.5230s] 06/11/23 10:56:40| INFO atc_mc finished [took 47.6566s] 06/11/23 10:57:20| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00927) [took 90.0830s] 06/11/23 10:58:04| INFO mul_pacc_gs finished [took 134.5283s] 06/11/23 11:02:12| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00974) [took 383.6784s] 06/11/23 11:05:24| INFO bin_pacc_gs finished [took 574.8730s] 06/11/23 11:10:45| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00775) [took 897.6622s] 06/11/23 11:11:27| INFO mul_sld_gs finished [took 940.1205s] 06/11/23 11:18:11| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00835) [took 1344.8544s] 06/11/23 11:21:09| INFO bin_sld_gs finished [took 1523.4358s] 06/11/23 11:21:09| INFO Dataset sample 0.50 of dataset rcv1_CCAT_1prevs finished [took 1525.2268s] ---------------------------------------------------------------------------------------------------- 06/11/23 11:21:26| INFO dataset rcv1_CCAT_1prevs 06/11/23 11:21:30| INFO Dataset sample 0.50 of dataset rcv1_CCAT_1prevs started 06/11/23 11:22:18| INFO ref finished [took 42.1948s] 06/11/23 11:22:23| INFO atc_mc finished [took 45.7857s] 06/11/23 11:23:02| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00987) [took 87.4022s] 06/11/23 11:23:45| INFO mul_pacc_gs finished [took 130.6127s] 06/11/23 11:27:48| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00925) [took 374.1460s] 06/11/23 11:29:46| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00775) [took 493.2309s] 06/11/23 11:30:30| INFO mul_sld_gs finished [took 537.7362s] 06/11/23 11:30:56| INFO bin_pacc_gs finished [took 562.8681s] 06/11/23 11:35:33| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00835) [took 840.9875s] 06/11/23 11:38:31| INFO bin_sld_gs finished [took 1019.8362s] 06/11/23 11:38:31| INFO Dataset sample 0.50 of dataset rcv1_CCAT_1prevs finished [took 1021.3535s] ---------------------------------------------------------------------------------------------------- 06/11/23 11:53:50| INFO dataset rcv1_CCAT_9prevs 06/11/23 11:53:56| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 06/11/23 11:56:45| INFO doc_feat finished [took 83.7957s] 06/11/23 11:56:58| INFO mulne_pacc finished [took 146.6577s] 06/11/23 11:57:03| INFO ref finished [took 120.2665s] 06/11/23 11:57:05| INFO mul_pacc finished [took 169.5909s] 06/11/23 11:57:07| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 06/11/23 11:57:08| INFO kfcv finished [took 130.0948s] 06/11/23 11:57:13| INFO mulmc_pacc finished [took 173.0431s] 06/11/23 11:57:16| INFO atc_mc finished [took 125.2363s] 06/11/23 11:57:17| INFO mul_sld finished [took 199.1179s] 06/11/23 11:57:18| INFO mul_cc finished [took 148.2203s] 06/11/23 11:57:20| INFO atc_ne finished [took 121.9570s] 06/11/23 11:57:39| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00899) [took 176.8809s] 06/11/23 11:58:48| INFO mul_pacc_gs finished [took 245.7641s] 06/11/23 12:00:56| INFO bin_pacc finished [took 409.8967s] 06/11/23 12:01:03| INFO bin_sld finished [took 426.0031s] 06/11/23 12:01:09| INFO binmc_pacc finished [took 412.9057s] 06/11/23 12:01:13| INFO bin_cc finished [took 389.4719s] 06/11/23 12:01:14| INFO binne_pacc finished [took 411.1276s] 06/11/23 12:02:20| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 12:03:18| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00719) [took 523.4665s] 06/11/23 12:04:44| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00644) [took 643.3372s] 06/11/23 12:05:27| INFO mul_sld_gs finished [took 686.5912s] 06/11/23 12:06:25| INFO bin_pacc_gs finished [took 710.5248s] 06/11/23 12:08:52| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00589) [took 892.3454s] 06/11/23 12:11:50| INFO bin_sld_gs finished [took 1070.2847s] 06/11/23 12:11:50| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 1073.7689s] 06/11/23 12:11:50| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 06/11/23 12:14:15| INFO doc_feat finished [took 80.2198s] 06/11/23 12:14:27| INFO ref finished [took 106.1446s] 06/11/23 12:14:36| INFO mul_pacc finished [took 155.8715s] 06/11/23 12:14:37| INFO mul_sld finished [took 162.7857s] 06/11/23 12:14:47| INFO kfcv finished [took 132.1178s] 06/11/23 12:14:55| INFO atc_mc finished [took 127.9109s] 06/11/23 12:14:57| INFO atc_ne finished [took 121.6128s] 06/11/23 12:14:58| INFO mulmc_pacc finished [took 173.9023s] 06/11/23 12:14:58| INFO mulne_pacc finished [took 167.2920s] 06/11/23 12:14:59| INFO mul_cc finished [took 147.7428s] 06/11/23 12:15:28| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.00931) [took 186.6087s] 06/11/23 12:16:44| INFO mul_pacc_gs finished [took 261.9352s] 06/11/23 12:18:49| INFO binmc_pacc finished [took 407.0394s] 06/11/23 12:18:50| INFO bin_pacc finished [took 410.4620s] 06/11/23 12:18:55| INFO bin_sld finished [took 422.8949s] 06/11/23 12:19:01| INFO binne_pacc finished [took 410.3575s] 06/11/23 12:19:03| INFO bin_cc finished [took 396.9482s] 06/11/23 12:20:14| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 12:20:41| INFO bin_sld_gsq finished [took 524.4318s] 06/11/23 12:21:23| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00784) [took 546.2730s] 06/11/23 12:22:36| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01221) [took 640.2364s] 06/11/23 12:23:20| INFO mul_sld_gs finished [took 683.6191s] 06/11/23 12:24:29| INFO bin_pacc_gs finished [took 732.6258s] 06/11/23 12:27:43| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00768) [took 948.8111s] 06/11/23 12:30:43| INFO bin_sld_gs finished [took 1128.0644s] 06/11/23 12:30:43| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 1132.7995s] 06/11/23 12:30:43| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 06/11/23 12:33:12| INFO mul_sld finished [took 146.3214s] 06/11/23 12:33:24| INFO mul_cc finished [took 118.2992s] 06/11/23 12:33:26| INFO doc_feat finished [took 96.3414s] 06/11/23 12:33:36| INFO atc_ne finished [took 108.2657s] 06/11/23 12:33:37| INFO mulne_pacc finished [took 155.4759s] 06/11/23 12:33:39| INFO atc_mc finished [took 119.0950s] 06/11/23 12:33:39| INFO mul_pacc finished [took 166.1039s] 06/11/23 12:33:40| INFO ref finished [took 122.3921s] 06/11/23 12:33:40| INFO mulmc_pacc finished [took 164.5722s] 06/11/23 12:33:43| INFO kfcv finished [took 131.6124s] 06/11/23 12:34:24| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': 'max_conf'} (score=0.00857) [took 188.0301s] 06/11/23 12:35:45| INFO mul_pacc_gs finished [took 269.4655s] 06/11/23 12:37:47| INFO binne_pacc finished [took 409.7038s] 06/11/23 12:37:47| INFO bin_sld finished [took 421.4590s] 06/11/23 12:37:55| INFO bin_pacc finished [took 423.8805s] 06/11/23 12:37:57| INFO binmc_pacc finished [took 422.8180s] 06/11/23 12:38:01| INFO bin_cc finished [took 400.2199s] 06/11/23 12:39:14| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 12:39:41| INFO bin_sld_gsq finished [took 531.7360s] 06/11/23 12:40:17| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00762) [took 549.6726s] 06/11/23 12:41:35| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00872) [took 646.0507s] 06/11/23 12:42:19| INFO mul_sld_gs finished [took 690.7431s] 06/11/23 12:43:25| INFO bin_pacc_gs finished [took 737.2287s] 06/11/23 12:47:07| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00782) [took 979.3211s] 06/11/23 12:50:07| INFO bin_sld_gs finished [took 1159.4207s] 06/11/23 12:50:07| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 1163.9370s] 06/11/23 12:50:07| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 06/11/23 12:52:34| INFO doc_feat finished [took 79.3857s] 06/11/23 12:52:39| INFO mul_pacc finished [took 143.2358s] 06/11/23 12:52:49| INFO mul_sld finished [took 159.6160s] 06/11/23 12:52:58| INFO kfcv finished [took 121.1756s] 06/11/23 12:53:07| INFO mulmc_pacc finished [took 167.6154s] 06/11/23 12:53:09| INFO atc_ne finished [took 115.9704s] 06/11/23 12:53:11| INFO ref finished [took 127.9906s] 06/11/23 12:53:17| INFO atc_mc finished [took 129.9605s] 06/11/23 12:53:19| INFO mulne_pacc finished [took 166.1444s] 06/11/23 12:53:21| INFO mul_cc finished [took 152.0451s] 06/11/23 12:53:45| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00832) [took 183.1015s] 06/11/23 12:55:03| INFO mul_pacc_gs finished [took 261.6088s] 06/11/23 12:57:20| INFO binmc_pacc finished [took 422.6680s] 06/11/23 12:57:23| INFO bin_sld finished [took 434.1109s] 06/11/23 12:57:26| INFO bin_pacc finished [took 431.1893s] 06/11/23 12:57:28| INFO binne_pacc finished [took 427.7980s] 06/11/23 12:57:29| INFO bin_cc finished [took 402.6463s] 06/11/23 12:58:43| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 12:59:20| INFO bin_sld_gsq finished [took 546.8013s] 06/11/23 12:59:48| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.00858) [took 550.8127s] 06/11/23 13:01:04| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01037) [took 652.8483s] 06/11/23 13:01:47| INFO mul_sld_gs finished [took 695.7927s] 06/11/23 13:02:56| INFO bin_pacc_gs finished [took 739.4380s] 06/11/23 13:06:49| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01112) [took 999.0699s] 06/11/23 13:09:50| INFO bin_sld_gs finished [took 1179.8181s] 06/11/23 13:09:50| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 1183.4124s] 06/11/23 13:09:50| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 06/11/23 13:12:34| INFO doc_feat finished [took 88.8963s] 06/11/23 13:12:43| INFO mul_sld finished [took 169.3932s] 06/11/23 13:12:47| INFO mul_pacc finished [took 166.5633s] 06/11/23 13:12:50| INFO kfcv finished [took 134.2527s] 06/11/23 13:12:58| INFO ref finished [took 128.7367s] 06/11/23 13:12:59| INFO mulne_pacc finished [took 161.0902s] 06/11/23 13:13:00| INFO mulmc_pacc finished [took 176.8006s] 06/11/23 13:13:01| INFO atc_mc finished [took 129.5173s] 06/11/23 13:13:06| INFO atc_ne finished [took 122.8886s] 06/11/23 13:13:16| INFO mul_cc finished [took 152.5218s] 06/11/23 13:13:34| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.00774) [took 183.0928s] 06/11/23 13:14:57| INFO mul_pacc_gs finished [took 266.4369s] 06/11/23 13:17:06| INFO bin_pacc finished [took 427.3693s] 06/11/23 13:17:08| INFO binmc_pacc finished [took 426.6359s] 06/11/23 13:17:14| INFO bin_sld finished [took 441.7834s] 06/11/23 13:17:20| INFO binne_pacc finished [took 435.6569s] 06/11/23 13:17:22| INFO bin_cc finished [took 412.7263s] 06/11/23 13:18:20| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 13:19:06| INFO bin_sld_gsq finished [took 549.0379s] 06/11/23 13:19:27| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': 'max_conf'} (score=0.00709) [took 545.0306s] 06/11/23 13:20:41| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00572) [took 645.5669s] 06/11/23 13:21:25| INFO mul_sld_gs finished [took 689.4814s] 06/11/23 13:22:32| INFO bin_pacc_gs finished [took 730.0602s] 06/11/23 13:26:21| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00653) [took 985.8522s] 06/11/23 13:29:21| INFO bin_sld_gs finished [took 1166.4200s] 06/11/23 13:29:21| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 1170.8744s] 06/11/23 13:29:21| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 06/11/23 13:31:52| INFO doc_feat finished [took 80.3058s] 06/11/23 13:32:00| INFO mul_sld finished [took 153.1261s] 06/11/23 13:32:00| INFO mul_pacc finished [took 148.0156s] 06/11/23 13:32:13| INFO kfcv finished [took 122.2270s] 06/11/23 13:32:13| INFO mulne_pacc finished [took 145.0130s] 06/11/23 13:32:22| INFO ref finished [took 122.3525s] 06/11/23 13:32:23| INFO atc_mc finished [took 120.2587s] 06/11/23 13:32:23| INFO atc_ne finished [took 113.5667s] 06/11/23 13:32:23| INFO mulmc_pacc finished [took 167.7106s] 06/11/23 13:32:36| INFO mul_cc finished [took 143.6517s] 06/11/23 13:33:04| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00802) [took 182.2049s] 06/11/23 13:34:23| INFO mul_pacc_gs finished [took 261.0038s] 06/11/23 13:36:19| INFO binmc_pacc finished [took 405.9199s] 06/11/23 13:36:31| INFO bin_sld finished [took 426.3780s] 06/11/23 13:36:32| INFO bin_pacc finished [took 420.2833s] 06/11/23 13:36:34| INFO binne_pacc finished [took 417.2048s] 06/11/23 13:36:42| INFO bin_cc finished [took 394.3524s] 06/11/23 13:37:45| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 13:38:18| INFO bin_sld_gsq finished [took 528.6956s] 06/11/23 13:38:52| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00707) [took 544.2769s] 06/11/23 13:39:56| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00637) [took 628.0656s] 06/11/23 13:40:41| INFO mul_sld_gs finished [took 673.3968s] 06/11/23 13:41:58| INFO bin_pacc_gs finished [took 730.5371s] 06/11/23 13:45:27| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00544) [took 960.1061s] 06/11/23 13:48:28| INFO bin_sld_gs finished [took 1140.6073s] 06/11/23 13:48:28| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 1146.6395s] 06/11/23 13:48:28| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 06/11/23 13:50:49| INFO mul_pacc finished [took 130.9408s] 06/11/23 13:51:02| INFO doc_feat finished [took 86.2411s] 06/11/23 13:51:07| INFO mul_sld finished [took 155.4513s] 06/11/23 13:51:15| INFO atc_ne finished [took 101.0761s] 06/11/23 13:51:20| INFO ref finished [took 121.3689s] 06/11/23 13:51:20| INFO atc_mc finished [took 106.6415s] 06/11/23 13:51:22| INFO mulmc_pacc finished [took 160.4221s] 06/11/23 13:51:22| INFO mulne_pacc finished [took 150.1203s] 06/11/23 13:51:25| INFO kfcv finished [took 127.5280s] 06/11/23 13:51:35| INFO mul_cc finished [took 145.4437s] 06/11/23 13:52:03| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00886) [took 182.0543s] 06/11/23 13:53:23| INFO mul_pacc_gs finished [took 262.2496s] 06/11/23 13:55:28| INFO bin_sld finished [took 417.7315s] 06/11/23 13:55:30| INFO binmc_pacc finished [took 410.0114s] 06/11/23 13:55:30| INFO bin_pacc finished [took 413.5912s] 06/11/23 13:55:35| INFO binne_pacc finished [took 411.8241s] 06/11/23 13:55:42| INFO bin_cc finished [took 396.5011s] 06/11/23 13:56:50| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 13:57:22| INFO bin_sld_gsq finished [took 527.2507s] 06/11/23 13:58:03| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.01, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00910) [took 547.7641s] 06/11/23 13:59:09| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00765) [took 634.8469s] 06/11/23 13:59:54| INFO mul_sld_gs finished [took 680.2027s] 06/11/23 14:01:07| INFO bin_pacc_gs finished [took 731.8655s] 06/11/23 14:04:33| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01235) [took 960.6861s] 06/11/23 14:07:34| INFO bin_sld_gs finished [took 1141.7199s] 06/11/23 14:07:34| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 1146.2680s] 06/11/23 14:07:34| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 06/11/23 14:10:08| INFO mulmc_pacc finished [took 141.2266s] 06/11/23 14:10:19| INFO atc_ne finished [took 101.4512s] 06/11/23 14:10:20| INFO mul_sld finished [took 162.5808s] 06/11/23 14:10:23| INFO mul_pacc finished [took 158.9068s] 06/11/23 14:10:30| INFO kfcv finished [took 123.4790s] 06/11/23 14:10:33| INFO mulne_pacc finished [took 158.4983s] 06/11/23 14:10:33| INFO doc_feat finished [took 111.7987s] 06/11/23 14:10:35| INFO ref finished [took 124.4184s] 06/11/23 14:10:40| INFO atc_mc finished [took 126.3543s] 06/11/23 14:10:40| INFO mul_cc finished [took 139.5958s] 06/11/23 14:11:16| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.01309) [took 184.0645s] 06/11/23 14:12:44| INFO mul_pacc_gs finished [took 272.5404s] 06/11/23 14:14:32| INFO binmc_pacc finished [took 406.3609s] 06/11/23 14:14:38| INFO bin_pacc finished [took 414.8972s] 06/11/23 14:14:43| INFO binne_pacc finished [took 414.4123s] 06/11/23 14:14:51| INFO bin_cc finished [took 395.5254s] 06/11/23 14:14:55| INFO bin_sld finished [took 437.7681s] 06/11/23 14:15:58| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 14:16:33| INFO bin_sld_gsq finished [took 532.4040s] 06/11/23 14:16:57| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.00812) [took 536.4746s] 06/11/23 14:18:16| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01306) [took 636.4067s] 06/11/23 14:19:00| INFO mul_sld_gs finished [took 680.2467s] 06/11/23 14:20:01| INFO bin_pacc_gs finished [took 720.9205s] 06/11/23 14:23:33| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00894) [took 954.4487s] 06/11/23 14:26:41| INFO bin_sld_gs finished [took 1142.3328s] 06/11/23 14:26:41| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 1146.7713s] 06/11/23 14:26:41| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 06/11/23 14:29:04| INFO mul_pacc finished [took 133.1736s] 06/11/23 14:29:07| INFO ref finished [took 87.1594s] 06/11/23 14:29:16| INFO doc_feat finished [took 83.8190s] 06/11/23 14:29:21| INFO mulmc_pacc finished [took 147.5202s] 06/11/23 14:29:22| INFO atc_mc finished [took 99.1039s] 06/11/23 14:29:23| INFO kfcv finished [took 109.5348s] 06/11/23 14:29:27| INFO mulne_pacc finished [took 148.1672s] 06/11/23 14:29:33| INFO atc_ne finished [took 101.4673s] 06/11/23 14:29:36| INFO mul_cc finished [took 126.0447s] 06/11/23 14:29:42| INFO mul_sld finished [took 177.5880s] 06/11/23 14:30:16| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.001, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01497) [took 175.1432s] 06/11/23 14:31:33| INFO mul_pacc_gs finished [took 252.3399s] 06/11/23 14:33:34| INFO binmc_pacc finished [took 401.7891s] 06/11/23 14:33:35| INFO binne_pacc finished [took 400.4138s] 06/11/23 14:33:36| INFO bin_pacc finished [took 406.7598s] 06/11/23 14:33:48| INFO bin_cc finished [took 378.7595s] 06/11/23 14:33:48| INFO bin_sld finished [took 423.7366s] 06/11/23 14:34:47| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 14:35:26| INFO bin_sld_gsq finished [took 518.8996s] 06/11/23 14:36:13| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.001, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00880) [took 539.3992s] 06/11/23 14:37:09| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00808) [took 622.0419s] 06/11/23 14:37:53| INFO mul_sld_gs finished [took 666.0058s] 06/11/23 14:39:16| INFO bin_pacc_gs finished [took 722.5231s] 06/11/23 14:42:15| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00604) [took 929.3464s] 06/11/23 14:45:14| INFO bin_sld_gs finished [took 1108.7356s] 06/11/23 14:45:14| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 1113.2364s] 06/11/23 14:48:04| INFO dataset imdb_9prevs 06/11/23 14:48:14| INFO Dataset sample 0.10 of dataset imdb_9prevs started 06/11/23 14:48:17| WARNING Method mul_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 14:48:18| WARNING Method bin_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 14:48:31| INFO doc_feat finished [took 11.5257s] 06/11/23 14:48:36| INFO ref finished [took 18.5620s] 06/11/23 14:48:42| INFO kfcv finished [took 24.7227s] 06/11/23 14:48:44| INFO atc_ne finished [took 25.5676s] 06/11/23 14:48:46| INFO atc_mc finished [took 27.4910s] 06/11/23 14:48:50| INFO mulne_pacc finished [took 34.0415s] 06/11/23 14:48:57| INFO mulmc_pacc finished [took 41.7500s] 06/11/23 14:48:58| INFO mul_pacc finished [took 43.0162s] 06/11/23 14:48:58| INFO mul_cc finished [took 40.3279s] 06/11/23 14:49:16| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 06/11/23 14:49:26| INFO mul_sld finished [took 71.4588s] 06/11/23 14:50:10| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 06/11/23 14:52:12| INFO binne_pacc finished [took 236.2174s] 06/11/23 14:52:16| INFO binmc_pacc finished [took 240.4686s] 06/11/23 14:52:19| INFO bin_cc finished [took 241.9141s] 06/11/23 14:52:20| INFO bin_pacc finished [took 244.5632s] 06/11/23 14:52:23| INFO bin_sld finished [took 249.0477s] 06/11/23 14:53:48| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 14:55:38| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.03127) [took 443.6010s] 06/11/23 14:55:51| INFO mul_sld_gs finished [took 455.9932s] 06/11/23 14:55:51| INFO Dataset sample 0.10 of dataset imdb_9prevs finished [took 456.7746s] 06/11/23 14:55:51| INFO Dataset sample 0.20 of dataset imdb_9prevs started 06/11/23 14:56:07| INFO doc_feat finished [took 11.2758s] 06/11/23 14:56:18| INFO atc_mc finished [took 22.2986s] 06/11/23 14:56:22| INFO ref finished [took 26.3482s] 06/11/23 14:56:25| INFO kfcv finished [took 30.4761s] 06/11/23 14:56:29| INFO mul_pacc finished [took 36.5892s] 06/11/23 14:56:29| INFO mulmc_pacc finished [took 36.7773s] 06/11/23 14:56:38| INFO atc_ne finished [took 41.7824s] 06/11/23 14:56:41| INFO mulne_pacc finished [took 47.8318s] 06/11/23 14:56:41| INFO mul_cc finished [took 46.7221s] 06/11/23 14:56:55| INFO mul_sld finished [took 63.3547s] 06/11/23 14:57:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': 'max_conf'} (score=0.01017) [took 119.9166s] 06/11/23 14:58:15| INFO mul_pacc_gs finished [took 141.4446s] 06/11/23 15:00:38| INFO binne_pacc finished [took 285.5562s] 06/11/23 15:00:48| INFO bin_cc finished [took 293.8727s] 06/11/23 15:00:49| INFO binmc_pacc finished [took 296.7176s] 06/11/23 15:00:49| INFO bin_pacc finished [took 297.1868s] 06/11/23 15:01:03| INFO bin_sld finished [took 312.0358s] 06/11/23 15:02:29| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 15:02:34| INFO bin_sld_gsq finished [took 402.0748s] 06/11/23 15:03:56| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.01, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.00980) [took 482.9237s] 06/11/23 15:05:00| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01194) [took 548.0443s] 06/11/23 15:05:14| INFO mul_sld_gs finished [took 562.2966s] 06/11/23 15:06:30| INFO bin_pacc_gs finished [took 636.7956s] 06/11/23 15:10:36| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00924) [took 884.9748s] 06/11/23 15:13:11| INFO bin_sld_gs finished [took 1039.3282s] 06/11/23 15:13:11| INFO Dataset sample 0.20 of dataset imdb_9prevs finished [took 1040.0772s] 06/11/23 15:13:11| INFO Dataset sample 0.30 of dataset imdb_9prevs started 06/11/23 15:13:39| INFO doc_feat finished [took 22.8145s] 06/11/23 15:13:41| INFO atc_ne finished [took 24.3471s] 06/11/23 15:13:45| INFO ref finished [took 28.7559s] 06/11/23 15:13:52| INFO mulne_pacc finished [took 38.1365s] 06/11/23 15:13:53| INFO kfcv finished [took 37.4026s] 06/11/23 15:13:56| INFO atc_mc finished [took 39.4198s] 06/11/23 15:13:59| INFO mul_pacc finished [took 45.9542s] 06/11/23 15:13:59| INFO mul_cc finished [took 43.9076s] 06/11/23 15:13:59| INFO mulmc_pacc finished [took 45.9395s] 06/11/23 15:14:11| INFO mul_sld finished [took 59.8835s] 06/11/23 15:15:23| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.01028) [took 128.2866s] 06/11/23 15:15:44| INFO mul_pacc_gs finished [took 149.5820s] 06/11/23 15:18:03| INFO binne_pacc finished [took 289.3504s] 06/11/23 15:18:07| INFO bin_pacc finished [took 294.7115s] 06/11/23 15:18:14| INFO bin_cc finished [took 298.6839s] 06/11/23 15:18:14| INFO binmc_pacc finished [took 300.9499s] 06/11/23 15:18:14| INFO bin_sld finished [took 302.9035s] 06/11/23 15:19:46| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 15:20:05| INFO bin_sld_gsq finished [took 413.1151s] 06/11/23 15:21:23| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.00916) [took 488.7327s] 06/11/23 15:22:13| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00953) [took 541.2865s] 06/11/23 15:22:28| INFO mul_sld_gs finished [took 556.0867s] 06/11/23 15:23:57| INFO bin_pacc_gs finished [took 643.0717s] 06/11/23 15:27:32| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01064) [took 860.3135s] 06/11/23 15:30:05| INFO bin_sld_gs finished [took 1013.1878s] 06/11/23 15:30:05| INFO Dataset sample 0.30 of dataset imdb_9prevs finished [took 1014.3141s] 06/11/23 15:30:05| INFO Dataset sample 0.40 of dataset imdb_9prevs started 06/11/23 15:30:24| INFO doc_feat finished [took 13.8500s] 06/11/23 15:30:32| INFO ref finished [took 22.3531s] 06/11/23 15:30:41| INFO mul_pacc finished [took 34.1860s] 06/11/23 15:30:45| INFO atc_ne finished [took 34.8111s] 06/11/23 15:30:46| INFO kfcv finished [took 36.4055s] 06/11/23 15:30:49| INFO atc_mc finished [took 38.7978s] 06/11/23 15:30:49| INFO mulmc_pacc finished [took 42.4552s] 06/11/23 15:30:51| INFO mul_cc finished [took 42.6899s] 06/11/23 15:30:53| INFO mulne_pacc finished [took 45.2694s] 06/11/23 15:30:57| INFO mul_sld finished [took 51.2705s] 06/11/23 15:32:13| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01220) [took 124.5801s] 06/11/23 15:32:34| INFO mul_pacc_gs finished [took 145.3368s] 06/11/23 15:34:56| INFO binmc_pacc finished [took 289.1451s] 06/11/23 15:35:04| INFO bin_sld finished [took 298.3514s] 06/11/23 15:35:04| INFO binne_pacc finished [took 296.5538s] 06/11/23 15:35:05| INFO bin_pacc finished [took 298.5077s] 06/11/23 15:35:09| INFO bin_cc finished [took 300.1332s] 06/11/23 15:36:41| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 15:37:08| INFO bin_sld_gsq finished [took 421.3938s] 06/11/23 15:38:19| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.01137) [took 490.9644s] 06/11/23 15:38:58| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.01029) [took 531.8225s] 06/11/23 15:39:12| INFO mul_sld_gs finished [took 546.4524s] 06/11/23 15:40:53| INFO bin_pacc_gs finished [took 645.0957s] 06/11/23 15:44:48| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01176) [took 882.0550s] 06/11/23 15:47:19| INFO bin_sld_gs finished [took 1033.2802s] 06/11/23 15:47:19| INFO Dataset sample 0.40 of dataset imdb_9prevs finished [took 1034.1241s] 06/11/23 15:47:19| INFO Dataset sample 0.50 of dataset imdb_9prevs started 06/11/23 15:47:36| INFO doc_feat finished [took 11.6005s] 06/11/23 15:47:40| INFO ref finished [took 16.3058s] 06/11/23 15:47:50| INFO atc_mc finished [took 25.8745s] 06/11/23 15:47:52| INFO kfcv finished [took 29.0931s] 06/11/23 15:47:53| INFO atc_ne finished [took 28.8903s] 06/11/23 15:47:53| INFO mul_pacc finished [took 32.5473s] 06/11/23 15:48:00| INFO mul_cc finished [took 37.3478s] 06/11/23 15:48:01| INFO mulne_pacc finished [took 39.9745s] 06/11/23 15:48:02| INFO mulmc_pacc finished [took 40.5057s] 06/11/23 15:48:10| INFO mul_sld finished [took 50.1825s] 06/11/23 15:49:28| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.01107) [took 125.0329s] 06/11/23 15:49:49| INFO mul_pacc_gs finished [took 146.7316s] 06/11/23 15:52:15| INFO bin_cc finished [took 292.6719s] 06/11/23 15:52:15| INFO binne_pacc finished [took 293.9844s] 06/11/23 15:52:17| INFO bin_pacc finished [took 296.2830s] 06/11/23 15:52:21| INFO binmc_pacc finished [took 299.4873s] 06/11/23 15:52:23| INFO bin_sld finished [took 303.4889s] 06/11/23 15:53:57| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 15:54:18| INFO bin_sld_gsq finished [took 418.0959s] 06/11/23 15:55:32| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01038) [took 489.7797s] 06/11/23 15:56:17| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00885) [took 536.7408s] 06/11/23 15:56:33| INFO mul_sld_gs finished [took 552.5393s] 06/11/23 15:58:05| INFO bin_pacc_gs finished [took 643.1581s] 06/11/23 16:01:42| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00940) [took 862.6012s] 06/11/23 16:04:15| INFO bin_sld_gs finished [took 1015.3606s] 06/11/23 16:04:15| INFO Dataset sample 0.50 of dataset imdb_9prevs finished [took 1016.0642s] 06/11/23 16:04:15| INFO Dataset sample 0.60 of dataset imdb_9prevs started 06/11/23 16:04:40| INFO doc_feat finished [took 19.9628s] 06/11/23 16:04:41| INFO kfcv finished [took 21.8848s] 06/11/23 16:04:46| INFO ref finished [took 26.2613s] 06/11/23 16:04:56| INFO mulmc_pacc finished [took 38.6399s] 06/11/23 16:04:56| INFO atc_ne finished [took 35.7501s] 06/11/23 16:04:57| INFO atc_mc finished [took 37.3907s] 06/11/23 16:05:01| INFO mul_cc finished [took 41.6420s] 06/11/23 16:05:01| INFO mul_pacc finished [took 44.6898s] 06/11/23 16:05:02| INFO mulne_pacc finished [took 44.7679s] 06/11/23 16:05:12| INFO mul_sld finished [took 56.0834s] 06/11/23 16:06:24| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.01082) [took 125.2569s] 06/11/23 16:06:44| INFO mul_pacc_gs finished [took 146.2318s] 06/11/23 16:09:05| INFO binne_pacc finished [took 288.1949s] 06/11/23 16:09:10| INFO bin_pacc finished [took 293.3207s] 06/11/23 16:09:12| INFO bin_sld finished [took 296.1022s] 06/11/23 16:09:13| INFO binmc_pacc finished [took 296.4000s] 06/11/23 16:09:18| INFO bin_cc finished [took 299.1982s] 06/11/23 16:10:50| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 16:11:22| INFO bin_sld_gsq finished [took 425.6641s] 06/11/23 16:12:31| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00976) [took 492.8847s] 06/11/23 16:13:13| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00984) [took 536.8669s] 06/11/23 16:13:28| INFO mul_sld_gs finished [took 551.6187s] 06/11/23 16:15:03| INFO bin_pacc_gs finished [took 645.6602s] 06/11/23 16:19:24| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.01142) [took 907.7074s] 06/11/23 16:21:57| INFO bin_sld_gs finished [took 1060.9759s] 06/11/23 16:21:57| INFO Dataset sample 0.60 of dataset imdb_9prevs finished [took 1061.7730s] 06/11/23 16:21:57| INFO Dataset sample 0.70 of dataset imdb_9prevs started 06/11/23 16:22:23| INFO doc_feat finished [took 20.2428s] 06/11/23 16:22:34| INFO kfcv finished [took 32.1532s] 06/11/23 16:22:36| INFO ref finished [took 34.3738s] 06/11/23 16:22:38| INFO mul_sld finished [took 40.1101s] 06/11/23 16:22:40| INFO mul_cc finished [took 38.6722s] 06/11/23 16:22:41| INFO atc_mc finished [took 38.9379s] 06/11/23 16:22:43| INFO atc_ne finished [took 40.3132s] 06/11/23 16:22:43| INFO mulne_pacc finished [took 43.7833s] 06/11/23 16:22:44| INFO mulmc_pacc finished [took 44.4084s] 06/11/23 16:22:46| INFO mul_pacc finished [took 47.7998s] 06/11/23 16:24:08| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.01575) [took 127.2393s] 06/11/23 16:24:31| INFO mul_pacc_gs finished [took 150.2100s] 06/11/23 16:26:49| INFO bin_cc finished [took 288.6128s] 06/11/23 16:26:51| INFO bin_pacc finished [took 292.1757s] 06/11/23 16:26:52| INFO binne_pacc finished [took 293.0194s] 06/11/23 16:27:01| INFO binmc_pacc finished [took 302.5703s] 06/11/23 16:27:01| INFO bin_sld finished [took 303.9303s] 06/11/23 16:28:32| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 16:28:53| INFO bin_sld_gsq finished [took 414.4520s] 06/11/23 16:30:15| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01641) [took 494.7681s] 06/11/23 16:31:00| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01102) [took 542.3282s] 06/11/23 16:31:15| INFO mul_sld_gs finished [took 557.2859s] 06/11/23 16:32:49| INFO bin_pacc_gs finished [took 648.9428s] 06/11/23 16:36:23| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.02196) [took 864.7237s] 06/11/23 16:38:54| INFO bin_sld_gs finished [took 1015.9618s] 06/11/23 16:38:54| INFO Dataset sample 0.70 of dataset imdb_9prevs finished [took 1016.7743s] 06/11/23 16:38:54| INFO Dataset sample 0.80 of dataset imdb_9prevs started 06/11/23 16:39:19| INFO doc_feat finished [took 19.9639s] 06/11/23 16:39:22| INFO atc_mc finished [took 22.9650s] 06/11/23 16:39:26| INFO kfcv finished [took 27.9671s] 06/11/23 16:39:30| INFO mul_pacc finished [took 34.3899s] 06/11/23 16:39:31| INFO ref finished [took 32.4692s] 06/11/23 16:39:33| INFO mulne_pacc finished [took 37.2045s] 06/11/23 16:39:39| INFO atc_ne finished [took 39.7686s] 06/11/23 16:39:41| INFO mul_cc finished [took 42.9411s] 06/11/23 16:39:41| INFO mulmc_pacc finished [took 44.9724s] 06/11/23 16:39:46| INFO mul_sld finished [took 51.4269s] 06/11/23 16:40:59| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.01013) [took 122.2196s] 06/11/23 16:41:24| INFO mul_pacc_gs finished [took 146.7076s] 06/11/23 16:43:40| INFO binne_pacc finished [took 284.1154s] 06/11/23 16:43:52| INFO bin_pacc finished [took 296.8885s] 06/11/23 16:43:54| INFO bin_cc finished [took 297.1714s] 06/11/23 16:43:56| INFO binmc_pacc finished [took 300.6806s] 06/11/23 16:43:57| INFO bin_sld finished [took 302.6966s] 06/11/23 16:45:26| WARNING Method mul_sld_gsq failed. Exception: 'GridSearchQ' object has no attribute 'classes_' 06/11/23 16:45:41| INFO bin_sld_gsq finished [took 405.8247s] 06/11/23 16:47:00| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00949) [took 483.3129s] 06/11/23 16:47:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00785) [took 539.6504s] 06/11/23 16:48:09| INFO mul_sld_gs finished [took 553.8401s] 06/11/23 16:49:34| INFO bin_pacc_gs finished [took 637.2772s] 06/11/23 16:53:30| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.01, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01449) [took 875.8870s] 06/11/23 16:56:08| INFO bin_sld_gs finished [took 1033.4325s] 06/11/23 16:56:08| INFO Dataset sample 0.80 of dataset imdb_9prevs finished [took 1034.1983s] 06/11/23 16:56:08| INFO Dataset sample 0.90 of dataset imdb_9prevs started 06/11/23 16:56:09| WARNING Method mul_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:09| WARNING Method mul_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method mulmc_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method bin_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method mulne_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method bin_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method mul_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:10| WARNING Method binmc_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:11| WARNING Method binne_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:11| WARNING Method bin_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 16:56:22| INFO doc_feat finished [took 10.1613s] 06/11/23 16:56:25| INFO ref finished [took 13.7569s] 06/11/23 16:56:27| INFO kfcv finished [took 15.6337s] 06/11/23 16:56:29| INFO atc_mc finished [took 18.0104s] 06/11/23 16:56:30| INFO atc_ne finished [took 18.0260s] 06/11/23 16:56:31| INFO mul_cc finished [took 20.6201s] 06/11/23 16:56:40| INFO mul_sld finished [took 31.2942s] 06/11/23 16:56:47| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 16:58:55| INFO bin_cc finished [took 164.5182s] 06/11/23 16:58:59| INFO bin_sld finished [took 170.5046s] 06/11/23 17:02:17| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.04178) [took 368.6067s] 06/11/23 17:02:29| INFO mul_sld_gs finished [took 380.7801s] 06/11/23 17:02:29| INFO Dataset sample 0.90 of dataset imdb_9prevs finished [took 381.5305s] ---------------------------------------------------------------------------------------------------- 06/11/23 18:04:06| INFO dataset rcv1_GCAT_9prevs 06/11/23 18:04:12| INFO Dataset sample 0.10 of dataset rcv1_GCAT_9prevs started 06/11/23 18:04:19| WARNING Method mul_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:21| WARNING Method bin_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:22| WARNING Method mul_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:24| WARNING Method binmc_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:24| WARNING Method mulmc_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:26| WARNING Method binne_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:27| WARNING Method mulne_pacc failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:28| WARNING Method bin_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:04:29| WARNING Method mul_pacc_gs failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:05:10| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 06/11/23 18:05:41| INFO ref finished [took 65.3048s] 06/11/23 18:05:43| INFO kfcv finished [took 66.9585s] 06/11/23 18:05:45| INFO doc_feat finished [took 56.7504s] 06/11/23 18:05:49| INFO mul_cc finished [took 77.6035s] 06/11/23 18:05:49| INFO atc_mc finished [took 66.4650s] 06/11/23 18:05:52| INFO atc_ne finished [took 65.1035s] 06/11/23 18:05:52| WARNING Method bin_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 06/11/23 18:05:56| INFO mul_sld finished [took 101.3427s] 06/11/23 18:08:12| INFO bin_sld finished [took 238.6323s] 06/11/23 18:08:21| INFO bin_cc finished [took 230.3034s] 06/11/23 18:10:59| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00897) [took 402.3046s] 06/11/23 18:11:39| INFO mul_sld_gs finished [took 441.7473s] 06/11/23 18:11:39| INFO Dataset sample 0.10 of dataset rcv1_GCAT_9prevs finished [took 446.6543s] 06/11/23 18:11:39| INFO Dataset sample 0.20 of dataset rcv1_GCAT_9prevs started 06/11/23 18:14:11| INFO mulmc_pacc finished [took 140.5240s] 06/11/23 18:14:13| INFO kfcv finished [took 108.3325s] 06/11/23 18:14:16| INFO doc_feat finished [took 91.1407s] 06/11/23 18:14:21| INFO atc_ne finished [took 96.9645s] 06/11/23 18:14:22| INFO mul_pacc finished [took 154.9757s] 06/11/23 18:14:36| INFO ref finished [took 118.1583s] 06/11/23 18:14:37| INFO atc_mc finished [took 118.5016s] 06/11/23 18:14:41| INFO mulne_pacc finished [took 157.8831s] 06/11/23 18:14:49| INFO mul_cc finished [took 144.8053s] 06/11/23 18:14:50| INFO mul_sld finished [took 188.8450s] 06/11/23 18:15:19| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.01452) [took 184.0929s] 06/11/23 18:16:33| INFO mul_pacc_gs finished [took 258.2234s] 06/11/23 18:18:46| INFO binmc_pacc finished [took 417.1372s] 06/11/23 18:18:48| INFO bin_pacc finished [took 422.0619s] 06/11/23 18:18:52| INFO bin_sld finished [took 431.4426s] 06/11/23 18:18:56| INFO binne_pacc finished [took 421.5812s] 06/11/23 18:19:02| INFO bin_cc finished [took 402.4673s] 06/11/23 18:19:32| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 18:20:26| INFO bin_sld_gsq finished [took 522.0734s] 06/11/23 18:21:11| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01038) [took 540.4022s] 06/11/23 18:21:44| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00821) [took 600.6611s] 06/11/23 18:22:25| INFO mul_sld_gs finished [took 642.1063s] 06/11/23 18:24:14| INFO bin_pacc_gs finished [took 723.2605s] 06/11/23 18:26:54| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00816) [took 911.5066s] 06/11/23 18:29:56| INFO bin_sld_gs finished [took 1093.4674s] 06/11/23 18:29:56| INFO Dataset sample 0.20 of dataset rcv1_GCAT_9prevs finished [took 1096.7184s] 06/11/23 18:29:56| INFO Dataset sample 0.30 of dataset rcv1_GCAT_9prevs started 06/11/23 18:32:21| INFO ref finished [took 89.3355s] 06/11/23 18:32:33| INFO doc_feat finished [took 91.9119s] 06/11/23 18:32:35| INFO mulmc_pacc finished [took 147.2084s] 06/11/23 18:32:38| INFO mulne_pacc finished [took 137.0643s] 06/11/23 18:32:54| INFO atc_mc finished [took 117.6847s] 06/11/23 18:32:56| INFO kfcv finished [took 129.8598s] 06/11/23 18:33:00| INFO mul_pacc finished [took 174.5769s] 06/11/23 18:33:00| INFO mul_sld finished [took 181.1734s] 06/11/23 18:33:03| INFO atc_ne finished [took 123.9984s] 06/11/23 18:33:09| INFO mul_cc finished [took 148.8635s] 06/11/23 18:33:32| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00629) [took 177.7598s] 06/11/23 18:34:51| INFO mul_pacc_gs finished [took 256.4186s] 06/11/23 18:37:10| INFO bin_pacc finished [took 425.7912s] 06/11/23 18:37:12| INFO binmc_pacc finished [took 425.7599s] 06/11/23 18:37:14| INFO binne_pacc finished [took 424.0101s] 06/11/23 18:37:18| INFO bin_sld finished [took 440.4389s] 06/11/23 18:37:22| INFO bin_cc finished [took 407.2413s] 06/11/23 18:37:52| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 18:38:51| INFO bin_sld_gsq finished [took 529.6242s] 06/11/23 18:39:30| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.00489) [took 541.8062s] 06/11/23 18:40:02| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00615) [took 601.7630s] 06/11/23 18:40:45| INFO mul_sld_gs finished [took 644.5111s] 06/11/23 18:42:37| INFO bin_pacc_gs finished [took 729.3942s] 06/11/23 18:45:36| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00490) [took 936.3088s] 06/11/23 18:48:37| INFO bin_sld_gs finished [took 1117.0610s] 06/11/23 18:48:37| INFO Dataset sample 0.30 of dataset rcv1_GCAT_9prevs finished [took 1120.9681s] 06/11/23 18:48:37| INFO Dataset sample 0.40 of dataset rcv1_GCAT_9prevs started 06/11/23 18:51:02| INFO doc_feat finished [took 79.6380s] 06/11/23 18:51:20| INFO mulne_pacc finished [took 144.5625s] 06/11/23 18:51:30| INFO mul_sld finished [took 171.1473s] 06/11/23 18:51:35| INFO mulmc_pacc finished [took 166.1468s] 06/11/23 18:51:39| INFO mul_pacc finished [took 172.9449s] 06/11/23 18:51:43| INFO ref finished [took 132.2492s] 06/11/23 18:51:45| INFO kfcv finished [took 137.9538s] 06/11/23 18:51:52| INFO atc_mc finished [took 137.7185s] 06/11/23 18:51:54| INFO atc_ne finished [took 134.1066s] 06/11/23 18:51:59| INFO mul_cc finished [took 159.0670s] 06/11/23 18:52:11| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01049) [took 180.3366s] 06/11/23 18:53:38| INFO mul_pacc_gs finished [took 266.6075s] 06/11/23 18:56:00| INFO bin_sld finished [took 441.9022s] 06/11/23 18:56:02| INFO binne_pacc finished [took 431.1354s] 06/11/23 18:56:02| INFO binmc_pacc finished [took 434.5268s] 06/11/23 18:56:04| INFO bin_pacc finished [took 438.8400s] 06/11/23 18:56:07| INFO bin_cc finished [took 412.8827s] 06/11/23 18:56:38| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 18:57:38| INFO bin_sld_gsq finished [took 534.9970s] 06/11/23 18:58:15| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00762) [took 549.5790s] 06/11/23 18:58:58| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00692) [took 616.7506s] 06/11/23 18:59:43| INFO mul_sld_gs finished [took 661.6976s] 06/11/23 19:01:20| INFO bin_pacc_gs finished [took 735.1934s] 06/11/23 19:04:29| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00601) [took 948.3129s] 06/11/23 19:07:30| INFO bin_sld_gs finished [took 1129.1432s] 06/11/23 19:07:30| INFO Dataset sample 0.40 of dataset rcv1_GCAT_9prevs finished [took 1133.2853s] 06/11/23 19:07:30| INFO Dataset sample 0.50 of dataset rcv1_GCAT_9prevs started 06/11/23 19:10:11| INFO doc_feat finished [took 90.8028s] 06/11/23 19:10:12| INFO mul_sld finished [took 159.3725s] 06/11/23 19:10:17| INFO atc_mc finished [took 108.3872s] 06/11/23 19:10:20| INFO mulmc_pacc finished [took 158.7937s] 06/11/23 19:10:27| INFO kfcv finished [took 125.4384s] 06/11/23 19:10:32| INFO mul_cc finished [took 134.1449s] 06/11/23 19:10:33| INFO atc_ne finished [took 115.0137s] 06/11/23 19:10:33| INFO mul_pacc finished [took 173.4398s] 06/11/23 19:10:35| INFO ref finished [took 127.6900s] 06/11/23 19:10:35| INFO mulne_pacc finished [took 158.1989s] 06/11/23 19:11:06| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'confidence': 'max_conf'} (score=0.00893) [took 181.2645s] 06/11/23 19:12:28| INFO mul_pacc_gs finished [took 263.1619s] 06/11/23 19:14:45| INFO bin_sld finished [took 432.8401s] 06/11/23 19:14:48| INFO bin_pacc finished [took 430.1210s] 06/11/23 19:14:54| INFO binmc_pacc finished [took 433.8715s] 06/11/23 19:14:58| INFO bin_cc finished [took 405.7688s] 06/11/23 19:14:59| INFO binne_pacc finished [took 435.7315s] 06/11/23 19:15:29| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 19:16:36| INFO bin_sld_gsq finished [took 539.4078s] 06/11/23 19:17:05| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00831) [took 545.8362s] 06/11/23 19:17:45| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.001, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00797) [took 609.7895s] 06/11/23 19:18:32| INFO mul_sld_gs finished [took 657.1765s] 06/11/23 19:20:08| INFO bin_pacc_gs finished [took 728.9184s] 06/11/23 19:23:41| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00738) [took 966.8750s] 06/11/23 19:26:42| INFO bin_sld_gs finished [took 1148.2428s] 06/11/23 19:26:42| INFO Dataset sample 0.50 of dataset rcv1_GCAT_9prevs finished [took 1152.4463s] 06/11/23 19:26:43| INFO Dataset sample 0.60 of dataset rcv1_GCAT_9prevs started 06/11/23 19:29:16| INFO mul_pacc finished [took 142.3375s] 06/11/23 19:29:26| INFO doc_feat finished [took 92.0123s] 06/11/23 19:29:29| INFO atc_ne finished [took 96.1697s] 06/11/23 19:29:32| INFO mul_sld finished [took 164.7852s] 06/11/23 19:29:33| INFO ref finished [took 114.3664s] 06/11/23 19:29:36| INFO kfcv finished [took 118.4300s] 06/11/23 19:29:37| INFO atc_mc finished [took 111.6950s] 06/11/23 19:29:37| INFO mul_cc finished [took 127.8860s] 06/11/23 19:29:39| INFO mulmc_pacc finished [took 162.5217s] 06/11/23 19:29:46| INFO mulne_pacc finished [took 159.7535s] 06/11/23 19:30:22| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00832) [took 183.2267s] 06/11/23 19:31:42| INFO mul_pacc_gs finished [took 263.2959s] 06/11/23 19:33:48| INFO bin_pacc finished [took 415.7355s] 06/11/23 19:33:49| INFO binne_pacc finished [took 411.7032s] 06/11/23 19:33:49| INFO bin_sld finished [took 423.6935s] 06/11/23 19:33:56| INFO binmc_pacc finished [took 422.0731s] 06/11/23 19:34:02| INFO bin_cc finished [took 394.8074s] 06/11/23 19:34:45| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 19:35:33| INFO bin_sld_gsq finished [took 523.6794s] 06/11/23 19:36:10| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': 'max_conf'} (score=0.00651) [took 539.0149s] 06/11/23 19:36:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00646) [took 605.4721s] 06/11/23 19:37:37| INFO mul_sld_gs finished [took 647.9998s] 06/11/23 19:39:13| INFO bin_pacc_gs finished [took 722.3065s] 06/11/23 19:42:14| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00635) [took 926.2548s] 06/11/23 19:45:13| INFO bin_sld_gs finished [took 1105.8303s] 06/11/23 19:45:13| INFO Dataset sample 0.60 of dataset rcv1_GCAT_9prevs finished [took 1110.5345s] 06/11/23 19:45:13| INFO Dataset sample 0.70 of dataset rcv1_GCAT_9prevs started 06/11/23 19:47:55| INFO mul_pacc finished [took 151.2717s] 06/11/23 19:48:01| INFO mul_sld finished [took 164.7303s] 06/11/23 19:48:02| INFO doc_feat finished [took 95.7218s] 06/11/23 19:48:20| INFO kfcv finished [took 132.6414s] 06/11/23 19:48:26| INFO ref finished [took 136.4855s] 06/11/23 19:48:27| INFO mulmc_pacc finished [took 180.2510s] 06/11/23 19:48:30| INFO mulne_pacc finished [took 173.6996s] 06/11/23 19:48:33| INFO atc_mc finished [took 135.5939s] 06/11/23 19:48:34| INFO atc_ne finished [took 129.3719s] 06/11/23 19:48:35| INFO mul_cc finished [took 153.9587s] 06/11/23 19:48:47| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00782) [took 177.0918s] 06/11/23 19:50:13| INFO mul_pacc_gs finished [took 262.7047s] 06/11/23 19:52:34| INFO bin_pacc finished [took 431.9695s] 06/11/23 19:52:36| INFO binmc_pacc finished [took 430.1566s] 06/11/23 19:52:43| INFO bin_sld finished [took 446.4452s] 06/11/23 19:52:44| INFO bin_cc finished [took 407.8850s] 06/11/23 19:52:47| INFO binne_pacc finished [took 438.4423s] 06/11/23 19:53:19| WARNING Method mul_sld_gsq failed. Exception: 'function' object has no attribute 'classes_' 06/11/23 19:54:09| INFO bin_sld_gsq finished [took 528.9254s] 06/11/23 19:54:43| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.01, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00669) [took 545.8164s] 06/11/23 19:55:38| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00814) [took 619.0258s] 06/11/23 19:56:21| INFO mul_sld_gs finished [took 661.4303s] 06/11/23 19:57:51| INFO bin_pacc_gs finished [took 733.3970s] 06/11/23 20:00:54| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00795) [took 935.9973s] 06/11/23 20:03:55| INFO bin_sld_gs finished [took 1117.3981s] 06/11/23 20:03:55| INFO Dataset sample 0.70 of dataset rcv1_GCAT_9prevs finished [took 1121.8060s] 06/11/23 20:03:55| INFO Dataset sample 0.80 of dataset rcv1_GCAT_9prevs started 06/11/23 20:06:27| INFO mul_sld finished [took 147.0727s] 06/11/23 20:06:30| INFO doc_feat finished [took 81.1117s] 06/11/23 20:06:48| INFO mul_pacc finished [took 162.2312s] 06/11/23 20:07:04| INFO kfcv finished [took 133.4389s] 06/11/23 20:07:04| INFO ref finished [took 132.6728s] 06/11/23 20:07:05| INFO mulne_pacc finished [took 171.0782s] 06/11/23 20:07:08| INFO mulmc_pacc finished [took 179.6909s] 06/11/23 20:07:10| INFO atc_mc finished [took 130.5941s] 06/11/23 20:07:14| INFO mul_cc finished [took 150.3795s] 06/11/23 20:07:15| INFO atc_ne finished [took 131.0309s] 06/11/23 20:07:29| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00813) [took 177.7289s] 06/11/23 20:08:49| INFO mul_pacc_gs finished [took 257.9675s] 06/11/23 20:10:44| INFO bin_pacc finished [took 399.4800s] 06/11/23 21:01:51| INFO bin_pacc_gs finished [took 3446.1854s] 06/11/23 21:03:24| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00684) [took 3563.0699s] 06/11/23 21:04:07| INFO mul_sld_gs finished [took 3606.0194s] 06/11/23 21:08:24| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00519) [took 3863.9570s] 06/11/23 21:11:26| INFO bin_sld_gs finished [took 4046.4500s] 06/11/23 21:11:26| INFO Dataset sample 0.80 of dataset rcv1_GCAT_9prevs finished [took 4051.2016s] 06/11/23 21:11:26| INFO Dataset sample 0.90 of dataset rcv1_GCAT_9prevs started 06/11/23 21:11:31| WARNING Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:32| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:34| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:35| WARNING Method mul_sld_gsq failed. Exception: a must be greater than 0 unless no samples are taken 06/11/23 21:11:36| WARNING Method bin_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:38| WARNING Method mul_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 21:11:38| WARNING Method binmc_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:40| WARNING Method mulmc_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 21:11:40| WARNING Method binne_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:42| WARNING Method mulne_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 21:11:42| WARNING Method bin_pacc_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:11:44| WARNING Method mul_pacc_gs failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 21:11:44| WARNING Method bin_cc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 21:12:27| INFO mul_sld finished [took 56.8958s] 06/11/23 21:12:32| INFO ref finished [took 44.3311s] 06/11/23 21:12:32| INFO doc_feat finished [took 41.1551s] 06/11/23 21:12:33| INFO kfcv finished [took 46.1873s] 06/11/23 21:12:36| INFO atc_mc finished [took 47.9541s] 06/11/23 21:12:37| INFO mul_cc finished [took 51.8838s] 06/11/23 21:12:37| INFO atc_ne finished [took 47.4962s] 06/11/23 21:16:45| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00843) [took 312.8612s] 06/11/23 21:17:24| INFO mul_sld_gs finished [took 351.5693s] 06/11/23 21:17:24| INFO Dataset sample 0.90 of dataset rcv1_GCAT_9prevs finished [took 357.7321s] 06/11/23 21:20:10| INFO dataset rcv1_MCAT_9prevs 06/11/23 21:20:18| INFO Dataset sample 0.10 of dataset rcv1_MCAT_9prevs started 06/11/23 21:23:12| INFO doc_feat finished [took 81.2849s] 06/11/23 21:23:21| INFO mul_pacc finished [took 168.3242s] 06/11/23 21:23:30| INFO mulmc_pacc finished [took 173.2730s] 06/11/23 21:23:35| INFO atc_mc finished [took 115.3803s] 06/11/23 21:23:41| INFO ref finished [took 125.5611s] 06/11/23 21:23:41| INFO kfcv finished [took 136.3040s] 06/11/23 21:23:51| INFO mulne_pacc finished [took 185.3346s] 06/11/23 21:23:58| INFO atc_ne finished [took 129.7752s] 06/11/23 21:23:59| INFO mul_cc finished [took 164.3501s] 06/11/23 21:24:26| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': None, 'confidence': 'entropy'} (score=0.02036) [took 203.9839s] 06/11/23 21:24:32| INFO mul_sld finished [took 249.6979s] 06/11/23 21:25:50| INFO mul_pacc_gs finished [took 287.7634s] 06/11/23 21:28:08| INFO binne_pacc finished [took 443.1314s] 06/11/23 21:28:11| INFO bin_cc finished [took 427.7416s] 06/11/23 21:28:26| INFO bin_pacc finished [took 475.7859s] 06/11/23 21:28:28| INFO binmc_pacc finished [took 472.2702s] 06/11/23 21:28:33| INFO bin_sld finished [took 492.0457s] 06/11/23 21:29:19| INFO mul_sld_gsq finished [took 529.8190s] 06/11/23 21:29:26| INFO bin_sld_gsq finished [took 539.2552s] 06/11/23 21:30:30| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00591) [took 573.3773s] 06/11/23 21:31:27| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00754) [took 661.4704s] 06/11/23 21:32:10| INFO mul_sld_gs finished [took 704.6441s] 06/11/23 21:33:40| INFO bin_pacc_gs finished [took 763.3541s] 06/11/23 21:36:30| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00760) [took 965.4559s] 06/11/23 21:39:31| INFO bin_sld_gs finished [took 1146.5622s] 06/11/23 21:39:31| INFO Dataset sample 0.10 of dataset rcv1_MCAT_9prevs finished [took 1152.1700s] 06/11/23 21:39:31| INFO Dataset sample 0.20 of dataset rcv1_MCAT_9prevs started 06/11/23 21:42:13| INFO doc_feat finished [took 88.9970s] 06/11/23 21:42:24| INFO mul_pacc finished [took 161.9999s] 06/11/23 21:42:31| INFO mulmc_pacc finished [took 159.0109s] 06/11/23 21:42:34| INFO mul_sld finished [took 179.5397s] 06/11/23 21:42:42| INFO kfcv finished [took 138.3784s] 06/11/23 21:42:42| INFO atc_mc finished [took 127.5150s] 06/11/23 21:42:45| INFO ref finished [took 133.9163s] 06/11/23 21:42:48| INFO mulne_pacc finished [took 170.3191s] 06/11/23 21:42:53| INFO mul_cc finished [took 153.9952s] 06/11/23 21:42:57| INFO atc_ne finished [took 133.9857s] 06/11/23 21:43:07| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.01406) [took 179.2817s] 06/11/23 21:44:27| INFO mul_pacc_gs finished [took 259.4430s] 06/11/23 21:46:57| INFO bin_pacc finished [took 435.9586s] 06/11/23 21:47:02| INFO binmc_pacc finished [took 436.7170s] 06/11/23 21:47:02| INFO bin_sld finished [took 448.6901s] 06/11/23 21:47:03| INFO binne_pacc finished [took 430.3933s] 06/11/23 21:47:06| INFO bin_cc finished [took 413.3717s] 06/11/23 21:47:44| INFO mul_sld_gsq finished [took 485.8565s] 06/11/23 21:48:40| INFO bin_sld_gsq finished [took 542.6385s] 06/11/23 21:49:21| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.01029) [took 558.1111s] 06/11/23 21:49:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00862) [took 617.7204s] 06/11/23 21:50:38| INFO mul_sld_gs finished [took 661.3619s] 06/11/23 21:52:31| INFO bin_pacc_gs finished [took 747.8605s] 06/11/23 21:55:23| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00631) [took 947.6305s] 06/11/23 21:58:25| INFO bin_sld_gs finished [took 1128.9705s] 06/11/23 21:58:25| INFO Dataset sample 0.20 of dataset rcv1_MCAT_9prevs finished [took 1133.8038s] 06/11/23 21:58:25| INFO Dataset sample 0.30 of dataset rcv1_MCAT_9prevs started 06/11/23 22:01:11| INFO doc_feat finished [took 91.6284s] 06/11/23 22:01:13| INFO mul_pacc finished [took 157.8979s] 06/11/23 22:01:21| INFO ref finished [took 117.5064s] 06/11/23 22:01:29| INFO mulmc_pacc finished [took 171.3367s] 06/11/23 22:01:34| INFO kfcv finished [took 138.8623s] 06/11/23 22:01:44| INFO atc_ne finished [took 127.4515s] 06/11/23 22:01:45| INFO mulne_pacc finished [took 175.7659s] 06/11/23 22:01:45| INFO atc_mc finished [took 134.5717s] 06/11/23 22:01:47| INFO mul_sld finished [took 198.7132s] 06/11/23 22:01:53| INFO mul_cc finished [took 156.7010s] 06/11/23 22:01:56| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00920) [took 169.8061s] 06/11/23 22:03:15| INFO mul_pacc_gs finished [took 248.7885s] 06/11/23 22:05:47| INFO bin_pacc finished [took 433.9454s] 06/11/23 22:05:52| INFO binmc_pacc finished [took 435.7566s] 06/11/23 22:05:55| INFO binne_pacc finished [took 432.5216s] 06/11/23 22:06:02| INFO bin_sld finished [took 455.4425s] 06/11/23 22:06:03| INFO bin_cc finished [took 409.9712s] 06/11/23 22:06:43| INFO mul_sld_gsq finished [took 490.7571s] 06/11/23 22:07:34| INFO bin_sld_gsq finished [took 542.4371s] 06/11/23 22:08:10| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': None} (score=0.00585) [took 557.7911s] 06/11/23 22:08:29| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00589) [took 598.8338s] 06/11/23 22:09:12| INFO mul_sld_gs finished [took 641.4050s] 06/11/23 22:11:15| INFO bin_pacc_gs finished [took 742.8423s] 06/11/23 22:14:10| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00443) [took 940.7448s] 06/11/23 22:17:12| INFO bin_sld_gs finished [took 1122.5660s] 06/11/23 22:17:12| INFO Dataset sample 0.30 of dataset rcv1_MCAT_9prevs finished [took 1126.9865s] 06/11/23 22:17:12| INFO Dataset sample 0.40 of dataset rcv1_MCAT_9prevs started 06/11/23 22:19:32| INFO ref finished [took 85.6333s] 06/11/23 22:19:43| INFO mulmc_pacc finished [took 138.3833s] 06/11/23 22:19:44| INFO doc_feat finished [took 84.2844s] 06/11/23 22:19:54| INFO atc_ne finished [took 99.6744s] 06/11/23 22:19:57| INFO kfcv finished [took 114.5018s] 06/11/23 22:19:59| INFO mul_cc finished [took 123.4161s] 06/11/23 22:20:05| INFO mul_pacc finished [took 163.4607s] 06/11/23 22:20:09| INFO mul_sld finished [took 173.7721s] 06/11/23 22:20:16| INFO mulne_pacc finished [took 162.8502s] 06/11/23 22:20:16| INFO atc_mc finished [took 124.1504s] 06/11/23 22:20:36| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00596) [took 169.9575s] 06/11/23 22:21:55| INFO mul_pacc_gs finished [took 248.8139s] 06/11/23 22:24:04| INFO binmc_pacc finished [took 400.7570s] 06/11/23 22:24:12| INFO bin_pacc finished [took 411.2454s] 06/11/23 22:24:21| INFO binne_pacc finished [took 414.5496s] 06/11/23 22:24:21| INFO bin_cc finished [took 389.2880s] 06/11/23 22:24:25| INFO bin_sld finished [took 431.6256s] 06/11/23 22:25:13| INFO mul_sld_gsq finished [took 474.0621s] 06/11/23 22:25:54| INFO bin_sld_gsq finished [took 515.9435s] 06/11/23 22:26:41| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00626) [took 539.2315s] 06/11/23 22:27:11| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00612) [took 594.2222s] 06/11/23 22:27:54| INFO mul_sld_gs finished [took 637.0683s] 06/11/23 22:29:48| INFO bin_pacc_gs finished [took 725.8952s] 06/11/23 22:33:01| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00682) [took 945.7122s] 06/11/23 22:36:02| INFO bin_sld_gs finished [took 1126.7133s] 06/11/23 22:36:02| INFO Dataset sample 0.40 of dataset rcv1_MCAT_9prevs finished [took 1130.5566s] 06/11/23 22:36:02| INFO Dataset sample 0.50 of dataset rcv1_MCAT_9prevs started 06/11/23 22:38:42| INFO doc_feat finished [took 76.3995s] 06/11/23 22:39:04| INFO mul_pacc finished [took 170.8108s] 06/11/23 22:39:11| INFO mulmc_pacc finished [took 169.1537s] 06/11/23 22:39:22| INFO ref finished [took 134.5551s] 06/11/23 22:39:23| INFO kfcv finished [took 144.5049s] 06/11/23 22:39:28| INFO mul_sld finished [took 201.7112s] 06/11/23 22:39:31| INFO atc_ne finished [took 127.5871s] 06/11/23 22:39:32| INFO atc_mc finished [took 141.1615s] 06/11/23 22:39:33| INFO mulne_pacc finished [took 181.7155s] 06/11/23 22:39:34| INFO mul_cc finished [took 156.9505s] 06/11/23 22:39:37| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.00848) [took 178.6463s] 06/11/23 22:41:02| INFO mul_pacc_gs finished [took 264.1109s] 06/11/23 22:43:34| INFO binmc_pacc finished [took 438.9742s] 06/11/23 22:43:34| INFO bin_pacc finished [took 442.7005s] 06/11/23 22:43:43| INFO bin_sld finished [took 458.4940s] 06/11/23 22:43:44| INFO binne_pacc finished [took 443.0455s] 06/11/23 22:43:55| INFO bin_cc finished [took 423.6361s] 06/11/23 22:44:45| INFO mul_sld_gsq finished [took 514.4586s] 06/11/23 22:45:32| INFO bin_sld_gsq finished [took 562.7681s] 06/11/23 22:46:12| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00790) [took 574.1156s] 06/11/23 22:46:42| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00824) [took 633.5645s] 06/11/23 22:47:24| INFO mul_sld_gs finished [took 676.3552s] 06/11/23 22:49:27| INFO bin_pacc_gs finished [took 768.3574s] 06/11/23 22:52:27| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00861) [took 979.5729s] 06/11/23 22:55:32| INFO bin_sld_gs finished [took 1164.7331s] 06/11/23 22:55:32| INFO Dataset sample 0.50 of dataset rcv1_MCAT_9prevs finished [took 1169.2748s] 06/11/23 22:55:32| INFO Dataset sample 0.60 of dataset rcv1_MCAT_9prevs started 06/11/23 22:58:47| INFO doc_feat finished [took 112.6375s] 06/11/23 22:59:00| INFO kfcv finished [took 150.2412s] 06/11/23 22:59:00| INFO mul_pacc finished [took 197.0521s] 06/11/23 22:59:06| INFO mul_sld finished [took 209.9482s] 06/11/23 22:59:07| INFO mulmc_pacc finished [took 198.8911s] 06/11/23 22:59:07| INFO ref finished [took 148.7702s] 06/11/23 22:59:16| INFO atc_ne finished [took 143.7730s] 06/11/23 22:59:18| INFO atc_mc finished [took 151.2783s] 06/11/23 22:59:19| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.01122) [took 190.1694s] 06/11/23 22:59:26| INFO mul_cc finished [took 179.0100s] 06/11/23 22:59:33| INFO mulne_pacc finished [took 211.9002s] 06/11/23 23:00:52| INFO mul_pacc_gs finished [took 283.5718s] 06/11/23 23:03:21| INFO bin_sld finished [took 466.9682s] 06/11/23 23:03:24| INFO binmc_pacc finished [took 456.9500s] 06/11/23 23:03:25| INFO bin_pacc finished [took 464.1421s] 06/11/23 23:03:39| INFO bin_cc finished [took 445.8302s] 06/11/23 23:03:40| INFO binne_pacc finished [took 466.3427s] 06/11/23 23:04:10| INFO mul_sld_gsq finished [took 509.0584s] 06/11/23 23:04:56| INFO bin_sld_gsq finished [took 556.7578s] 06/11/23 23:05:48| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'confidence': None} (score=0.01033) [took 581.0899s] 06/11/23 23:06:14| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00791) [took 636.6955s] 06/11/23 23:07:00| INFO mul_sld_gs finished [took 682.1829s] 06/11/23 23:08:59| INFO bin_pacc_gs finished [took 772.0584s] 06/11/23 23:11:44| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00722) [took 966.7367s] 06/11/23 23:14:47| INFO bin_sld_gs finished [took 1150.2138s] 06/11/23 23:14:47| INFO Dataset sample 0.60 of dataset rcv1_MCAT_9prevs finished [took 1155.4582s] 06/11/23 23:14:47| INFO Dataset sample 0.70 of dataset rcv1_MCAT_9prevs started 06/11/23 23:17:29| INFO mulmc_pacc finished [took 140.6592s] 06/11/23 23:17:37| INFO doc_feat finished [took 93.5374s] 06/11/23 23:17:58| INFO mul_pacc finished [took 176.1101s] 06/11/23 23:18:06| INFO mulne_pacc finished [took 168.2578s] 06/11/23 23:18:06| INFO ref finished [took 138.9670s] 06/11/23 23:18:13| INFO atc_ne finished [took 133.8368s] 06/11/23 23:18:13| INFO mul_cc finished [took 156.3809s] 06/11/23 23:18:14| INFO atc_mc finished [took 140.7865s] 06/11/23 23:18:15| INFO kfcv finished [took 150.8563s] 06/11/23 23:18:28| INFO mul_sld finished [took 213.5502s] 06/11/23 23:18:37| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.00696) [took 184.7202s] 06/11/23 23:20:04| INFO mul_pacc_gs finished [took 271.8620s] 06/11/23 23:22:38| INFO binne_pacc finished [took 444.7274s] 06/11/23 23:22:39| INFO binmc_pacc finished [took 454.8866s] 06/11/23 23:22:39| INFO bin_pacc finished [took 458.6381s] 06/11/23 23:22:47| INFO bin_cc finished [took 432.1075s] 06/11/23 23:22:54| INFO bin_sld finished [took 480.5003s] 06/11/23 23:23:33| INFO mul_sld_gsq finished [took 514.0066s] 06/11/23 23:24:13| INFO bin_sld_gsq finished [took 554.7885s] 06/11/23 23:24:57| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.00603) [took 574.6463s] 06/11/23 23:25:06| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00528) [took 609.3079s] 06/11/23 23:25:51| INFO mul_sld_gs finished [took 654.2885s] 06/11/23 23:28:10| INFO bin_pacc_gs finished [took 767.8253s] 06/11/23 23:30:43| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00733) [took 947.2105s] 06/11/23 23:33:48| INFO bin_sld_gs finished [took 1132.1309s] 06/11/23 23:33:48| INFO Dataset sample 0.70 of dataset rcv1_MCAT_9prevs finished [took 1140.6743s] 06/11/23 23:33:48| INFO Dataset sample 0.80 of dataset rcv1_MCAT_9prevs started 06/11/23 23:36:55| INFO doc_feat finished [took 101.6311s] 06/11/23 23:37:16| INFO atc_ne finished [took 124.5854s] 06/11/23 23:37:39| INFO mulne_pacc finished [took 198.5060s] 06/11/23 23:37:42| INFO mulmc_pacc finished [took 210.8408s] 06/11/23 23:37:43| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'max_conf'} (score=0.01019) [took 194.4422s] 06/11/23 23:37:44| INFO mul_pacc finished [took 224.0155s] 06/11/23 23:37:44| INFO kfcv finished [took 178.0222s] 06/11/23 23:37:47| INFO ref finished [took 176.1278s] 06/11/23 23:37:55| INFO atc_mc finished [took 173.0154s] 06/11/23 23:37:58| INFO mul_cc finished [took 198.1420s] 06/11/23 23:38:10| INFO mul_sld finished [took 258.4898s] 06/11/23 23:39:25| INFO mul_pacc_gs finished [took 297.0552s] 06/11/23 23:41:55| INFO binmc_pacc finished [took 471.8397s] 06/11/23 23:42:06| INFO binne_pacc finished [took 470.6917s] 06/11/23 23:42:08| INFO bin_pacc finished [took 490.2025s] 06/11/23 23:42:11| INFO bin_sld finished [took 500.3974s] 06/11/23 23:42:17| INFO bin_cc finished [took 463.2719s] 06/11/23 23:42:33| INFO mul_sld_gsq finished [took 515.9211s] 06/11/23 23:43:19| INFO bin_sld_gsq finished [took 563.2792s] 06/11/23 23:44:05| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'confidence': 'entropy'} (score=0.01110) [took 580.7011s] 06/11/23 23:44:33| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00755) [took 638.9055s] 06/11/23 23:45:18| INFO mul_sld_gs finished [took 683.7473s] 06/11/23 23:47:14| INFO bin_pacc_gs finished [took 769.5136s] 06/11/23 23:50:19| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00653) [took 986.1331s] 06/11/23 23:53:23| INFO bin_sld_gs finished [took 1170.3407s] 06/11/23 23:53:23| INFO Dataset sample 0.80 of dataset rcv1_MCAT_9prevs finished [took 1175.4004s] 06/11/23 23:53:23| INFO Dataset sample 0.90 of dataset rcv1_MCAT_9prevs started 06/11/23 23:53:29| WARNING Method bin_sld failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:31| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:32| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:34| WARNING Method mul_sld_gsq failed. Exception: a must be greater than 0 unless no samples are taken 06/11/23 23:53:34| WARNING Method bin_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:36| WARNING Method mul_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 23:53:37| WARNING Method binmc_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:38| WARNING Method binne_pacc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:39| WARNING Method mulmc_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 23:53:41| WARNING Method mulne_pacc failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 23:53:41| WARNING Method bin_pacc_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:53:43| WARNING Method mul_pacc_gs failed. Exception: could not broadcast input array from shape (3,) into shape (4,) 06/11/23 23:53:44| WARNING Method bin_cc failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 06/11/23 23:54:33| INFO ref finished [took 46.5615s] 06/11/23 23:54:34| INFO doc_feat finished [took 43.4254s] 06/11/23 23:54:34| INFO kfcv finished [took 48.7260s] 06/11/23 23:54:34| INFO mul_sld finished [took 64.5496s] 06/11/23 23:54:38| INFO atc_mc finished [took 49.9172s] 06/11/23 23:54:39| INFO atc_ne finished [took 49.8635s] 06/11/23 23:54:39| INFO mul_cc finished [took 54.7417s] 06/11/23 23:58:27| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01247) [took 295.7388s] 06/11/23 23:59:08| INFO mul_sld_gs finished [took 336.2009s] 06/11/23 23:59:08| INFO Dataset sample 0.90 of dataset rcv1_MCAT_9prevs finished [took 344.1389s] ---------------------------------------------------------------------------------------------------- 07/11/23 01:05:25| INFO dataset rcv1_CCAT_9prevs 07/11/23 01:05:30| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs started 07/11/23 01:06:23| INFO ref finished [took 48.3560s] 07/11/23 01:06:29| INFO atc_mc finished [took 52.9929s] 07/11/23 01:06:30| INFO atc_ne finished [took 53.3908s] 07/11/23 01:07:06| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 07/11/23 01:11:38| INFO mul_sld_gsq finished [took 364.0698s] 07/11/23 01:13:51| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00644) [took 499.4945s] 07/11/23 01:14:34| INFO mul_sld_gs finished [took 542.6047s] 07/11/23 01:18:02| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00589) [took 750.8663s] 07/11/23 01:21:01| INFO bin_sld_gs finished [took 930.1356s] 07/11/23 01:21:01| INFO Dataset sample 0.10 of dataset rcv1_CCAT_9prevs finished [took 931.4321s] 07/11/23 01:21:01| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs started 07/11/23 01:22:02| INFO ref finished [took 55.2212s] 07/11/23 01:22:07| INFO atc_mc finished [took 59.3890s] 07/11/23 01:22:09| INFO atc_ne finished [took 59.7388s] 07/11/23 01:27:21| INFO mul_sld_gsq finished [took 375.2352s] 07/11/23 01:27:24| INFO bin_sld_gsq finished [took 379.6159s] 07/11/23 01:29:25| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01221) [took 502.0302s] 07/11/23 01:30:08| INFO mul_sld_gs finished [took 545.0285s] 07/11/23 01:34:25| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00768) [took 802.3620s] 07/11/23 01:37:25| INFO bin_sld_gs finished [took 982.3260s] 07/11/23 01:37:25| INFO Dataset sample 0.20 of dataset rcv1_CCAT_9prevs finished [took 983.7236s] 07/11/23 01:37:25| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs started 07/11/23 01:38:20| INFO ref finished [took 49.9803s] 07/11/23 01:38:25| INFO atc_mc finished [took 53.3765s] 07/11/23 01:38:26| INFO atc_ne finished [took 53.8925s] 07/11/23 01:43:41| INFO mul_sld_gsq finished [took 372.2608s] 07/11/23 01:43:45| INFO bin_sld_gsq finished [took 377.3380s] 07/11/23 01:45:45| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00872) [took 497.5768s] 07/11/23 01:46:28| INFO mul_sld_gs finished [took 540.8267s] 07/11/23 01:51:09| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00782) [took 822.2849s] 07/11/23 01:54:10| INFO bin_sld_gs finished [took 1003.7804s] 07/11/23 01:54:10| INFO Dataset sample 0.30 of dataset rcv1_CCAT_9prevs finished [took 1005.2506s] 07/11/23 01:54:10| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs started 07/11/23 01:55:05| INFO ref finished [took 49.8884s] 07/11/23 01:55:09| INFO atc_mc finished [took 53.3594s] 07/11/23 01:55:10| INFO atc_ne finished [took 53.5162s] 07/11/23 02:00:25| INFO mul_sld_gsq finished [took 371.4460s] 07/11/23 02:00:41| INFO bin_sld_gsq finished [took 387.6183s] 07/11/23 02:02:30| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01037) [took 498.0096s] 07/11/23 02:03:11| INFO mul_sld_gs finished [took 539.1531s] 07/11/23 02:07:53| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01112) [took 821.8730s] 07/11/23 02:10:52| INFO bin_sld_gs finished [took 1001.0803s] 07/11/23 02:10:52| INFO Dataset sample 0.40 of dataset rcv1_CCAT_9prevs finished [took 1002.3085s] 07/11/23 02:10:52| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs started 07/11/23 02:11:44| INFO ref finished [took 47.2218s] 07/11/23 02:11:48| INFO atc_mc finished [took 49.6349s] 07/11/23 02:11:50| INFO atc_ne finished [took 50.9082s] 07/11/23 02:16:51| INFO mul_sld_gsq finished [took 354.3706s] 07/11/23 02:17:11| INFO bin_sld_gsq finished [took 376.0124s] 07/11/23 02:18:51| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00572) [took 476.0587s] 07/11/23 02:19:33| INFO mul_sld_gs finished [took 518.5692s] 07/11/23 02:24:17| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00653) [took 803.4978s] 07/11/23 02:27:16| INFO bin_sld_gs finished [took 982.4395s] 07/11/23 02:27:16| INFO Dataset sample 0.50 of dataset rcv1_CCAT_9prevs finished [took 983.7838s] 07/11/23 02:27:16| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs started 07/11/23 02:28:08| INFO ref finished [took 46.6191s] 07/11/23 02:28:13| INFO atc_mc finished [took 50.3543s] 07/11/23 02:28:15| INFO atc_ne finished [took 51.6601s] 07/11/23 02:33:15| INFO mul_sld_gsq finished [took 354.6014s] 07/11/23 02:33:34| INFO bin_sld_gsq finished [took 374.7872s] 07/11/23 02:35:14| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00637) [took 475.9302s] 07/11/23 02:35:57| INFO mul_sld_gs finished [took 518.5425s] 07/11/23 02:40:20| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00544) [took 782.7268s] 07/11/23 02:43:18| INFO bin_sld_gs finished [took 960.6334s] 07/11/23 02:43:18| INFO Dataset sample 0.60 of dataset rcv1_CCAT_9prevs finished [took 961.9030s] 07/11/23 02:43:18| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs started 07/11/23 02:44:10| INFO ref finished [took 47.1234s] 07/11/23 02:44:14| INFO atc_mc finished [took 49.9871s] 07/11/23 02:44:16| INFO atc_ne finished [took 50.9160s] 07/11/23 02:49:19| INFO mul_sld_gsq finished [took 357.0613s] 07/11/23 02:49:30| INFO bin_sld_gsq finished [took 368.8000s] 07/11/23 02:51:16| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00765) [took 475.7332s] 07/11/23 02:51:59| INFO mul_sld_gs finished [took 518.6671s] 07/11/23 02:56:28| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.1, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01235) [took 788.7117s] 07/11/23 02:59:28| INFO bin_sld_gs finished [took 968.7653s] 07/11/23 02:59:28| INFO Dataset sample 0.70 of dataset rcv1_CCAT_9prevs finished [took 970.1516s] 07/11/23 02:59:28| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs started 07/11/23 03:00:20| INFO ref finished [took 46.9898s] 07/11/23 03:00:24| INFO atc_mc finished [took 49.8768s] 07/11/23 03:00:25| INFO atc_ne finished [took 49.6324s] 07/11/23 03:05:23| INFO mul_sld_gsq finished [took 350.7932s] 07/11/23 03:05:32| INFO bin_sld_gsq finished [took 360.8665s] 07/11/23 03:07:25| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01306) [took 474.6581s] 07/11/23 03:08:07| INFO mul_sld_gs finished [took 516.4890s] 07/11/23 03:12:24| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00894) [took 774.9140s] 07/11/23 03:15:29| INFO bin_sld_gs finished [took 959.3579s] 07/11/23 03:15:29| INFO Dataset sample 0.80 of dataset rcv1_CCAT_9prevs finished [took 960.6992s] 07/11/23 03:15:29| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs started 07/11/23 03:16:21| INFO ref finished [took 47.3281s] 07/11/23 03:16:25| INFO atc_mc finished [took 49.8016s] 07/11/23 03:16:28| INFO atc_ne finished [took 51.2288s] 07/11/23 03:21:16| INFO mul_sld_gsq finished [took 343.2861s] 07/11/23 03:21:22| INFO bin_sld_gsq finished [took 349.6065s] 07/11/23 03:23:20| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00808) [took 468.7910s] 07/11/23 03:24:01| INFO mul_sld_gs finished [took 509.9001s] 07/11/23 03:28:03| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00604) [took 752.8185s] 07/11/23 03:31:01| INFO bin_sld_gs finished [took 930.3934s] 07/11/23 03:31:01| INFO Dataset sample 0.90 of dataset rcv1_CCAT_9prevs finished [took 931.7055s] 07/11/23 03:31:29| INFO dataset imdb_9prevs 07/11/23 03:31:37| INFO Dataset sample 0.10 of dataset imdb_9prevs started 07/11/23 03:31:49| INFO ref finished [took 11.4117s] 07/11/23 03:31:53| INFO atc_mc finished [took 14.8218s] 07/11/23 03:31:53| INFO atc_ne finished [took 14.8359s] 07/11/23 03:32:11| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 07/11/23 03:32:56| WARNING Method bin_sld_gsq failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 1 07/11/23 03:36:32| INFO mul_sld_gsq finished [took 294.6812s] 07/11/23 03:38:05| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.03127) [took 387.7698s] 07/11/23 03:38:18| INFO mul_sld_gs finished [took 400.7660s] 07/11/23 03:38:18| INFO Dataset sample 0.10 of dataset imdb_9prevs finished [took 401.3208s] 07/11/23 03:38:18| INFO Dataset sample 0.20 of dataset imdb_9prevs started 07/11/23 03:38:30| INFO ref finished [took 11.1665s] 07/11/23 03:38:34| INFO atc_mc finished [took 14.4483s] 07/11/23 03:38:34| INFO atc_ne finished [took 14.8634s] 07/11/23 03:43:16| INFO bin_sld_gsq finished [took 296.8786s] 07/11/23 03:43:32| INFO mul_sld_gsq finished [took 312.4588s] 07/11/23 03:45:44| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01194) [took 445.1331s] 07/11/23 03:45:58| INFO mul_sld_gs finished [took 459.5855s] 07/11/23 03:51:05| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00924) [took 766.1528s] 07/11/23 03:53:40| INFO bin_sld_gs finished [took 921.5996s] 07/11/23 03:53:40| INFO Dataset sample 0.20 of dataset imdb_9prevs finished [took 922.0949s] 07/11/23 03:53:40| INFO Dataset sample 0.30 of dataset imdb_9prevs started 07/11/23 03:53:53| INFO ref finished [took 11.5825s] 07/11/23 03:53:57| INFO atc_mc finished [took 14.8590s] 07/11/23 03:53:57| INFO atc_ne finished [took 15.3090s] 07/11/23 03:58:53| INFO mul_sld_gsq finished [took 311.9891s] 07/11/23 03:58:54| INFO bin_sld_gsq finished [took 313.1182s] 07/11/23 04:01:03| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.00953) [took 441.3198s] 07/11/23 04:01:18| INFO mul_sld_gs finished [took 456.2347s] 07/11/23 04:06:06| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01064) [took 745.0596s] 07/11/23 04:08:40| INFO bin_sld_gs finished [took 898.9046s] 07/11/23 04:08:40| INFO Dataset sample 0.30 of dataset imdb_9prevs finished [took 899.6778s] 07/11/23 04:08:40| INFO Dataset sample 0.40 of dataset imdb_9prevs started 07/11/23 04:08:52| INFO ref finished [took 11.0605s] 07/11/23 04:08:56| INFO atc_mc finished [took 14.9590s] 07/11/23 04:08:56| INFO atc_ne finished [took 14.8804s] 07/11/23 04:13:54| INFO mul_sld_gsq finished [took 313.3797s] 07/11/23 04:13:56| INFO bin_sld_gsq finished [took 315.5862s] 07/11/23 04:15:54| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.01029) [took 432.9025s] 07/11/23 04:16:08| INFO mul_sld_gs finished [took 447.1098s] 07/11/23 04:21:25| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01176) [took 764.2230s] 07/11/23 04:23:56| INFO bin_sld_gs finished [took 915.4905s] 07/11/23 04:23:56| INFO Dataset sample 0.40 of dataset imdb_9prevs finished [took 916.1187s] 07/11/23 04:23:56| INFO Dataset sample 0.50 of dataset imdb_9prevs started 07/11/23 04:24:08| INFO ref finished [took 10.9214s] 07/11/23 04:24:12| INFO atc_mc finished [took 14.9236s] 07/11/23 04:24:12| INFO atc_ne finished [took 14.9240s] 07/11/23 04:29:11| INFO bin_sld_gsq finished [took 314.3071s] 07/11/23 04:29:19| INFO mul_sld_gsq finished [took 322.1027s] 07/11/23 04:31:25| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.00885) [took 448.0202s] 07/11/23 04:31:40| INFO mul_sld_gs finished [took 463.2243s] 07/11/23 04:36:23| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 10.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00940) [took 746.2797s] 07/11/23 04:38:55| INFO bin_sld_gs finished [took 898.7899s] 07/11/23 04:38:55| INFO Dataset sample 0.50 of dataset imdb_9prevs finished [took 899.2924s] 07/11/23 04:38:55| INFO Dataset sample 0.60 of dataset imdb_9prevs started 07/11/23 04:39:08| INFO ref finished [took 11.9811s] 07/11/23 04:39:12| INFO atc_mc finished [took 15.7159s] 07/11/23 04:39:12| INFO atc_ne finished [took 15.9512s] 07/11/23 04:44:19| INFO bin_sld_gsq finished [took 323.1420s] 07/11/23 04:44:21| INFO mul_sld_gsq finished [took 325.2299s] 07/11/23 04:46:22| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00984) [took 445.8872s] 07/11/23 04:46:37| INFO mul_sld_gs finished [took 460.6339s] 07/11/23 04:52:03| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.01142) [took 786.7500s] 07/11/23 04:54:36| INFO bin_sld_gs finished [took 940.1627s] 07/11/23 04:54:36| INFO Dataset sample 0.60 of dataset imdb_9prevs finished [took 940.6023s] 07/11/23 04:54:36| INFO Dataset sample 0.70 of dataset imdb_9prevs started 07/11/23 04:54:48| INFO ref finished [took 11.1744s] 07/11/23 04:54:52| INFO atc_mc finished [took 14.7518s] 07/11/23 04:54:52| INFO atc_ne finished [took 14.8147s] 07/11/23 04:59:45| INFO bin_sld_gsq finished [took 308.3645s] 07/11/23 05:00:07| INFO mul_sld_gsq finished [took 330.3332s] 07/11/23 05:02:14| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 1000.0, 'quantifier__classifier__class_weight': None, 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'max_conf'} (score=0.01102) [took 456.8448s] 07/11/23 05:02:28| INFO mul_sld_gs finished [took 471.4675s] 07/11/23 05:06:48| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.02196) [took 731.2847s] 07/11/23 05:09:19| INFO bin_sld_gs finished [took 882.2200s] 07/11/23 05:09:19| INFO Dataset sample 0.70 of dataset imdb_9prevs finished [took 882.8165s] 07/11/23 05:09:19| INFO Dataset sample 0.80 of dataset imdb_9prevs started 07/11/23 05:09:31| INFO ref finished [took 11.0645s] 07/11/23 05:09:35| INFO atc_mc finished [took 14.7375s] 07/11/23 05:09:35| INFO atc_ne finished [took 14.7704s] 07/11/23 05:14:22| INFO bin_sld_gsq finished [took 302.1848s] 07/11/23 05:14:33| INFO mul_sld_gsq finished [took 313.5459s] 07/11/23 05:16:38| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.00785) [took 438.9863s] 07/11/23 05:16:52| INFO mul_sld_gs finished [took 452.7273s] 07/11/23 05:21:59| DEBUG [BinaryQuantifierAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 0.01, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': 'bcts', 'quantifier__exact_train_prev': True, 'confidence': None} (score=0.01449) [took 759.8355s] 07/11/23 05:24:38| INFO bin_sld_gs finished [took 918.7338s] 07/11/23 05:24:38| INFO Dataset sample 0.80 of dataset imdb_9prevs finished [took 919.2981s] 07/11/23 05:24:38| INFO Dataset sample 0.90 of dataset imdb_9prevs started 07/11/23 05:24:39| WARNING Method mul_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 07/11/23 05:24:39| WARNING Method bin_sld_gsq failed. Exception: The least populated class in y has only 1 member, which is too few. The minimum number of groups for any class cannot be less than 2. 07/11/23 05:24:48| INFO ref finished [took 9.1378s] 07/11/23 05:24:51| INFO atc_mc finished [took 12.1603s] 07/11/23 05:24:52| INFO atc_ne finished [took 12.3482s] 07/11/23 05:25:08| WARNING Method bin_sld_gs failed. Exception: This solver needs samples of at least 2 classes in the data, but the data contains only one class: 0 07/11/23 05:30:32| DEBUG [MultiClassAccuracyEstimator] optimization finished: best params {'quantifier__classifier__C': 100.0, 'quantifier__classifier__class_weight': 'balanced', 'quantifier__recalib': None, 'quantifier__exact_train_prev': True, 'confidence': 'entropy'} (score=0.04178) [took 353.7904s] 07/11/23 05:30:45| INFO mul_sld_gs finished [took 365.9283s] 07/11/23 05:30:45| INFO Dataset sample 0.90 of dataset imdb_9prevs finished [took 366.4930s] ----------------------------------------------------------------------------------------------------