lorenzo.volpi
/
QuAcc
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
QuAcc/out/rcv1_CCAT_all_bin_vs_atc/rcv1_CCAT_all_bin_vs_atc_f1.md

2409 lines
48 KiB
Markdown
Raw Normal View History

outputs updated
2023-10-23 08:28:19 +02:00
rcv1_CCAT
> train: [0.09996662 0.90003338]
> validation: [0.09996662 0.90003338]
> evaluate_bin_sld: 260.939s
> evaluate_bin_sld_nbvs: 281.252s
> evaluate_bin_sld_bcts: 257.632s
> evaluate_bin_sld_ts: 279.822s
> evaluate_bin_sld_vs: 257.127s
> evaluate_bin_cc: 251.271s
> reference: 47.963s
> atc_mc: 51.553s
> atc_ne: 51.146s
> tot: 286.668s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0000</td>
<td>0.0001</td>
<td>0.0000</td>
<td>0.0001</td>
<td>0.0000</td>
<td>0.6000</td>
<td>0.4745</td>
<td>0.4745</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.1094</td>
<td>0.0877</td>
<td>0.0719</td>
<td>0.0877</td>
<td>0.0719</td>
<td>0.5213</td>
<td>0.4016</td>
<td>0.4016</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.1807</td>
<td>0.0886</td>
<td>0.0683</td>
<td>0.0886</td>
<td>0.0683</td>
<td>0.4553</td>
<td>0.3432</td>
<td>0.3432</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.1695</td>
<td>0.0831</td>
<td>0.0607</td>
<td>0.0831</td>
<td>0.0607</td>
<td>0.3958</td>
<td>0.2909</td>
<td>0.2909</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.1458</td>
<td>0.0738</td>
<td>0.0505</td>
<td>0.0738</td>
<td>0.0505</td>
<td>0.3459</td>
<td>0.2470</td>
<td>0.2470</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.1307</td>
<td>0.0709</td>
<td>0.0476</td>
<td>0.0709</td>
<td>0.0476</td>
<td>0.3001</td>
<td>0.2076</td>
<td>0.2076</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.1112</td>
<td>0.0621</td>
<td>0.0399</td>
<td>0.0621</td>
<td>0.0399</td>
<td>0.2611</td>
<td>0.1759</td>
<td>0.1759</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0955</td>
<td>0.0562</td>
<td>0.0351</td>
<td>0.0562</td>
<td>0.0351</td>
<td>0.2274</td>
<td>0.1487</td>
<td>0.1487</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0818</td>
<td>0.0501</td>
<td>0.0311</td>
<td>0.0501</td>
<td>0.0311</td>
<td>0.1956</td>
<td>0.1239</td>
<td>0.1239</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0658</td>
<td>0.0419</td>
<td>0.0248</td>
<td>0.0419</td>
<td>0.0248</td>
<td>0.1690</td>
<td>0.1027</td>
<td>0.1027</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0541</td>
<td>0.0363</td>
<td>0.0210</td>
<td>0.0363</td>
<td>0.0210</td>
<td>0.1430</td>
<td>0.0842</td>
<td>0.0842</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0465</td>
<td>0.0324</td>
<td>0.0199</td>
<td>0.0324</td>
<td>0.0199</td>
<td>0.1198</td>
<td>0.0659</td>
<td>0.0659</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0342</td>
<td>0.0252</td>
<td>0.0146</td>
<td>0.0252</td>
<td>0.0146</td>
<td>0.1005</td>
<td>0.0530</td>
<td>0.0530</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0300</td>
<td>0.0227</td>
<td>0.0152</td>
<td>0.0227</td>
<td>0.0152</td>
<td>0.0816</td>
<td>0.0392</td>
<td>0.0392</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0224</td>
<td>0.0177</td>
<td>0.0127</td>
<td>0.0177</td>
<td>0.0127</td>
<td>0.0655</td>
<td>0.0290</td>
<td>0.0290</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0156</td>
<td>0.0133</td>
<td>0.0100</td>
<td>0.0133</td>
<td>0.0100</td>
<td>0.0510</td>
<td>0.0196</td>
<td>0.0196</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0116</td>
<td>0.0093</td>
<td>0.0091</td>
<td>0.0093</td>
<td>0.0091</td>
<td>0.0370</td>
<td>0.0125</td>
<td>0.0125</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0075</td>
<td>0.0063</td>
<td>0.0076</td>
<td>0.0063</td>
<td>0.0076</td>
<td>0.0248</td>
<td>0.0061</td>
<td>0.0061</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0047</td>
<td>0.0045</td>
<td>0.0067</td>
<td>0.0045</td>
<td>0.0067</td>
<td>0.0133</td>
<td>0.0036</td>
<td>0.0036</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0032</td>
<td>0.0029</td>
<td>0.0060</td>
<td>0.0029</td>
<td>0.0060</td>
<td>0.0031</td>
<td>0.0069</td>
<td>0.0069</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0024</td>
<td>0.0023</td>
<td>0.0063</td>
<td>0.0023</td>
<td>0.0063</td>
<td>0.0073</td>
<td>0.0123</td>
<td>0.0123</td>
</tr>
<tr>
<th>tot</th>
<td>0.0630</td>
<td>0.0375</td>
<td>0.0266</td>
<td>0.0375</td>
<td>0.0266</td>
<td>0.1961</td>
<td>0.1356</td>
<td>0.1356</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_90_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_90_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_90_f1.png)
> train: [0.19993324 0.80006676]
> validation: [0.20010013 0.79989987]
> evaluate_bin_sld: 279.633s
> evaluate_bin_sld_nbvs: 279.180s
> evaluate_bin_sld_bcts: 274.875s
> evaluate_bin_sld_ts: 276.549s
> evaluate_bin_sld_vs: 272.373s
> evaluate_bin_cc: 265.376s
> reference: 50.451s
> atc_mc: 53.163s
> atc_ne: 51.929s
> tot: 281.604s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0001</td>
<td>0.0003</td>
<td>0.0002</td>
<td>0.0003</td>
<td>0.0002</td>
<td>0.5814</td>
<td>0.5459</td>
<td>0.5459</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0933</td>
<td>0.0319</td>
<td>0.0385</td>
<td>0.0319</td>
<td>0.0384</td>
<td>0.4421</td>
<td>0.3941</td>
<td>0.3941</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0682</td>
<td>0.0209</td>
<td>0.0271</td>
<td>0.0209</td>
<td>0.0270</td>
<td>0.3494</td>
<td>0.2954</td>
<td>0.2954</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0501</td>
<td>0.0152</td>
<td>0.0189</td>
<td>0.0152</td>
<td>0.0189</td>
<td>0.2797</td>
<td>0.2206</td>
<td>0.2206</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0337</td>
<td>0.0150</td>
<td>0.0143</td>
<td>0.0150</td>
<td>0.0143</td>
<td>0.2291</td>
<td>0.1701</td>
<td>0.1701</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0296</td>
<td>0.0123</td>
<td>0.0136</td>
<td>0.0123</td>
<td>0.0136</td>
<td>0.1846</td>
<td>0.1277</td>
<td>0.1277</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0215</td>
<td>0.0127</td>
<td>0.0120</td>
<td>0.0127</td>
<td>0.0119</td>
<td>0.1542</td>
<td>0.0994</td>
<td>0.0994</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0184</td>
<td>0.0125</td>
<td>0.0123</td>
<td>0.0125</td>
<td>0.0123</td>
<td>0.1274</td>
<td>0.0774</td>
<td>0.0774</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0141</td>
<td>0.0118</td>
<td>0.0101</td>
<td>0.0118</td>
<td>0.0101</td>
<td>0.1046</td>
<td>0.0563</td>
<td>0.0563</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0114</td>
<td>0.0133</td>
<td>0.0101</td>
<td>0.0133</td>
<td>0.0101</td>
<td>0.0875</td>
<td>0.0440</td>
<td>0.0440</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0083</td>
<td>0.0119</td>
<td>0.0073</td>
<td>0.0119</td>
<td>0.0073</td>
<td>0.0713</td>
<td>0.0323</td>
<td>0.0323</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0078</td>
<td>0.0105</td>
<td>0.0073</td>
<td>0.0105</td>
<td>0.0073</td>
<td>0.0564</td>
<td>0.0206</td>
<td>0.0206</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0060</td>
<td>0.0120</td>
<td>0.0064</td>
<td>0.0120</td>
<td>0.0064</td>
<td>0.0461</td>
<td>0.0152</td>
<td>0.0152</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0066</td>
<td>0.0106</td>
<td>0.0074</td>
<td>0.0106</td>
<td>0.0074</td>
<td>0.0358</td>
<td>0.0098</td>
<td>0.0098</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0054</td>
<td>0.0094</td>
<td>0.0061</td>
<td>0.0094</td>
<td>0.0061</td>
<td>0.0270</td>
<td>0.0072</td>
<td>0.0072</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0062</td>
<td>0.0097</td>
<td>0.0059</td>
<td>0.0097</td>
<td>0.0059</td>
<td>0.0197</td>
<td>0.0056</td>
<td>0.0056</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0070</td>
<td>0.0089</td>
<td>0.0061</td>
<td>0.0089</td>
<td>0.0061</td>
<td>0.0130</td>
<td>0.0049</td>
<td>0.0049</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0078</td>
<td>0.0078</td>
<td>0.0060</td>
<td>0.0078</td>
<td>0.0060</td>
<td>0.0072</td>
<td>0.0053</td>
<td>0.0053</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0081</td>
<td>0.0074</td>
<td>0.0055</td>
<td>0.0074</td>
<td>0.0055</td>
<td>0.0036</td>
<td>0.0055</td>
<td>0.0055</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0081</td>
<td>0.0065</td>
<td>0.0057</td>
<td>0.0065</td>
<td>0.0057</td>
<td>0.0041</td>
<td>0.0068</td>
<td>0.0068</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0028</td>
<td>0.0027</td>
<td>0.0059</td>
<td>0.0027</td>
<td>0.0059</td>
<td>0.0084</td>
<td>0.0076</td>
<td>0.0076</td>
</tr>
<tr>
<th>tot</th>
<td>0.0197</td>
<td>0.0116</td>
<td>0.0108</td>
<td>0.0116</td>
<td>0.0108</td>
<td>0.1349</td>
<td>0.1025</td>
<td>0.1025</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_80_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_80_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_80_f1.png)
> train: [0.29989987 0.70010013]
> validation: [0.30006676 0.69993324]
> evaluate_bin_sld: 280.310s
> evaluate_bin_sld_nbvs: 282.471s
> evaluate_bin_sld_bcts: 278.534s
> evaluate_bin_sld_ts: 278.888s
> evaluate_bin_sld_vs: 278.748s
> evaluate_bin_cc: 270.160s
> reference: 49.592s
> atc_mc: 52.383s
> atc_ne: 51.682s
> tot: 284.878s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0001</td>
<td>0.0002</td>
<td>0.0002</td>
<td>0.0002</td>
<td>0.0002</td>
<td>0.7211</td>
<td>0.5749</td>
<td>0.5749</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.1119</td>
<td>0.0479</td>
<td>0.0554</td>
<td>0.0479</td>
<td>0.0554</td>
<td>0.4676</td>
<td>0.3336</td>
<td>0.3336</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0743</td>
<td>0.0286</td>
<td>0.0411</td>
<td>0.0286</td>
<td>0.0410</td>
<td>0.3359</td>
<td>0.2163</td>
<td>0.2163</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0513</td>
<td>0.0194</td>
<td>0.0332</td>
<td>0.0194</td>
<td>0.0331</td>
<td>0.2516</td>
<td>0.1450</td>
<td>0.1450</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0324</td>
<td>0.0160</td>
<td>0.0233</td>
<td>0.0160</td>
<td>0.0233</td>
<td>0.2004</td>
<td>0.1055</td>
<td>0.1055</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0266</td>
<td>0.0136</td>
<td>0.0226</td>
<td>0.0136</td>
<td>0.0226</td>
<td>0.1558</td>
<td>0.0703</td>
<td>0.0703</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0190</td>
<td>0.0151</td>
<td>0.0199</td>
<td>0.0151</td>
<td>0.0199</td>
<td>0.1295</td>
<td>0.0549</td>
<td>0.0549</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0175</td>
<td>0.0131</td>
<td>0.0179</td>
<td>0.0131</td>
<td>0.0179</td>
<td>0.1064</td>
<td>0.0403</td>
<td>0.0403</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0124</td>
<td>0.0131</td>
<td>0.0164</td>
<td>0.0131</td>
<td>0.0163</td>
<td>0.0870</td>
<td>0.0279</td>
<td>0.0279</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0105</td>
<td>0.0154</td>
<td>0.0145</td>
<td>0.0154</td>
<td>0.0144</td>
<td>0.0751</td>
<td>0.0225</td>
<td>0.0225</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0093</td>
<td>0.0147</td>
<td>0.0133</td>
<td>0.0147</td>
<td>0.0133</td>
<td>0.0606</td>
<td>0.0165</td>
<td>0.0165</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0090</td>
<td>0.0153</td>
<td>0.0127</td>
<td>0.0153</td>
<td>0.0126</td>
<td>0.0510</td>
<td>0.0120</td>
<td>0.0120</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0095</td>
<td>0.0184</td>
<td>0.0097</td>
<td>0.0184</td>
<td>0.0097</td>
<td>0.0428</td>
<td>0.0095</td>
<td>0.0095</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0098</td>
<td>0.0175</td>
<td>0.0112</td>
<td>0.0175</td>
<td>0.0112</td>
<td>0.0365</td>
<td>0.0089</td>
<td>0.0089</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0091</td>
<td>0.0168</td>
<td>0.0088</td>
<td>0.0168</td>
<td>0.0088</td>
<td>0.0288</td>
<td>0.0060</td>
<td>0.0060</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0093</td>
<td>0.0179</td>
<td>0.0088</td>
<td>0.0179</td>
<td>0.0088</td>
<td>0.0237</td>
<td>0.0047</td>
<td>0.0047</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0096</td>
<td>0.0165</td>
<td>0.0091</td>
<td>0.0165</td>
<td>0.0091</td>
<td>0.0184</td>
<td>0.0044</td>
<td>0.0044</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0086</td>
<td>0.0148</td>
<td>0.0091</td>
<td>0.0148</td>
<td>0.0091</td>
<td>0.0139</td>
<td>0.0045</td>
<td>0.0045</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0070</td>
<td>0.0109</td>
<td>0.0074</td>
<td>0.0109</td>
<td>0.0074</td>
<td>0.0104</td>
<td>0.0036</td>
<td>0.0036</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0057</td>
<td>0.0056</td>
<td>0.0068</td>
<td>0.0056</td>
<td>0.0067</td>
<td>0.0069</td>
<td>0.0035</td>
<td>0.0035</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0026</td>
<td>0.0015</td>
<td>0.0066</td>
<td>0.0015</td>
<td>0.0066</td>
<td>0.0050</td>
<td>0.0032</td>
<td>0.0032</td>
</tr>
<tr>
<th>tot</th>
<td>0.0212</td>
<td>0.0158</td>
<td>0.0166</td>
<td>0.0158</td>
<td>0.0165</td>
<td>0.1347</td>
<td>0.0794</td>
<td>0.0794</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_70_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_70_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_70_f1.png)
> train: [0.40003338 0.59996662]
> validation: [0.40003338 0.59996662]
> evaluate_bin_sld: 277.880s
> evaluate_bin_sld_nbvs: 277.436s
> evaluate_bin_sld_bcts: 278.774s
> evaluate_bin_sld_ts: 276.244s
> evaluate_bin_sld_vs: 275.283s
> evaluate_bin_cc: 269.340s
> reference: 49.693s
> atc_mc: 52.566s
> atc_ne: 51.600s
> tot: 282.019s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0003</td>
<td>0.0074</td>
<td>0.0158</td>
<td>0.0074</td>
<td>0.0158</td>
<td>0.8645</td>
<td>0.5310</td>
<td>0.5310</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0431</td>
<td>0.0499</td>
<td>0.0399</td>
<td>0.0499</td>
<td>0.0399</td>
<td>0.4588</td>
<td>0.2044</td>
<td>0.2044</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0250</td>
<td>0.0491</td>
<td>0.0315</td>
<td>0.0491</td>
<td>0.0315</td>
<td>0.3067</td>
<td>0.1045</td>
<td>0.1045</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0225</td>
<td>0.0512</td>
<td>0.0248</td>
<td>0.0512</td>
<td>0.0248</td>
<td>0.2227</td>
<td>0.0571</td>
<td>0.0571</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0250</td>
<td>0.0547</td>
<td>0.0252</td>
<td>0.0547</td>
<td>0.0252</td>
<td>0.1788</td>
<td>0.0407</td>
<td>0.0407</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0255</td>
<td>0.0514</td>
<td>0.0195</td>
<td>0.0514</td>
<td>0.0195</td>
<td>0.1416</td>
<td>0.0228</td>
<td>0.0228</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0257</td>
<td>0.0507</td>
<td>0.0185</td>
<td>0.0507</td>
<td>0.0185</td>
<td>0.1203</td>
<td>0.0196</td>
<td>0.0196</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0257</td>
<td>0.0489</td>
<td>0.0162</td>
<td>0.0489</td>
<td>0.0162</td>
<td>0.1013</td>
<td>0.0125</td>
<td>0.0125</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0268</td>
<td>0.0486</td>
<td>0.0151</td>
<td>0.0486</td>
<td>0.0151</td>
<td>0.0868</td>
<td>0.0100</td>
<td>0.0100</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0279</td>
<td>0.0493</td>
<td>0.0133</td>
<td>0.0493</td>
<td>0.0133</td>
<td>0.0774</td>
<td>0.0101</td>
<td>0.0101</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0252</td>
<td>0.0462</td>
<td>0.0141</td>
<td>0.0462</td>
<td>0.0141</td>
<td>0.0661</td>
<td>0.0081</td>
<td>0.0081</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0247</td>
<td>0.0456</td>
<td>0.0100</td>
<td>0.0456</td>
<td>0.0100</td>
<td>0.0582</td>
<td>0.0076</td>
<td>0.0076</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0242</td>
<td>0.0457</td>
<td>0.0096</td>
<td>0.0457</td>
<td>0.0096</td>
<td>0.0524</td>
<td>0.0060</td>
<td>0.0060</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0206</td>
<td>0.0434</td>
<td>0.0087</td>
<td>0.0434</td>
<td>0.0087</td>
<td>0.0481</td>
<td>0.0060</td>
<td>0.0060</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0167</td>
<td>0.0372</td>
<td>0.0090</td>
<td>0.0372</td>
<td>0.0090</td>
<td>0.0423</td>
<td>0.0055</td>
<td>0.0055</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0139</td>
<td>0.0317</td>
<td>0.0075</td>
<td>0.0317</td>
<td>0.0075</td>
<td>0.0384</td>
<td>0.0051</td>
<td>0.0051</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0116</td>
<td>0.0260</td>
<td>0.0072</td>
<td>0.0260</td>
<td>0.0072</td>
<td>0.0352</td>
<td>0.0042</td>
<td>0.0042</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0076</td>
<td>0.0188</td>
<td>0.0068</td>
<td>0.0188</td>
<td>0.0068</td>
<td>0.0318</td>
<td>0.0042</td>
<td>0.0042</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0051</td>
<td>0.0114</td>
<td>0.0068</td>
<td>0.0114</td>
<td>0.0068</td>
<td>0.0284</td>
<td>0.0045</td>
<td>0.0045</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0039</td>
<td>0.0052</td>
<td>0.0053</td>
<td>0.0052</td>
<td>0.0053</td>
<td>0.0269</td>
<td>0.0037</td>
<td>0.0037</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0007</td>
<td>0.0003</td>
<td>0.0047</td>
<td>0.0003</td>
<td>0.0047</td>
<td>0.0253</td>
<td>0.0034</td>
<td>0.0034</td>
</tr>
<tr>
<th>tot</th>
<td>0.0191</td>
<td>0.0368</td>
<td>0.0147</td>
<td>0.0368</td>
<td>0.0147</td>
<td>0.1434</td>
<td>0.0510</td>
<td>0.0510</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_60_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_60_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_60_f1.png)
> train: [0.5 0.5]
> validation: [0.5 0.5]
> evaluate_bin_sld: 275.896s
> evaluate_bin_sld_nbvs: 275.560s
> evaluate_bin_sld_bcts: 275.814s
> evaluate_bin_sld_ts: 274.482s
> evaluate_bin_sld_vs: 274.020s
> evaluate_bin_cc: 266.491s
> reference: 49.629s
> atc_mc: 52.484s
> atc_ne: 51.710s
> tot: 279.902s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0003</td>
<td>0.0027</td>
<td>0.0105</td>
<td>0.0027</td>
<td>0.0105</td>
<td>0.9852</td>
<td>0.5135</td>
<td>0.5135</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0562</td>
<td>0.0636</td>
<td>0.0485</td>
<td>0.0636</td>
<td>0.0485</td>
<td>0.4037</td>
<td>0.1066</td>
<td>0.1066</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0322</td>
<td>0.0733</td>
<td>0.0388</td>
<td>0.0733</td>
<td>0.0388</td>
<td>0.2633</td>
<td>0.0476</td>
<td>0.0476</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0417</td>
<td>0.0840</td>
<td>0.0400</td>
<td>0.0840</td>
<td>0.0400</td>
<td>0.1955</td>
<td>0.0306</td>
<td>0.0306</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0515</td>
<td>0.0905</td>
<td>0.0369</td>
<td>0.0905</td>
<td>0.0369</td>
<td>0.1611</td>
<td>0.0235</td>
<td>0.0235</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0554</td>
<td>0.0905</td>
<td>0.0337</td>
<td>0.0905</td>
<td>0.0337</td>
<td>0.1327</td>
<td>0.0158</td>
<td>0.0158</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0505</td>
<td>0.0874</td>
<td>0.0280</td>
<td>0.0874</td>
<td>0.0280</td>
<td>0.1177</td>
<td>0.0147</td>
<td>0.0147</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0498</td>
<td>0.0867</td>
<td>0.0258</td>
<td>0.0867</td>
<td>0.0258</td>
<td>0.1062</td>
<td>0.0151</td>
<td>0.0151</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0459</td>
<td>0.0804</td>
<td>0.0225</td>
<td>0.0804</td>
<td>0.0225</td>
<td>0.0938</td>
<td>0.0105</td>
<td>0.0105</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0420</td>
<td>0.0748</td>
<td>0.0195</td>
<td>0.0748</td>
<td>0.0195</td>
<td>0.0873</td>
<td>0.0119</td>
<td>0.0119</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0378</td>
<td>0.0655</td>
<td>0.0169</td>
<td>0.0655</td>
<td>0.0169</td>
<td>0.0800</td>
<td>0.0115</td>
<td>0.0115</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0337</td>
<td>0.0566</td>
<td>0.0153</td>
<td>0.0566</td>
<td>0.0153</td>
<td>0.0746</td>
<td>0.0105</td>
<td>0.0105</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0303</td>
<td>0.0488</td>
<td>0.0154</td>
<td>0.0488</td>
<td>0.0154</td>
<td>0.0698</td>
<td>0.0107</td>
<td>0.0107</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0249</td>
<td>0.0415</td>
<td>0.0137</td>
<td>0.0415</td>
<td>0.0137</td>
<td>0.0686</td>
<td>0.0114</td>
<td>0.0114</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0173</td>
<td>0.0311</td>
<td>0.0117</td>
<td>0.0311</td>
<td>0.0117</td>
<td>0.0645</td>
<td>0.0103</td>
<td>0.0103</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0136</td>
<td>0.0250</td>
<td>0.0102</td>
<td>0.0250</td>
<td>0.0102</td>
<td>0.0607</td>
<td>0.0097</td>
<td>0.0097</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0092</td>
<td>0.0191</td>
<td>0.0086</td>
<td>0.0191</td>
<td>0.0086</td>
<td>0.0584</td>
<td>0.0117</td>
<td>0.0117</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0062</td>
<td>0.0130</td>
<td>0.0063</td>
<td>0.0130</td>
<td>0.0063</td>
<td>0.0561</td>
<td>0.0104</td>
<td>0.0104</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0045</td>
<td>0.0081</td>
<td>0.0060</td>
<td>0.0081</td>
<td>0.0060</td>
<td>0.0547</td>
<td>0.0117</td>
<td>0.0117</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0038</td>
<td>0.0039</td>
<td>0.0038</td>
<td>0.0039</td>
<td>0.0038</td>
<td>0.0527</td>
<td>0.0117</td>
<td>0.0117</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0002</td>
<td>0.0003</td>
<td>0.0021</td>
<td>0.0003</td>
<td>0.0021</td>
<td>0.0521</td>
<td>0.0128</td>
<td>0.0128</td>
</tr>
<tr>
<th>tot</th>
<td>0.0289</td>
<td>0.0498</td>
<td>0.0197</td>
<td>0.0498</td>
<td>0.0197</td>
<td>0.1542</td>
<td>0.0434</td>
<td>0.0434</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_50_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_50_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_50_f1.png)
> train: [0.59996662 0.40003338]
> validation: [0.59996662 0.40003338]
> evaluate_bin_sld: 271.160s
> evaluate_bin_sld_nbvs: 273.312s
> evaluate_bin_sld_bcts: 275.646s
> evaluate_bin_sld_ts: 273.523s
> evaluate_bin_sld_vs: 270.973s
> evaluate_bin_cc: 265.710s
> reference: 48.837s
> atc_mc: 52.149s
> atc_ne: 51.567s
> tot: 278.833s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0002</td>
<td>0.0003</td>
<td>0.0125</td>
<td>0.0003</td>
<td>0.0125</td>
<td>0.8558</td>
<td>0.3564</td>
<td>0.3564</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0686</td>
<td>0.1148</td>
<td>0.0583</td>
<td>0.1148</td>
<td>0.0583</td>
<td>0.2215</td>
<td>0.0506</td>
<td>0.0506</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0857</td>
<td>0.1377</td>
<td>0.0497</td>
<td>0.1377</td>
<td>0.0497</td>
<td>0.1507</td>
<td>0.0460</td>
<td>0.0460</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.1039</td>
<td>0.1440</td>
<td>0.0497</td>
<td>0.1440</td>
<td>0.0496</td>
<td>0.1222</td>
<td>0.0318</td>
<td>0.0318</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.1048</td>
<td>0.1339</td>
<td>0.0453</td>
<td>0.1339</td>
<td>0.0453</td>
<td>0.1083</td>
<td>0.0254</td>
<td>0.0254</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0950</td>
<td>0.1178</td>
<td>0.0453</td>
<td>0.1178</td>
<td>0.0453</td>
<td>0.0965</td>
<td>0.0197</td>
<td>0.0197</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0766</td>
<td>0.0998</td>
<td>0.0371</td>
<td>0.0998</td>
<td>0.0371</td>
<td>0.0910</td>
<td>0.0174</td>
<td>0.0174</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0668</td>
<td>0.0896</td>
<td>0.0337</td>
<td>0.0896</td>
<td>0.0337</td>
<td>0.0897</td>
<td>0.0129</td>
<td>0.0129</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0541</td>
<td>0.0753</td>
<td>0.0316</td>
<td>0.0753</td>
<td>0.0316</td>
<td>0.0846</td>
<td>0.0118</td>
<td>0.0118</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0441</td>
<td>0.0633</td>
<td>0.0265</td>
<td>0.0633</td>
<td>0.0265</td>
<td>0.0814</td>
<td>0.0095</td>
<td>0.0095</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0363</td>
<td>0.0538</td>
<td>0.0256</td>
<td>0.0538</td>
<td>0.0256</td>
<td>0.0782</td>
<td>0.0088</td>
<td>0.0088</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0306</td>
<td>0.0468</td>
<td>0.0230</td>
<td>0.0468</td>
<td>0.0229</td>
<td>0.0768</td>
<td>0.0085</td>
<td>0.0085</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0251</td>
<td>0.0399</td>
<td>0.0214</td>
<td>0.0399</td>
<td>0.0214</td>
<td>0.0740</td>
<td>0.0078</td>
<td>0.0078</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0202</td>
<td>0.0346</td>
<td>0.0190</td>
<td>0.0346</td>
<td>0.0190</td>
<td>0.0756</td>
<td>0.0093</td>
<td>0.0093</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0155</td>
<td>0.0286</td>
<td>0.0160</td>
<td>0.0286</td>
<td>0.0160</td>
<td>0.0741</td>
<td>0.0090</td>
<td>0.0090</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0116</td>
<td>0.0233</td>
<td>0.0137</td>
<td>0.0233</td>
<td>0.0137</td>
<td>0.0723</td>
<td>0.0075</td>
<td>0.0075</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0089</td>
<td>0.0197</td>
<td>0.0124</td>
<td>0.0197</td>
<td>0.0124</td>
<td>0.0719</td>
<td>0.0066</td>
<td>0.0066</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0061</td>
<td>0.0147</td>
<td>0.0100</td>
<td>0.0147</td>
<td>0.0100</td>
<td>0.0709</td>
<td>0.0084</td>
<td>0.0084</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0040</td>
<td>0.0106</td>
<td>0.0076</td>
<td>0.0106</td>
<td>0.0076</td>
<td>0.0697</td>
<td>0.0078</td>
<td>0.0078</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0033</td>
<td>0.0065</td>
<td>0.0054</td>
<td>0.0065</td>
<td>0.0054</td>
<td>0.0695</td>
<td>0.0097</td>
<td>0.0097</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0002</td>
<td>0.0011</td>
<td>0.0017</td>
<td>0.0011</td>
<td>0.0017</td>
<td>0.0697</td>
<td>0.0090</td>
<td>0.0090</td>
</tr>
<tr>
<th>tot</th>
<td>0.0410</td>
<td>0.0598</td>
<td>0.0260</td>
<td>0.0598</td>
<td>0.0260</td>
<td>0.1288</td>
<td>0.0321</td>
<td>0.0321</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_40_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_40_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_40_f1.png)
> train: [0.69993324 0.30006676]
> validation: [0.70010013 0.29989987]
> evaluate_bin_sld: 276.303s
> evaluate_bin_sld_nbvs: 277.440s
> evaluate_bin_sld_bcts: 277.862s
> evaluate_bin_sld_ts: 275.166s
> evaluate_bin_sld_vs: 274.686s
> evaluate_bin_cc: 269.956s
> reference: 50.206s
> atc_mc: 52.805s
> atc_ne: 51.628s
> tot: 281.368s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0002</td>
<td>0.0019</td>
<td>0.0542</td>
<td>0.0019</td>
<td>0.0542</td>
<td>0.5809</td>
<td>0.3301</td>
<td>0.3301</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0936</td>
<td>0.1726</td>
<td>0.0564</td>
<td>0.1726</td>
<td>0.0564</td>
<td>0.0692</td>
<td>0.0519</td>
<td>0.0519</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0956</td>
<td>0.1377</td>
<td>0.0383</td>
<td>0.1377</td>
<td>0.0383</td>
<td>0.0564</td>
<td>0.0306</td>
<td>0.0306</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0815</td>
<td>0.1100</td>
<td>0.0306</td>
<td>0.1100</td>
<td>0.0306</td>
<td>0.0642</td>
<td>0.0252</td>
<td>0.0252</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0648</td>
<td>0.0860</td>
<td>0.0263</td>
<td>0.0860</td>
<td>0.0263</td>
<td>0.0673</td>
<td>0.0190</td>
<td>0.0190</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0546</td>
<td>0.0734</td>
<td>0.0237</td>
<td>0.0734</td>
<td>0.0237</td>
<td>0.0688</td>
<td>0.0167</td>
<td>0.0167</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0418</td>
<td>0.0597</td>
<td>0.0187</td>
<td>0.0597</td>
<td>0.0187</td>
<td>0.0711</td>
<td>0.0132</td>
<td>0.0132</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0342</td>
<td>0.0512</td>
<td>0.0189</td>
<td>0.0512</td>
<td>0.0189</td>
<td>0.0735</td>
<td>0.0170</td>
<td>0.0170</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0299</td>
<td>0.0461</td>
<td>0.0177</td>
<td>0.0461</td>
<td>0.0177</td>
<td>0.0756</td>
<td>0.0141</td>
<td>0.0141</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0231</td>
<td>0.0386</td>
<td>0.0151</td>
<td>0.0386</td>
<td>0.0151</td>
<td>0.0742</td>
<td>0.0135</td>
<td>0.0135</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0199</td>
<td>0.0344</td>
<td>0.0141</td>
<td>0.0344</td>
<td>0.0141</td>
<td>0.0746</td>
<td>0.0153</td>
<td>0.0153</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0176</td>
<td>0.0316</td>
<td>0.0135</td>
<td>0.0316</td>
<td>0.0135</td>
<td>0.0765</td>
<td>0.0146</td>
<td>0.0146</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0129</td>
<td>0.0257</td>
<td>0.0107</td>
<td>0.0257</td>
<td>0.0107</td>
<td>0.0739</td>
<td>0.0142</td>
<td>0.0142</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0107</td>
<td>0.0228</td>
<td>0.0104</td>
<td>0.0228</td>
<td>0.0104</td>
<td>0.0766</td>
<td>0.0159</td>
<td>0.0159</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0087</td>
<td>0.0202</td>
<td>0.0091</td>
<td>0.0202</td>
<td>0.0091</td>
<td>0.0772</td>
<td>0.0145</td>
<td>0.0145</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0065</td>
<td>0.0167</td>
<td>0.0078</td>
<td>0.0167</td>
<td>0.0078</td>
<td>0.0772</td>
<td>0.0144</td>
<td>0.0144</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0052</td>
<td>0.0137</td>
<td>0.0071</td>
<td>0.0137</td>
<td>0.0071</td>
<td>0.0768</td>
<td>0.0157</td>
<td>0.0157</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0042</td>
<td>0.0109</td>
<td>0.0062</td>
<td>0.0109</td>
<td>0.0062</td>
<td>0.0777</td>
<td>0.0168</td>
<td>0.0168</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0042</td>
<td>0.0075</td>
<td>0.0054</td>
<td>0.0075</td>
<td>0.0054</td>
<td>0.0770</td>
<td>0.0155</td>
<td>0.0155</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0045</td>
<td>0.0054</td>
<td>0.0050</td>
<td>0.0054</td>
<td>0.0050</td>
<td>0.0776</td>
<td>0.0152</td>
<td>0.0152</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0002</td>
<td>0.0009</td>
<td>0.0037</td>
<td>0.0009</td>
<td>0.0037</td>
<td>0.0786</td>
<td>0.0177</td>
<td>0.0177</td>
</tr>
<tr>
<th>tot</th>
<td>0.0292</td>
<td>0.0461</td>
<td>0.0187</td>
<td>0.0461</td>
<td>0.0187</td>
<td>0.0974</td>
<td>0.0334</td>
<td>0.0334</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_30_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_30_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_30_f1.png)
> train: [0.79989987 0.20010013]
> validation: [0.80006676 0.19993324]
> evaluate_bin_sld: 277.834s
> evaluate_bin_sld_nbvs: 276.506s
> evaluate_bin_sld_bcts: 278.317s
> evaluate_bin_sld_ts: 275.764s
> evaluate_bin_sld_vs: 275.146s
> evaluate_bin_cc: 270.770s
> reference: 49.612s
> atc_mc: 52.452s
> atc_ne: 52.091s
> tot: 281.829s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_SLD_nbvs</th>
<th>bin_SLD_bcts</th>
<th>bin_SLD_ts</th>
<th>bin_SLD_vs</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0003</td>
<td>0.0005</td>
<td>0.0141</td>
<td>0.0005</td>
<td>0.0141</td>
<td>0.3127</td>
<td>0.1159</td>
<td>0.1159</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.1241</td>
<td>0.1373</td>
<td>0.0644</td>
<td>0.1373</td>
<td>0.0644</td>
<td>0.0358</td>
<td>0.1303</td>
<td>0.1303</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0622</td>
<td>0.0798</td>
<td>0.0397</td>
<td>0.0798</td>
<td>0.0396</td>
<td>0.0524</td>
<td>0.0916</td>
<td>0.0916</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0390</td>
<td>0.0609</td>
<td>0.0331</td>
<td>0.0609</td>
<td>0.0330</td>
<td>0.0660</td>
<td>0.0794</td>
<td>0.0794</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0320</td>
<td>0.0506</td>
<td>0.0278</td>
<td>0.0506</td>
<td>0.0278</td>
<td>0.0786</td>
<td>0.0673</td>
<td>0.0673</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0213</td>
<td>0.0432</td>
<td>0.0205</td>
<td>0.0432</td>
<td>0.0205</td>
<td>0.0839</td>
<td>0.0623</td>
<td>0.0623</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0155</td>
<td>0.0341</td>
<td>0.0194</td>
<td>0.0341</td>
<td>0.0194</td>
<td>0.0881</td>
<td>0.0592</td>
<td>0.0592</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0121</td>
<td>0.0293</td>
<td>0.0152</td>
<td>0.0293</td>
<td>0.0152</td>
<td>0.0933</td>
<td>0.0518</td>
<td>0.0518</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0115</td>
<td>0.0267</td>
<td>0.0152</td>
<td>0.0267</td>
<td>0.0152</td>
<td>0.0967</td>
<td>0.0536</td>
<td>0.0536</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0097</td>
<td>0.0223</td>
<td>0.0152</td>
<td>0.0223</td>
<td>0.0152</td>
<td>0.0964</td>
<td>0.0510</td>
<td>0.0510</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0081</td>
<td>0.0186</td>
<td>0.0140</td>
<td>0.0186</td>
<td>0.0140</td>
<td>0.0965</td>
<td>0.0518</td>
<td>0.0518</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0077</td>
<td>0.0168</td>
<td>0.0124</td>
<td>0.0168</td>
<td>0.0124</td>
<td>0.0980</td>
<td>0.0533</td>
<td>0.0533</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0084</td>
<td>0.0124</td>
<td>0.0125</td>
<td>0.0124</td>
<td>0.0125</td>
<td>0.0970</td>
<td>0.0506</td>
<td>0.0506</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0087</td>
<td>0.0123</td>
<td>0.0135</td>
<td>0.0123</td>
<td>0.0135</td>
<td>0.1008</td>
<td>0.0480</td>
<td>0.0480</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0094</td>
<td>0.0096</td>
<td>0.0110</td>
<td>0.0096</td>
<td>0.0110</td>
<td>0.1018</td>
<td>0.0453</td>
<td>0.0453</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0104</td>
<td>0.0074</td>
<td>0.0121</td>
<td>0.0074</td>
<td>0.0121</td>
<td>0.1025</td>
<td>0.0428</td>
<td>0.0428</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0124</td>
<td>0.0051</td>
<td>0.0115</td>
<td>0.0050</td>
<td>0.0115</td>
<td>0.1009</td>
<td>0.0472</td>
<td>0.0472</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0134</td>
<td>0.0040</td>
<td>0.0131</td>
<td>0.0040</td>
<td>0.0131</td>
<td>0.1025</td>
<td>0.0461</td>
<td>0.0461</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0146</td>
<td>0.0035</td>
<td>0.0133</td>
<td>0.0035</td>
<td>0.0133</td>
<td>0.1020</td>
<td>0.0439</td>
<td>0.0439</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0146</td>
<td>0.0039</td>
<td>0.0133</td>
<td>0.0039</td>
<td>0.0132</td>
<td>0.1019</td>
<td>0.0468</td>
<td>0.0468</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0008</td>
<td>0.0003</td>
<td>0.0093</td>
<td>0.0003</td>
<td>0.0093</td>
<td>0.1036</td>
<td>0.0425</td>
<td>0.0425</td>
</tr>
<tr>
<th>tot</th>
<td>0.0208</td>
<td>0.0276</td>
<td>0.0191</td>
<td>0.0276</td>
<td>0.0191</td>
<td>0.1005</td>
<td>0.0610</td>
<td>0.0610</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_20_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_20_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_20_f1.png)
> train: [0.90003338 0.09996662]
> validation: [0.90003338 0.09996662]
> evaluate_bin_sld: 212.423s
> evaluate_bin_cc: 200.296s
> reference: 39.473s
> atc_mc: 41.699s
> atc_ne: 41.574s
> tot: 213.741s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>bin_SLD</th>
<th>bin_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0155</td>
<td>0.0548</td>
<td>0.0022</td>
<td>0.0022</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.2219</td>
<td>0.0921</td>
<td>0.2253</td>
<td>0.2253</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.1663</td>
<td>0.1226</td>
<td>0.1997</td>
<td>0.1997</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.1556</td>
<td>0.1304</td>
<td>0.2018</td>
<td>0.2018</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.1368</td>
<td>0.1365</td>
<td>0.1936</td>
<td>0.1936</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.1054</td>
<td>0.1382</td>
<td>0.1943</td>
<td>0.1943</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.1181</td>
<td>0.1425</td>
<td>0.1865</td>
<td>0.1865</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0996</td>
<td>0.1472</td>
<td>0.1849</td>
<td>0.1849</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.1031</td>
<td>0.1468</td>
<td>0.1852</td>
<td>0.1852</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0840</td>
<td>0.1471</td>
<td>0.1824</td>
<td>0.1824</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.1091</td>
<td>0.1478</td>
<td>0.1836</td>
<td>0.1836</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0893</td>
<td>0.1480</td>
<td>0.1801</td>
<td>0.1801</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0801</td>
<td>0.1474</td>
<td>0.1872</td>
<td>0.1872</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.1038</td>
<td>0.1495</td>
<td>0.1871</td>
<td>0.1871</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0810</td>
<td>0.1503</td>
<td>0.1884</td>
<td>0.1884</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0827</td>
<td>0.1510</td>
<td>0.1829</td>
<td>0.1829</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0746</td>
<td>0.1500</td>
<td>0.1840</td>
<td>0.1840</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0754</td>
<td>0.1511</td>
<td>0.1816</td>
<td>0.1816</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0613</td>
<td>0.1512</td>
<td>0.1818</td>
<td>0.1818</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0696</td>
<td>0.1506</td>
<td>0.1848</td>
<td>0.1848</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0495</td>
<td>0.1527</td>
<td>0.1850</td>
<td>0.1850</td>
</tr>
<tr>
<th>tot</th>
<td>0.0992</td>
<td>0.1385</td>
<td>0.1801</td>
<td>0.1801</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_10_f1.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_10_f1.png)
![plot_shift](plot\shift_rcv1_CCAT_10_f1.png)