lorenzo.volpi
/
QuAcc
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
QuAcc/out/rcv1_CCAT_all_mul_vs_atc/rcv1_CCAT_all_mul_vs_atc_ac...

2409 lines
48 KiB
Markdown
Raw Normal View History

outputs updated
2023-10-23 08:28:19 +02:00
rcv1_CCAT
> train: [0.09996662 0.90003338]
> validation: [0.09996662 0.90003338]
> evaluate_mul_sld: 80.667s
> evaluate_mul_sld_nbvs: 85.070s
> evaluate_mul_sld_bcts: 84.600s
> evaluate_mul_sld_ts: 83.671s
> evaluate_mul_sld_vs: 81.712s
> evaluate_mul_cc: 71.627s
> reference: 57.055s
> atc_mc: 59.720s
> atc_ne: 57.966s
> tot: 91.101s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0358</td>
<td>0.0141</td>
<td>0.0153</td>
<td>0.0629</td>
<td>0.0033</td>
<td>0.2797</td>
<td>0.1704</td>
<td>0.1704</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0961</td>
<td>0.0156</td>
<td>0.0417</td>
<td>0.1021</td>
<td>0.0320</td>
<td>0.2671</td>
<td>0.1614</td>
<td>0.1614</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.1250</td>
<td>0.0198</td>
<td>0.0431</td>
<td>0.1000</td>
<td>0.0333</td>
<td>0.2512</td>
<td>0.1528</td>
<td>0.1528</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.1269</td>
<td>0.0212</td>
<td>0.0420</td>
<td>0.0931</td>
<td>0.0321</td>
<td>0.2365</td>
<td>0.1426</td>
<td>0.1426</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.1192</td>
<td>0.0196</td>
<td>0.0368</td>
<td>0.0814</td>
<td>0.0283</td>
<td>0.2243</td>
<td>0.1334</td>
<td>0.1334</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.1197</td>
<td>0.0233</td>
<td>0.0401</td>
<td>0.0795</td>
<td>0.0300</td>
<td>0.2058</td>
<td>0.1217</td>
<td>0.1217</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.1118</td>
<td>0.0217</td>
<td>0.0362</td>
<td>0.0697</td>
<td>0.0269</td>
<td>0.1937</td>
<td>0.1131</td>
<td>0.1131</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.1062</td>
<td>0.0219</td>
<td>0.0352</td>
<td>0.0632</td>
<td>0.0254</td>
<td>0.1781</td>
<td>0.1040</td>
<td>0.1040</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0999</td>
<td>0.0215</td>
<td>0.0342</td>
<td>0.0571</td>
<td>0.0241</td>
<td>0.1640</td>
<td>0.0943</td>
<td>0.0943</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0867</td>
<td>0.0182</td>
<td>0.0286</td>
<td>0.0455</td>
<td>0.0196</td>
<td>0.1504</td>
<td>0.0847</td>
<td>0.0847</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0771</td>
<td>0.0173</td>
<td>0.0256</td>
<td>0.0377</td>
<td>0.0178</td>
<td>0.1341</td>
<td>0.0749</td>
<td>0.0749</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0715</td>
<td>0.0187</td>
<td>0.0263</td>
<td>0.0338</td>
<td>0.0181</td>
<td>0.1189</td>
<td>0.0622</td>
<td>0.0622</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0563</td>
<td>0.0142</td>
<td>0.0200</td>
<td>0.0224</td>
<td>0.0135</td>
<td>0.1035</td>
<td>0.0541</td>
<td>0.0541</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0536</td>
<td>0.0178</td>
<td>0.0236</td>
<td>0.0224</td>
<td>0.0158</td>
<td>0.0888</td>
<td>0.0422</td>
<td>0.0422</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0426</td>
<td>0.0164</td>
<td>0.0205</td>
<td>0.0158</td>
<td>0.0141</td>
<td>0.0738</td>
<td>0.0334</td>
<td>0.0334</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0318</td>
<td>0.0132</td>
<td>0.0169</td>
<td>0.0119</td>
<td>0.0111</td>
<td>0.0591</td>
<td>0.0239</td>
<td>0.0239</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0246</td>
<td>0.0138</td>
<td>0.0168</td>
<td>0.0092</td>
<td>0.0110</td>
<td>0.0454</td>
<td>0.0168</td>
<td>0.0168</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0172</td>
<td>0.0130</td>
<td>0.0154</td>
<td>0.0084</td>
<td>0.0104</td>
<td>0.0314</td>
<td>0.0090</td>
<td>0.0090</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0103</td>
<td>0.0114</td>
<td>0.0132</td>
<td>0.0077</td>
<td>0.0090</td>
<td>0.0166</td>
<td>0.0070</td>
<td>0.0070</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0072</td>
<td>0.0115</td>
<td>0.0131</td>
<td>0.0063</td>
<td>0.0090</td>
<td>0.0039</td>
<td>0.0134</td>
<td>0.0134</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0040</td>
<td>0.0121</td>
<td>0.0128</td>
<td>0.0033</td>
<td>0.0104</td>
<td>0.0137</td>
<td>0.0243</td>
<td>0.0243</td>
</tr>
<tr>
<th>tot</th>
<td>0.0678</td>
<td>0.0170</td>
<td>0.0265</td>
<td>0.0444</td>
<td>0.0188</td>
<td>0.1352</td>
<td>0.0781</td>
<td>0.0781</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_90_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_90_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_90_acc.png)
> train: [0.19993324 0.80006676]
> validation: [0.20010013 0.79989987]
> evaluate_mul_sld: 83.645s
> evaluate_mul_sld_nbvs: 83.775s
> evaluate_mul_sld_bcts: 85.033s
> evaluate_mul_sld_ts: 82.535s
> evaluate_mul_sld_vs: 81.965s
> evaluate_mul_cc: 70.455s
> reference: 56.854s
> atc_mc: 59.091s
> atc_ne: 57.585s
> tot: 88.539s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0162</td>
<td>0.0086</td>
<td>0.0163</td>
<td>0.0056</td>
<td>0.0270</td>
<td>0.1688</td>
<td>0.0311</td>
<td>0.0311</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0393</td>
<td>0.0078</td>
<td>0.0141</td>
<td>0.0094</td>
<td>0.0426</td>
<td>0.1602</td>
<td>0.0274</td>
<td>0.0274</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0340</td>
<td>0.0093</td>
<td>0.0118</td>
<td>0.0163</td>
<td>0.0370</td>
<td>0.1531</td>
<td>0.0267</td>
<td>0.0267</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0320</td>
<td>0.0083</td>
<td>0.0105</td>
<td>0.0205</td>
<td>0.0337</td>
<td>0.1418</td>
<td>0.0227</td>
<td>0.0227</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0248</td>
<td>0.0083</td>
<td>0.0087</td>
<td>0.0276</td>
<td>0.0274</td>
<td>0.1343</td>
<td>0.0214</td>
<td>0.0214</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0238</td>
<td>0.0093</td>
<td>0.0103</td>
<td>0.0297</td>
<td>0.0252</td>
<td>0.1231</td>
<td>0.0201</td>
<td>0.0201</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0242</td>
<td>0.0094</td>
<td>0.0108</td>
<td>0.0329</td>
<td>0.0219</td>
<td>0.1152</td>
<td>0.0178</td>
<td>0.0178</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0212</td>
<td>0.0102</td>
<td>0.0113</td>
<td>0.0336</td>
<td>0.0196</td>
<td>0.1066</td>
<td>0.0196</td>
<td>0.0196</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0193</td>
<td>0.0097</td>
<td>0.0103</td>
<td>0.0362</td>
<td>0.0164</td>
<td>0.0961</td>
<td>0.0168</td>
<td>0.0168</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0164</td>
<td>0.0099</td>
<td>0.0100</td>
<td>0.0382</td>
<td>0.0135</td>
<td>0.0877</td>
<td>0.0147</td>
<td>0.0147</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0152</td>
<td>0.0098</td>
<td>0.0098</td>
<td>0.0391</td>
<td>0.0108</td>
<td>0.0787</td>
<td>0.0136</td>
<td>0.0136</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0148</td>
<td>0.0088</td>
<td>0.0092</td>
<td>0.0381</td>
<td>0.0112</td>
<td>0.0673</td>
<td>0.0111</td>
<td>0.0111</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0143</td>
<td>0.0096</td>
<td>0.0094</td>
<td>0.0404</td>
<td>0.0090</td>
<td>0.0589</td>
<td>0.0110</td>
<td>0.0110</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0154</td>
<td>0.0093</td>
<td>0.0095</td>
<td>0.0393</td>
<td>0.0094</td>
<td>0.0501</td>
<td>0.0097</td>
<td>0.0097</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0131</td>
<td>0.0093</td>
<td>0.0097</td>
<td>0.0367</td>
<td>0.0085</td>
<td>0.0403</td>
<td>0.0106</td>
<td>0.0106</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0124</td>
<td>0.0088</td>
<td>0.0089</td>
<td>0.0365</td>
<td>0.0084</td>
<td>0.0328</td>
<td>0.0091</td>
<td>0.0091</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0116</td>
<td>0.0083</td>
<td>0.0099</td>
<td>0.0338</td>
<td>0.0084</td>
<td>0.0239</td>
<td>0.0100</td>
<td>0.0100</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0111</td>
<td>0.0081</td>
<td>0.0105</td>
<td>0.0303</td>
<td>0.0087</td>
<td>0.0153</td>
<td>0.0104</td>
<td>0.0104</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0099</td>
<td>0.0075</td>
<td>0.0111</td>
<td>0.0258</td>
<td>0.0089</td>
<td>0.0084</td>
<td>0.0108</td>
<td>0.0108</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0084</td>
<td>0.0073</td>
<td>0.0119</td>
<td>0.0188</td>
<td>0.0083</td>
<td>0.0053</td>
<td>0.0130</td>
<td>0.0130</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0058</td>
<td>0.0113</td>
<td>0.0141</td>
<td>0.0070</td>
<td>0.0051</td>
<td>0.0124</td>
<td>0.0147</td>
<td>0.0147</td>
</tr>
<tr>
<th>tot</th>
<td>0.0182</td>
<td>0.0090</td>
<td>0.0109</td>
<td>0.0284</td>
<td>0.0172</td>
<td>0.0800</td>
<td>0.0163</td>
<td>0.0163</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_80_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_80_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_80_acc.png)
> train: [0.29989987 0.70010013]
> validation: [0.30006676 0.69993324]
> evaluate_mul_sld: 84.430s
> evaluate_mul_sld_nbvs: 85.444s
> evaluate_mul_sld_bcts: 87.873s
> evaluate_mul_sld_ts: 85.637s
> evaluate_mul_sld_vs: 84.555s
> evaluate_mul_cc: 72.330s
> reference: 57.756s
> atc_mc: 60.572s
> atc_ne: 58.677s
> tot: 91.275s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0099</td>
<td>0.0066</td>
<td>0.0141</td>
<td>0.0176</td>
<td>0.0204</td>
<td>0.1679</td>
<td>0.0238</td>
<td>0.0238</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0145</td>
<td>0.0223</td>
<td>0.0136</td>
<td>0.0240</td>
<td>0.0302</td>
<td>0.1600</td>
<td>0.0222</td>
<td>0.0222</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0137</td>
<td>0.0240</td>
<td>0.0126</td>
<td>0.0311</td>
<td>0.0286</td>
<td>0.1538</td>
<td>0.0216</td>
<td>0.0216</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0119</td>
<td>0.0226</td>
<td>0.0112</td>
<td>0.0385</td>
<td>0.0268</td>
<td>0.1471</td>
<td>0.0197</td>
<td>0.0197</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0093</td>
<td>0.0213</td>
<td>0.0092</td>
<td>0.0442</td>
<td>0.0223</td>
<td>0.1398</td>
<td>0.0206</td>
<td>0.0206</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0108</td>
<td>0.0224</td>
<td>0.0111</td>
<td>0.0463</td>
<td>0.0243</td>
<td>0.1286</td>
<td>0.0160</td>
<td>0.0160</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0115</td>
<td>0.0205</td>
<td>0.0104</td>
<td>0.0508</td>
<td>0.0228</td>
<td>0.1231</td>
<td>0.0160</td>
<td>0.0160</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0123</td>
<td>0.0218</td>
<td>0.0115</td>
<td>0.0517</td>
<td>0.0220</td>
<td>0.1164</td>
<td>0.0149</td>
<td>0.0149</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0132</td>
<td>0.0203</td>
<td>0.0121</td>
<td>0.0545</td>
<td>0.0216</td>
<td>0.1075</td>
<td>0.0122</td>
<td>0.0122</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0135</td>
<td>0.0185</td>
<td>0.0112</td>
<td>0.0568</td>
<td>0.0189</td>
<td>0.1010</td>
<td>0.0123</td>
<td>0.0123</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0160</td>
<td>0.0189</td>
<td>0.0123</td>
<td>0.0565</td>
<td>0.0189</td>
<td>0.0920</td>
<td>0.0111</td>
<td>0.0111</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0149</td>
<td>0.0179</td>
<td>0.0124</td>
<td>0.0572</td>
<td>0.0182</td>
<td>0.0840</td>
<td>0.0102</td>
<td>0.0102</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0180</td>
<td>0.0149</td>
<td>0.0101</td>
<td>0.0601</td>
<td>0.0137</td>
<td>0.0775</td>
<td>0.0096</td>
<td>0.0096</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0178</td>
<td>0.0156</td>
<td>0.0128</td>
<td>0.0587</td>
<td>0.0158</td>
<td>0.0713</td>
<td>0.0100</td>
<td>0.0100</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0162</td>
<td>0.0141</td>
<td>0.0111</td>
<td>0.0558</td>
<td>0.0134</td>
<td>0.0621</td>
<td>0.0080</td>
<td>0.0080</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0158</td>
<td>0.0148</td>
<td>0.0131</td>
<td>0.0540</td>
<td>0.0135</td>
<td>0.0549</td>
<td>0.0070</td>
<td>0.0070</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0162</td>
<td>0.0140</td>
<td>0.0139</td>
<td>0.0504</td>
<td>0.0132</td>
<td>0.0476</td>
<td>0.0071</td>
<td>0.0071</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0145</td>
<td>0.0130</td>
<td>0.0154</td>
<td>0.0464</td>
<td>0.0129</td>
<td>0.0405</td>
<td>0.0076</td>
<td>0.0076</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0110</td>
<td>0.0121</td>
<td>0.0152</td>
<td>0.0407</td>
<td>0.0108</td>
<td>0.0336</td>
<td>0.0062</td>
<td>0.0062</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0082</td>
<td>0.0118</td>
<td>0.0150</td>
<td>0.0314</td>
<td>0.0094</td>
<td>0.0256</td>
<td>0.0063</td>
<td>0.0063</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0059</td>
<td>0.0162</td>
<td>0.0174</td>
<td>0.0099</td>
<td>0.0108</td>
<td>0.0199</td>
<td>0.0059</td>
<td>0.0059</td>
</tr>
<tr>
<th>tot</th>
<td>0.0131</td>
<td>0.0173</td>
<td>0.0126</td>
<td>0.0446</td>
<td>0.0185</td>
<td>0.0931</td>
<td>0.0128</td>
<td>0.0128</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_70_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_70_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_70_acc.png)
> train: [0.40003338 0.59996662]
> validation: [0.40003338 0.59996662]
> evaluate_mul_sld: 83.508s
> evaluate_mul_sld_nbvs: 86.755s
> evaluate_mul_sld_bcts: 87.560s
> evaluate_mul_sld_ts: 86.070s
> evaluate_mul_sld_vs: 85.272s
> evaluate_mul_cc: 71.809s
> reference: 57.819s
> atc_mc: 60.630s
> atc_ne: 59.231s
> tot: 91.426s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0064</td>
<td>0.0062</td>
<td>0.0106</td>
<td>0.0160</td>
<td>0.0137</td>
<td>0.1061</td>
<td>0.0106</td>
<td>0.0106</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0091</td>
<td>0.0067</td>
<td>0.0074</td>
<td>0.0349</td>
<td>0.0167</td>
<td>0.1031</td>
<td>0.0101</td>
<td>0.0101</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0134</td>
<td>0.0093</td>
<td>0.0073</td>
<td>0.0458</td>
<td>0.0128</td>
<td>0.1016</td>
<td>0.0092</td>
<td>0.0092</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0180</td>
<td>0.0126</td>
<td>0.0079</td>
<td>0.0547</td>
<td>0.0142</td>
<td>0.0980</td>
<td>0.0083</td>
<td>0.0083</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0235</td>
<td>0.0161</td>
<td>0.0102</td>
<td>0.0622</td>
<td>0.0116</td>
<td>0.0970</td>
<td>0.0089</td>
<td>0.0089</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0261</td>
<td>0.0178</td>
<td>0.0099</td>
<td>0.0660</td>
<td>0.0139</td>
<td>0.0924</td>
<td>0.0090</td>
<td>0.0090</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0288</td>
<td>0.0205</td>
<td>0.0109</td>
<td>0.0708</td>
<td>0.0144</td>
<td>0.0920</td>
<td>0.0084</td>
<td>0.0084</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0290</td>
<td>0.0213</td>
<td>0.0107</td>
<td>0.0721</td>
<td>0.0143</td>
<td>0.0887</td>
<td>0.0084</td>
<td>0.0084</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0320</td>
<td>0.0247</td>
<td>0.0117</td>
<td>0.0749</td>
<td>0.0132</td>
<td>0.0849</td>
<td>0.0082</td>
<td>0.0082</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0331</td>
<td>0.0274</td>
<td>0.0112</td>
<td>0.0777</td>
<td>0.0130</td>
<td>0.0841</td>
<td>0.0086</td>
<td>0.0086</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0317</td>
<td>0.0271</td>
<td>0.0121</td>
<td>0.0758</td>
<td>0.0156</td>
<td>0.0798</td>
<td>0.0085</td>
<td>0.0085</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0313</td>
<td>0.0282</td>
<td>0.0100</td>
<td>0.0755</td>
<td>0.0132</td>
<td>0.0762</td>
<td>0.0085</td>
<td>0.0085</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0335</td>
<td>0.0332</td>
<td>0.0104</td>
<td>0.0756</td>
<td>0.0125</td>
<td>0.0744</td>
<td>0.0072</td>
<td>0.0072</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0306</td>
<td>0.0341</td>
<td>0.0105</td>
<td>0.0756</td>
<td>0.0121</td>
<td>0.0741</td>
<td>0.0079</td>
<td>0.0079</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0260</td>
<td>0.0323</td>
<td>0.0112</td>
<td>0.0704</td>
<td>0.0149</td>
<td>0.0696</td>
<td>0.0076</td>
<td>0.0076</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0230</td>
<td>0.0325</td>
<td>0.0099</td>
<td>0.0674</td>
<td>0.0141</td>
<td>0.0672</td>
<td>0.0075</td>
<td>0.0075</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0200</td>
<td>0.0343</td>
<td>0.0098</td>
<td>0.0641</td>
<td>0.0132</td>
<td>0.0654</td>
<td>0.0066</td>
<td>0.0066</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0149</td>
<td>0.0308</td>
<td>0.0099</td>
<td>0.0584</td>
<td>0.0138</td>
<td>0.0627</td>
<td>0.0070</td>
<td>0.0070</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0107</td>
<td>0.0232</td>
<td>0.0108</td>
<td>0.0486</td>
<td>0.0158</td>
<td>0.0596</td>
<td>0.0078</td>
<td>0.0078</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0084</td>
<td>0.0169</td>
<td>0.0094</td>
<td>0.0363</td>
<td>0.0125</td>
<td>0.0579</td>
<td>0.0071</td>
<td>0.0071</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0048</td>
<td>0.0060</td>
<td>0.0131</td>
<td>0.0109</td>
<td>0.0140</td>
<td>0.0572</td>
<td>0.0071</td>
<td>0.0071</td>
</tr>
<tr>
<th>tot</th>
<td>0.0216</td>
<td>0.0220</td>
<td>0.0102</td>
<td>0.0587</td>
<td>0.0138</td>
<td>0.0806</td>
<td>0.0082</td>
<td>0.0082</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_60_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_60_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_60_acc.png)
> train: [0.5 0.5]
> validation: [0.5 0.5]
> evaluate_mul_sld: 82.271s
> evaluate_mul_sld_nbvs: 87.111s
> evaluate_mul_sld_bcts: 87.864s
> evaluate_mul_sld_ts: 85.152s
> evaluate_mul_sld_vs: 84.956s
> evaluate_mul_cc: 72.398s
> reference: 57.877s
> atc_mc: 60.136s
> atc_ne: 59.105s
> tot: 91.401s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0046</td>
<td>0.0128</td>
<td>0.0105</td>
<td>0.0104</td>
<td>0.0050</td>
<td>0.0592</td>
<td>0.0088</td>
<td>0.0088</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0098</td>
<td>0.0285</td>
<td>0.0077</td>
<td>0.0328</td>
<td>0.0076</td>
<td>0.0604</td>
<td>0.0080</td>
<td>0.0080</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0157</td>
<td>0.0399</td>
<td>0.0068</td>
<td>0.0446</td>
<td>0.0066</td>
<td>0.0636</td>
<td>0.0082</td>
<td>0.0082</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0244</td>
<td>0.0510</td>
<td>0.0094</td>
<td>0.0556</td>
<td>0.0086</td>
<td>0.0648</td>
<td>0.0077</td>
<td>0.0077</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0302</td>
<td>0.0578</td>
<td>0.0109</td>
<td>0.0621</td>
<td>0.0092</td>
<td>0.0683</td>
<td>0.0083</td>
<td>0.0083</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0358</td>
<td>0.0620</td>
<td>0.0124</td>
<td>0.0660</td>
<td>0.0097</td>
<td>0.0678</td>
<td>0.0066</td>
<td>0.0066</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0370</td>
<td>0.0646</td>
<td>0.0137</td>
<td>0.0698</td>
<td>0.0115</td>
<td>0.0711</td>
<td>0.0082</td>
<td>0.0082</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0385</td>
<td>0.0665</td>
<td>0.0150</td>
<td>0.0734</td>
<td>0.0121</td>
<td>0.0737</td>
<td>0.0103</td>
<td>0.0103</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0398</td>
<td>0.0652</td>
<td>0.0153</td>
<td>0.0737</td>
<td>0.0122</td>
<td>0.0737</td>
<td>0.0085</td>
<td>0.0085</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0398</td>
<td>0.0654</td>
<td>0.0150</td>
<td>0.0768</td>
<td>0.0114</td>
<td>0.0767</td>
<td>0.0110</td>
<td>0.0110</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0386</td>
<td>0.0616</td>
<td>0.0146</td>
<td>0.0773</td>
<td>0.0110</td>
<td>0.0773</td>
<td>0.0122</td>
<td>0.0122</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0390</td>
<td>0.0615</td>
<td>0.0146</td>
<td>0.0787</td>
<td>0.0089</td>
<td>0.0790</td>
<td>0.0125</td>
<td>0.0125</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0371</td>
<td>0.0570</td>
<td>0.0158</td>
<td>0.0774</td>
<td>0.0111</td>
<td>0.0802</td>
<td>0.0144</td>
<td>0.0144</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0338</td>
<td>0.0550</td>
<td>0.0160</td>
<td>0.0794</td>
<td>0.0120</td>
<td>0.0853</td>
<td>0.0168</td>
<td>0.0168</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0287</td>
<td>0.0486</td>
<td>0.0144</td>
<td>0.0751</td>
<td>0.0127</td>
<td>0.0857</td>
<td>0.0164</td>
<td>0.0164</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0245</td>
<td>0.0427</td>
<td>0.0135</td>
<td>0.0709</td>
<td>0.0126</td>
<td>0.0867</td>
<td>0.0170</td>
<td>0.0170</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0198</td>
<td>0.0369</td>
<td>0.0120</td>
<td>0.0663</td>
<td>0.0126</td>
<td>0.0888</td>
<td>0.0211</td>
<td>0.0211</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0148</td>
<td>0.0296</td>
<td>0.0100</td>
<td>0.0578</td>
<td>0.0128</td>
<td>0.0903</td>
<td>0.0205</td>
<td>0.0205</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0122</td>
<td>0.0218</td>
<td>0.0098</td>
<td>0.0487</td>
<td>0.0146</td>
<td>0.0927</td>
<td>0.0239</td>
<td>0.0239</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0085</td>
<td>0.0129</td>
<td>0.0071</td>
<td>0.0361</td>
<td>0.0147</td>
<td>0.0946</td>
<td>0.0253</td>
<td>0.0253</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0035</td>
<td>0.0068</td>
<td>0.0092</td>
<td>0.0127</td>
<td>0.0143</td>
<td>0.0979</td>
<td>0.0289</td>
<td>0.0289</td>
</tr>
<tr>
<th>tot</th>
<td>0.0255</td>
<td>0.0451</td>
<td>0.0121</td>
<td>0.0593</td>
<td>0.0110</td>
<td>0.0780</td>
<td>0.0140</td>
<td>0.0140</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_50_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_50_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_50_acc.png)
> train: [0.59996662 0.40003338]
> validation: [0.59996662 0.40003338]
> evaluate_mul_sld: 80.470s
> evaluate_mul_sld_nbvs: 84.751s
> evaluate_mul_sld_bcts: 86.113s
> evaluate_mul_sld_ts: 84.612s
> evaluate_mul_sld_vs: 83.568s
> evaluate_mul_cc: 71.756s
> reference: 57.252s
> atc_mc: 59.949s
> atc_ne: 58.848s
> tot: 89.557s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0034</td>
<td>0.0058</td>
<td>0.0078</td>
<td>0.0090</td>
<td>0.0031</td>
<td>0.0249</td>
<td>0.0190</td>
<td>0.0190</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0154</td>
<td>0.0211</td>
<td>0.0060</td>
<td>0.0318</td>
<td>0.0057</td>
<td>0.0305</td>
<td>0.0166</td>
<td>0.0166</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0254</td>
<td>0.0265</td>
<td>0.0070</td>
<td>0.0408</td>
<td>0.0083</td>
<td>0.0369</td>
<td>0.0147</td>
<td>0.0147</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0348</td>
<td>0.0290</td>
<td>0.0109</td>
<td>0.0479</td>
<td>0.0120</td>
<td>0.0427</td>
<td>0.0117</td>
<td>0.0117</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0419</td>
<td>0.0321</td>
<td>0.0143</td>
<td>0.0550</td>
<td>0.0141</td>
<td>0.0499</td>
<td>0.0105</td>
<td>0.0105</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0483</td>
<td>0.0344</td>
<td>0.0183</td>
<td>0.0599</td>
<td>0.0166</td>
<td>0.0538</td>
<td>0.0089</td>
<td>0.0089</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0502</td>
<td>0.0331</td>
<td>0.0190</td>
<td>0.0669</td>
<td>0.0158</td>
<td>0.0605</td>
<td>0.0085</td>
<td>0.0085</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0517</td>
<td>0.0335</td>
<td>0.0212</td>
<td>0.0738</td>
<td>0.0168</td>
<td>0.0682</td>
<td>0.0076</td>
<td>0.0076</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0537</td>
<td>0.0338</td>
<td>0.0233</td>
<td>0.0777</td>
<td>0.0173</td>
<td>0.0728</td>
<td>0.0079</td>
<td>0.0079</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0519</td>
<td>0.0327</td>
<td>0.0229</td>
<td>0.0826</td>
<td>0.0153</td>
<td>0.0784</td>
<td>0.0073</td>
<td>0.0073</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0516</td>
<td>0.0317</td>
<td>0.0244</td>
<td>0.0852</td>
<td>0.0153</td>
<td>0.0835</td>
<td>0.0081</td>
<td>0.0081</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0515</td>
<td>0.0321</td>
<td>0.0260</td>
<td>0.0887</td>
<td>0.0148</td>
<td>0.0901</td>
<td>0.0099</td>
<td>0.0099</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0491</td>
<td>0.0300</td>
<td>0.0265</td>
<td>0.0887</td>
<td>0.0146</td>
<td>0.0946</td>
<td>0.0112</td>
<td>0.0112</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0459</td>
<td>0.0292</td>
<td>0.0267</td>
<td>0.0890</td>
<td>0.0149</td>
<td>0.1034</td>
<td>0.0156</td>
<td>0.0156</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0409</td>
<td>0.0258</td>
<td>0.0256</td>
<td>0.0856</td>
<td>0.0132</td>
<td>0.1084</td>
<td>0.0168</td>
<td>0.0168</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0338</td>
<td>0.0211</td>
<td>0.0225</td>
<td>0.0797</td>
<td>0.0115</td>
<td>0.1133</td>
<td>0.0160</td>
<td>0.0160</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0308</td>
<td>0.0198</td>
<td>0.0232</td>
<td>0.0767</td>
<td>0.0113</td>
<td>0.1192</td>
<td>0.0180</td>
<td>0.0180</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0257</td>
<td>0.0180</td>
<td>0.0218</td>
<td>0.0702</td>
<td>0.0102</td>
<td>0.1258</td>
<td>0.0218</td>
<td>0.0218</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0172</td>
<td>0.0120</td>
<td>0.0172</td>
<td>0.0599</td>
<td>0.0092</td>
<td>0.1303</td>
<td>0.0224</td>
<td>0.0224</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0127</td>
<td>0.0101</td>
<td>0.0150</td>
<td>0.0495</td>
<td>0.0084</td>
<td>0.1371</td>
<td>0.0278</td>
<td>0.0278</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0055</td>
<td>0.0041</td>
<td>0.0067</td>
<td>0.0245</td>
<td>0.0097</td>
<td>0.1440</td>
<td>0.0285</td>
<td>0.0285</td>
</tr>
<tr>
<th>tot</th>
<td>0.0353</td>
<td>0.0246</td>
<td>0.0184</td>
<td>0.0640</td>
<td>0.0123</td>
<td>0.0842</td>
<td>0.0147</td>
<td>0.0147</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_40_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_40_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_40_acc.png)
> train: [0.69993324 0.30006676]
> validation: [0.70010013 0.29989987]
> evaluate_mul_sld: 81.533s
> evaluate_mul_sld_nbvs: 86.971s
> evaluate_mul_sld_bcts: 87.396s
> evaluate_mul_sld_ts: 85.778s
> evaluate_mul_sld_vs: 84.898s
> evaluate_mul_cc: 72.777s
> reference: 58.110s
> atc_mc: 60.832s
> atc_ne: 59.018s
> tot: 91.337s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0024</td>
<td>0.0072</td>
<td>0.0101</td>
<td>0.0043</td>
<td>0.0041</td>
<td>0.0047</td>
<td>0.0103</td>
<td>0.0103</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0117</td>
<td>0.0092</td>
<td>0.0080</td>
<td>0.0227</td>
<td>0.0062</td>
<td>0.0101</td>
<td>0.0072</td>
<td>0.0072</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0202</td>
<td>0.0113</td>
<td>0.0073</td>
<td>0.0327</td>
<td>0.0092</td>
<td>0.0175</td>
<td>0.0049</td>
<td>0.0049</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0282</td>
<td>0.0138</td>
<td>0.0082</td>
<td>0.0433</td>
<td>0.0121</td>
<td>0.0266</td>
<td>0.0060</td>
<td>0.0060</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0333</td>
<td>0.0159</td>
<td>0.0102</td>
<td>0.0522</td>
<td>0.0131</td>
<td>0.0352</td>
<td>0.0082</td>
<td>0.0082</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0378</td>
<td>0.0184</td>
<td>0.0125</td>
<td>0.0589</td>
<td>0.0152</td>
<td>0.0432</td>
<td>0.0101</td>
<td>0.0101</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0371</td>
<td>0.0182</td>
<td>0.0130</td>
<td>0.0641</td>
<td>0.0138</td>
<td>0.0526</td>
<td>0.0119</td>
<td>0.0119</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0364</td>
<td>0.0184</td>
<td>0.0147</td>
<td>0.0670</td>
<td>0.0149</td>
<td>0.0608</td>
<td>0.0160</td>
<td>0.0160</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0379</td>
<td>0.0204</td>
<td>0.0174</td>
<td>0.0713</td>
<td>0.0156</td>
<td>0.0699</td>
<td>0.0190</td>
<td>0.0190</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0369</td>
<td>0.0196</td>
<td>0.0179</td>
<td>0.0723</td>
<td>0.0148</td>
<td>0.0781</td>
<td>0.0222</td>
<td>0.0222</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0359</td>
<td>0.0195</td>
<td>0.0191</td>
<td>0.0732</td>
<td>0.0143</td>
<td>0.0858</td>
<td>0.0259</td>
<td>0.0259</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0365</td>
<td>0.0215</td>
<td>0.0218</td>
<td>0.0758</td>
<td>0.0150</td>
<td>0.0949</td>
<td>0.0297</td>
<td>0.0297</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0333</td>
<td>0.0199</td>
<td>0.0213</td>
<td>0.0743</td>
<td>0.0127</td>
<td>0.1006</td>
<td>0.0307</td>
<td>0.0307</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0309</td>
<td>0.0197</td>
<td>0.0224</td>
<td>0.0743</td>
<td>0.0136</td>
<td>0.1121</td>
<td>0.0368</td>
<td>0.0368</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0272</td>
<td>0.0180</td>
<td>0.0219</td>
<td>0.0716</td>
<td>0.0125</td>
<td>0.1204</td>
<td>0.0400</td>
<td>0.0400</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0225</td>
<td>0.0157</td>
<td>0.0205</td>
<td>0.0673</td>
<td>0.0110</td>
<td>0.1281</td>
<td>0.0427</td>
<td>0.0427</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0196</td>
<td>0.0147</td>
<td>0.0203</td>
<td>0.0648</td>
<td>0.0104</td>
<td>0.1366</td>
<td>0.0464</td>
<td>0.0464</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0155</td>
<td>0.0130</td>
<td>0.0191</td>
<td>0.0594</td>
<td>0.0099</td>
<td>0.1458</td>
<td>0.0517</td>
<td>0.0517</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0121</td>
<td>0.0107</td>
<td>0.0161</td>
<td>0.0517</td>
<td>0.0101</td>
<td>0.1531</td>
<td>0.0521</td>
<td>0.0521</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0102</td>
<td>0.0092</td>
<td>0.0140</td>
<td>0.0437</td>
<td>0.0103</td>
<td>0.1614</td>
<td>0.0548</td>
<td>0.0548</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0071</td>
<td>0.0054</td>
<td>0.0071</td>
<td>0.0243</td>
<td>0.0154</td>
<td>0.1713</td>
<td>0.0625</td>
<td>0.0625</td>
</tr>
<tr>
<th>tot</th>
<td>0.0254</td>
<td>0.0152</td>
<td>0.0154</td>
<td>0.0557</td>
<td>0.0121</td>
<td>0.0861</td>
<td>0.0280</td>
<td>0.0280</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_30_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_30_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_30_acc.png)
> train: [0.79989987 0.20010013]
> validation: [0.80006676 0.19993324]
> evaluate_mul_sld: 80.936s
> evaluate_mul_sld_nbvs: 84.504s
> evaluate_mul_sld_bcts: 84.459s
> evaluate_mul_sld_ts: 83.197s
> evaluate_mul_sld_vs: 82.279s
> evaluate_mul_cc: 72.115s
> reference: 57.389s
> atc_mc: 59.886s
> atc_ne: 58.513s
> tot: 88.463s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_SLD_nbvs</th>
<th>mul_SLD_bcts</th>
<th>mul_SLD_ts</th>
<th>mul_SLD_vs</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0019</td>
<td>0.0078</td>
<td>0.0078</td>
<td>0.0021</td>
<td>0.0029</td>
<td>0.0094</td>
<td>0.0097</td>
<td>0.0097</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0117</td>
<td>0.0066</td>
<td>0.0068</td>
<td>0.0176</td>
<td>0.0060</td>
<td>0.0034</td>
<td>0.0071</td>
<td>0.0071</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0164</td>
<td>0.0069</td>
<td>0.0068</td>
<td>0.0284</td>
<td>0.0073</td>
<td>0.0119</td>
<td>0.0062</td>
<td>0.0062</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0178</td>
<td>0.0070</td>
<td>0.0067</td>
<td>0.0344</td>
<td>0.0086</td>
<td>0.0214</td>
<td>0.0064</td>
<td>0.0064</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0208</td>
<td>0.0088</td>
<td>0.0088</td>
<td>0.0407</td>
<td>0.0105</td>
<td>0.0326</td>
<td>0.0088</td>
<td>0.0088</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0218</td>
<td>0.0093</td>
<td>0.0094</td>
<td>0.0460</td>
<td>0.0109</td>
<td>0.0429</td>
<td>0.0093</td>
<td>0.0093</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0197</td>
<td>0.0101</td>
<td>0.0102</td>
<td>0.0487</td>
<td>0.0109</td>
<td>0.0542</td>
<td>0.0124</td>
<td>0.0124</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0178</td>
<td>0.0102</td>
<td>0.0105</td>
<td>0.0500</td>
<td>0.0106</td>
<td>0.0652</td>
<td>0.0161</td>
<td>0.0161</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0173</td>
<td>0.0116</td>
<td>0.0118</td>
<td>0.0530</td>
<td>0.0113</td>
<td>0.0767</td>
<td>0.0190</td>
<td>0.0190</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0155</td>
<td>0.0109</td>
<td>0.0118</td>
<td>0.0531</td>
<td>0.0107</td>
<td>0.0855</td>
<td>0.0207</td>
<td>0.0207</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0135</td>
<td>0.0111</td>
<td>0.0118</td>
<td>0.0526</td>
<td>0.0095</td>
<td>0.0955</td>
<td>0.0222</td>
<td>0.0222</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0135</td>
<td>0.0133</td>
<td>0.0135</td>
<td>0.0547</td>
<td>0.0097</td>
<td>0.1059</td>
<td>0.0247</td>
<td>0.0247</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0110</td>
<td>0.0113</td>
<td>0.0119</td>
<td>0.0518</td>
<td>0.0087</td>
<td>0.1147</td>
<td>0.0272</td>
<td>0.0272</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0113</td>
<td>0.0124</td>
<td>0.0128</td>
<td>0.0518</td>
<td>0.0105</td>
<td>0.1273</td>
<td>0.0331</td>
<td>0.0331</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0126</td>
<td>0.0132</td>
<td>0.0137</td>
<td>0.0498</td>
<td>0.0087</td>
<td>0.1385</td>
<td>0.0384</td>
<td>0.0384</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0136</td>
<td>0.0125</td>
<td>0.0128</td>
<td>0.0467</td>
<td>0.0106</td>
<td>0.1496</td>
<td>0.0425</td>
<td>0.0425</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0156</td>
<td>0.0119</td>
<td>0.0115</td>
<td>0.0416</td>
<td>0.0110</td>
<td>0.1572</td>
<td>0.0407</td>
<td>0.0407</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0182</td>
<td>0.0109</td>
<td>0.0103</td>
<td>0.0366</td>
<td>0.0141</td>
<td>0.1685</td>
<td>0.0447</td>
<td>0.0447</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0209</td>
<td>0.0113</td>
<td>0.0104</td>
<td>0.0313</td>
<td>0.0178</td>
<td>0.1791</td>
<td>0.0492</td>
<td>0.0492</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0223</td>
<td>0.0111</td>
<td>0.0092</td>
<td>0.0236</td>
<td>0.0229</td>
<td>0.1872</td>
<td>0.0492</td>
<td>0.0492</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0082</td>
<td>0.0179</td>
<td>0.0055</td>
<td>0.0134</td>
<td>0.0285</td>
<td>0.2005</td>
<td>0.0571</td>
<td>0.0571</td>
</tr>
<tr>
<th>tot</th>
<td>0.0153</td>
<td>0.0108</td>
<td>0.0102</td>
<td>0.0394</td>
<td>0.0115</td>
<td>0.0965</td>
<td>0.0259</td>
<td>0.0259</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_20_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_20_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_20_acc.png)
> train: [0.90003338 0.09996662]
> validation: [0.90003338 0.09996662]
> evaluate_mul_sld: 64.528s
> evaluate_mul_cc: 58.489s
> reference: 47.116s
> atc_mc: 48.881s
> atc_ne: 47.186s
> tot: 66.290s
<table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th></th>
<th>mul_SLD</th>
<th>mul_CC</th>
<th>atc_mc</th>
<th>atc_ne</th>
</tr>
</thead>
<tbody>
<tr>
<th>(1.0, 0.0)</th>
<td>0.0010</td>
<td>0.0061</td>
<td>0.0088</td>
<td>0.0088</td>
</tr>
<tr>
<th>(0.95, 0.05)</th>
<td>0.0085</td>
<td>0.0076</td>
<td>0.0046</td>
<td>0.0046</td>
</tr>
<tr>
<th>(0.9, 0.1)</th>
<td>0.0093</td>
<td>0.0208</td>
<td>0.0080</td>
<td>0.0080</td>
</tr>
<tr>
<th>(0.85, 0.15)</th>
<td>0.0075</td>
<td>0.0332</td>
<td>0.0128</td>
<td>0.0128</td>
</tr>
<tr>
<th>(0.8, 0.2)</th>
<td>0.0110</td>
<td>0.0465</td>
<td>0.0194</td>
<td>0.0194</td>
</tr>
<tr>
<th>(0.75, 0.25)</th>
<td>0.0122</td>
<td>0.0588</td>
<td>0.0256</td>
<td>0.0256</td>
</tr>
<tr>
<th>(0.7, 0.3)</th>
<td>0.0178</td>
<td>0.0736</td>
<td>0.0348</td>
<td>0.0348</td>
</tr>
<tr>
<th>(0.65, 0.35)</th>
<td>0.0226</td>
<td>0.0892</td>
<td>0.0438</td>
<td>0.0438</td>
</tr>
<tr>
<th>(0.6, 0.4)</th>
<td>0.0317</td>
<td>0.1013</td>
<td>0.0509</td>
<td>0.0509</td>
</tr>
<tr>
<th>(0.55, 0.45)</th>
<td>0.0393</td>
<td>0.1133</td>
<td>0.0568</td>
<td>0.0568</td>
</tr>
<tr>
<th>(0.5, 0.5)</th>
<td>0.0473</td>
<td>0.1270</td>
<td>0.0633</td>
<td>0.0633</td>
</tr>
<tr>
<th>(0.45, 0.55)</th>
<td>0.0533</td>
<td>0.1416</td>
<td>0.0728</td>
<td>0.0728</td>
</tr>
<tr>
<th>(0.4, 0.6)</th>
<td>0.0639</td>
<td>0.1499</td>
<td>0.0748</td>
<td>0.0748</td>
</tr>
<tr>
<th>(0.35, 0.65)</th>
<td>0.0709</td>
<td>0.1657</td>
<td>0.0843</td>
<td>0.0843</td>
</tr>
<tr>
<th>(0.3, 0.7)</th>
<td>0.0775</td>
<td>0.1792</td>
<td>0.0916</td>
<td>0.0916</td>
</tr>
<tr>
<th>(0.25, 0.75)</th>
<td>0.0830</td>
<td>0.1930</td>
<td>0.1005</td>
<td>0.1005</td>
</tr>
<tr>
<th>(0.2, 0.8)</th>
<td>0.0916</td>
<td>0.2055</td>
<td>0.1064</td>
<td>0.1064</td>
</tr>
<tr>
<th>(0.15, 0.85)</th>
<td>0.0971</td>
<td>0.2185</td>
<td>0.1147</td>
<td>0.1147</td>
</tr>
<tr>
<th>(0.1, 0.9)</th>
<td>0.0976</td>
<td>0.2317</td>
<td>0.1204</td>
<td>0.1204</td>
</tr>
<tr>
<th>(0.05, 0.95)</th>
<td>0.0729</td>
<td>0.2411</td>
<td>0.1244</td>
<td>0.1244</td>
</tr>
<tr>
<th>(0.0, 1.0)</th>
<td>0.0184</td>
<td>0.2570</td>
<td>0.1336</td>
<td>0.1336</td>
</tr>
<tr>
<th>tot</th>
<td>0.0445</td>
<td>0.1267</td>
<td>0.0644</td>
<td>0.0644</td>
</tr>
</tbody>
</table>
![plot_delta](plot\delta_rcv1_CCAT_10_acc.png)
![plot_diagonal](plot\diagonal_rcv1_CCAT_10_acc.png)
![plot_shift](plot\shift_rcv1_CCAT_10_acc.png)