这个比赛的数据有吗

Question

这个比赛的数据有吗

xxllp opened this issue 6 years ago · comments

FireJohnny · Answer 1 · Sat Sep 29 2018 09:53:08 GMT+0800 (China Standard Time)

在data_set中有初赛的发自我的 iPhone 在 2018年9月29日，09:47，potter <notifications@github.com<mailto:notifications@github.com>> 写道： — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#1>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l0thS-e7sC5_b6Lnmb8lbyS1fPd6ks5uftE7gaJpZM4XARFp>.

potter · Answer 2 · Sat Sep 29 2018 10:04:49 GMT+0800 (China Standard Time)

看到了，数据还算清洗的干净了。。。atec的那个比赛数据你有吗

FireJohnny · Answer 3 · Sat Sep 29 2018 10:07:45 GMT+0800 (China Standard Time)

有好像是1.5个g来着发自我的 iPhone 在 2018年9月29日，10:04，potter <notifications@github.com<mailto:notifications@github.com>> 写道：看到了，数据还算清洗的干净了。。。atec的那个比赛数据你有吗 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l-iPhFa-LvubABspOyGacRWDFwvsks5uftVBgaJpZM4XARFp>.

potter · Answer 4 · Sat Sep 29 2018 10:08:56 GMT+0800 (China Standard Time)

能发我一份吗，我当时参加的是另一个比赛，现在又要做这块的东西

FireJohnny · Answer 5 · Sat Sep 29 2018 10:10:04 GMT+0800 (China Standard Time)

我到时候看能不能上传到云盘上发给你吧发自我的 iPhone 在 2018年9月29日，10:08，potter <notifications@github.com<mailto:notifications@github.com>> 写道：能发我一份吗，我当时参加的是另一个比赛，现在又要做这块的东西 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l4kf1IxtxDuGXFXMXMg2egNNjwUgks5uftY4gaJpZM4XARFp>.

potter · Answer 6 · Sat Sep 29 2018 10:10:51 GMT+0800 (China Standard Time)

好的，这块的比赛是个趋势哈，未来估计还会有

FireJohnny · Answer 7 · Sat Sep 29 2018 10:12:20 GMT+0800 (China Standard Time)

比赛这种东西吗是这样的发自我的 iPhone 在 2018年9月29日，10:11，potter <notifications@github.com<mailto:notifications@github.com>> 写道：好的，这块的比赛是个趋势哈，未来估计还会有 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l5tFlUv4rkPBWBpjhV3jljYX36jGks5uftargaJpZM4XARFp>.

potter · Answer 8 · Sat Sep 29 2018 10:13:44 GMT+0800 (China Standard Time)

这种比赛不懂深度学习根本没法玩

FireJohnny · Answer 9 · Sat Sep 29 2018 10:16:45 GMT+0800 (China Standard Time)

还不至于 atec那个比赛数据太大最初使用lightgbm做的效果还行后面用cnn做发现其实差不太多加了一下其他节后后训练过拟合极其严重我也没找到原因线下效果挺好的线上非常差一值在中旬徘徊后期我就放弃了发自我的 iPhone 在 2018年9月29日，10:13，potter <notifications@github.com<mailto:notifications@github.com>> 写道：这种比赛不懂深度学习根本没法玩 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5lxlmG8k3R7Gy30lGFL0L2W1GqYr2ks5uftdYgaJpZM4XARFp>.

potter · Answer 10 · Sat Sep 29 2018 10:18:07 GMT+0800 (China Standard Time)

。。。好吧，我也是仅仅进了复赛，大神太多了。真实的数据实在太少了

FireJohnny · Answer 11 · Sat Sep 29 2018 10:18:11 GMT+0800 (China Standard Time)

这种东西先用ligbm 选出重要特征有时候有奇效发自我的 iPhone 在 2018年9月29日，10:13，potter <notifications@github.com<mailto:notifications@github.com>> 写道：这种比赛不懂深度学习根本没法玩 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5lxlmG8k3R7Gy30lGFL0L2W1GqYr2ks5uftdYgaJpZM4XARFp>.

potter · Answer 12 · Sat Sep 29 2018 10:19:16 GMT+0800 (China Standard Time)

特征太稀疏了不好选的，动不动就上千上万的

FireJohnny · Answer 13 · Sat Sep 29 2018 10:19:57 GMT+0800 (China Standard Time)

对呀所以是有时候有奇效发自我的 iPhone 在 2018年9月29日，10:19，potter <notifications@github.com<mailto:notifications@github.com>> 写道：特征太稀疏了不好选的，动不动就上千上万的 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5lwMd77FLKjcz532W8swOiEm1P-KJks5uftikgaJpZM4XARFp>.

potter · Answer 14 · Sat Sep 29 2018 10:24:00 GMT+0800 (China Standard Time)

一般都是先简单再复杂的，不过有些是太复杂了。完全搞不懂的。

FireJohnny · Answer 15 · Sat Sep 29 2018 10:25:36 GMT+0800 (China Standard Time)

比赛吗模型越能拟合数据效果自然越好咯发自我的 iPhone 在 2018年9月29日，10:24，potter <notifications@github.com<mailto:notifications@github.com>> 写道：一般都是先简单再复杂的，不过有些是太复杂了。完全搞不懂的。 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l3vxqzDWt5ceq-9uI7Dvf3a73pn-ks5uftnAgaJpZM4XARFp>.

potter · Answer 16 · Sat Sep 29 2018 10:27:27 GMT+0800 (China Standard Time)

简单的模型容易过拟合的，复杂的模型也是个黑箱，最后都是做特征工程和各种集成融合，真的是靠资源

FireJohnny · Answer 17 · Sat Sep 29 2018 10:28:35 GMT+0800 (China Standard Time)

一个人是真的难做我一个人就进过一次复赛太难了智商不够发自我的 iPhone 在 2018年9月29日，10:27，potter <notifications@github.com<mailto:notifications@github.com>> 写道：简单的模型容易过拟合的，复杂的模型也是个黑箱，最后都是做特征工程和各种集成融合，真的是靠资源 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l77l-BYVHvk1skfIEgUWNmkMCTSQks5uftqQgaJpZM4XARFp>.

potter · Answer 18 · Sat Sep 29 2018 10:30:05 GMT+0800 (China Standard Time)

哈哈，确实，有时间可以加个联系方式一起哈。各类比赛都可以的

FireJohnny · Answer 19 · Sat Sep 29 2018 10:30:53 GMT+0800 (China Standard Time)

可以发自我的 iPhone 在 2018年9月29日，10:30，potter <notifications@github.com<mailto:notifications@github.com>> 写道：哈哈，确实，有时间可以加个联系方式一起哈。各类比赛都可以的 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l-jLTnzOvbkgERvVXCtWE4WSfsrEks5uftsugaJpZM4XARFp>.

potter · Answer 20 · Sat Sep 29 2018 10:33:35 GMT+0800 (China Standard Time)

我qq 505279206

FireJohnny · Answer 21 · Sat Sep 29 2018 23:37:29 GMT+0800 (China Standard Time)

那个数据集我记错了大的不是atec的是一个图像比赛的 atec的在 version6中有训练和测试抱歉发自我的 iPhone 在 2018年9月29日，10:33，potter <notifications@github.com<mailto:notifications@github.com>> 写道：我qq 505279206 — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l91IWnZY9mUzY1nTcWYOI6hp-_lUks5uftv_gaJpZM4XARFp>.

potter · Answer 22 · Mon Oct 08 2018 16:57:59 GMT+0800 (China Standard Time)

我在本地运行有报错
File "D:/daima/xxl/paipaidaiAItiaozhansai-master/train_model.py", line 190, in
train()
File "D:/daima/xxl/paipaidaiAItiaozhansai-master/train_model.py", line 91, in train
model.build()
File "D:\daima\xxl\paipaidaiAItiaozhansai-master\model_for_train\Graph_model.py", line 54, in build
input = self.embed(self.q1)
File "D:\daima\xxl\paipaidaiAItiaozhansai-master\model_for_train\Graph_model.py", line 45, in embed
shape=[self.vocab,self.embed_size]),
File "C:\Anaconda3\lib\site-packages\tensorflow\python\framework\constant_op.py", line 214, in constant
value, dtype=dtype, shape=shape, verify_shape=verify_shape))
File "C:\Anaconda3\lib\site-packages\tensorflow\python\framework\tensor_util.py", line 488, in make_tensor_proto
(shape_size, nparray.size))
ValueError: Too many elements provided. Needed at most 3371100, but received 6267300

potter · Answer 23 · Mon Oct 08 2018 16:58:16 GMT+0800 (China Standard Time)

这个真不知道是啥原因了

FireJohnny · Answer 24 · Mon Oct 08 2018 17:01:54 GMT+0800 (China Standard Time)

前后值不对应值是不是统计错了发自我的 iPhone 在 2018年10月8日，16:58，potter <notifications@github.com<mailto:notifications@github.com>> 写道：这个真不知道是啥原因了 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5ly0ZcDT9GtmkWiTx4Mo-2YmaKMv8ks5uixOggaJpZM4XARFp>.

potter · Answer 25 · Mon Oct 08 2018 17:02:38 GMT+0800 (China Standard Time)

我没改代码呢

FireJohnny · Answer 26 · Mon Oct 08 2018 17:40:02 GMT+0800 (China Standard Time)

我修改过了是我的错上传了第一版的代码发自我的 iPhone 在 2018年10月8日，17:02，potter <notifications@github.com<mailto:notifications@github.com>> 写道：我没改代码呢 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l12l5TxWZ5qpv6BlHfouKtxLg4QDks5uixSugaJpZM4XARFp>.

potter · Answer 27 · Mon Oct 08 2018 17:40:54 GMT+0800 (China Standard Time)

那能提交一个能跑的版本吗

FireJohnny · Answer 28 · Mon Oct 08 2018 17:41:29 GMT+0800 (China Standard Time)

提交了发自我的 iPhone 在 2018年10月8日，17:40，potter <notifications@github.com<mailto:notifications@github.com>> 写道：那能提交一个能跑的版本吗 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l7SIRsIuRCyBSl_t9MKal-GRO6kiks5uix2pgaJpZM4XARFp>.

potter · Answer 29 · Mon Oct 08 2018 23:24:27 GMT+0800 (China Standard Time)

在cpu 环境下运行还是有点问题

FireJohnny · Answer 30 · Tue Oct 09 2018 00:01:46 GMT+0800 (China Standard Time)

什么问题呢我没有在cpu下跑过发自我的 iPhone 在 2018年10月8日，23:24，potter <notifications@github.com<mailto:notifications@github.com>> 写道：在cpu 环境下运行还是有点问题 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l-2eEoY4xFXfkO4aBSSxWVxYMloPks5ui24rgaJpZM4XARFp>.

potter · Answer 31 · Tue Oct 09 2018 08:33:58 GMT+0800 (China Standard Time)

Process finished with exit code -1073740791 (0xC0000409)

FireJohnny · Answer 32 · Tue Oct 09 2018 08:35:41 GMT+0800 (China Standard Time)

可能是内存或者显存溢出考虑改小batch什么的发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用

…

________________________________ 发件人: potter <notifications@github.com> 发送时间: Tuesday, October 9, 2018 8:33:58 AM 收件人: FireJohnny/paipaidaiAItiaozhansai 抄送: FireJohnny; State change 主题: Re: [FireJohnny/paipaidaiAItiaozhansai] 这个比赛的数据有吗 (#1) Process finished with exit code -1073740791 (0xC0000409) ― You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l9MLVl92FQD7NnJdwbCZKwX0K3JUks5ui-72gaJpZM4XARFp>.

potter · Answer 33 · Tue Oct 09 2018 08:42:00 GMT+0800 (China Standard Time)

我觉得不是，这也没多少数据，怎么就不足了。

FireJohnny · Answer 34 · Tue Oct 09 2018 08:43:16 GMT+0800 (China Standard Time)

涉及到的参数太多很容易就溢出了可以试一下发自我的 iPhone 在 2018年10月9日，08:42，potter <notifications@github.com<mailto:notifications@github.com>> 写道：我觉得不是，这也没多少数据，怎么就不足了。 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5lx9gLo1Gi7bXJgRI0EIm1xrYqRYuks5ui_DYgaJpZM4XARFp>.

potter · Answer 35 · Tue Oct 09 2018 08:44:34 GMT+0800 (China Standard Time)

你这能跑出东西吗

FireJohnny · Answer 36 · Tue Oct 09 2018 08:45:36 GMT+0800 (China Standard Time)

跑出啥我都是正常跑出结果的发自我的 iPhone 在 2018年10月9日，08:44，potter <notifications@github.com<mailto:notifications@github.com>> 写道：你这能跑出东西吗 — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l0sugXQzzIOtRO2zFLobiyD_K0Mqks5ui_FygaJpZM4XARFp>.

potter · Answer 37 · Tue Oct 09 2018 08:46:15 GMT+0800 (China Standard Time)

我看到结果了，刚才调了下batch size

potter · Answer 38 · Tue Oct 09 2018 08:52:54 GMT+0800 (China Standard Time)

速度有点慢。。试试gpu

FireJohnny · Answer 39 · Tue Oct 09 2018 08:53:26 GMT+0800 (China Standard Time)

gpu也很慢的发自我的 iPhone 在 2018年10月9日，08:52，potter <notifications@github.com<mailto:notifications@github.com>> 写道：速度有点慢。。试试gpu — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l90v252ig0UbR1m8p7V89-nIgewDks5ui_NmgaJpZM4XARFp>.

FireJohnny · Answer 40 · Tue Oct 09 2018 08:54:23 GMT+0800 (China Standard Time)

把里面的lstm去掉可能好点发自我的 iPhone 在 2018年10月9日，08:52，potter <notifications@github.com<mailto:notifications@github.com>> 写道：速度有点慢。。试试gpu — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub<#1 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/ASm5l90v252ig0UbR1m8p7V89-nIgewDks5ui_NmgaJpZM4XARFp>.