Error when invoking `docker-compose up`
kaznak opened this issue · comments
Hello
To try Cryptostore, I invoked docker-compose up on the docker-compose.yml file but met several errors.
I tried to fix it, but they're still some errors. Please help me.
The fixed repository is here.
One of the errors is about the old version of the arctic. So I updated the Dockerfile with some fix as pasted after.
But still, the following errors are remaining.
% docker-compose up
cryptostore_redisdb_1 is up-to-date
Recreating cryptostore_cryptostore_1 ... done
Starting mongo ... done
Attaching to cryptostore_redisdb_1, mongo, cryptostore_cryptostore_1
mongo | {"t":{"$date":"2021-03-03T16:12:16.341+00:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
mongo | {"t":{"$date":"2021-03-03T16:12:16.357+00:00"},"s":"W", "c":"ASIO", "id":22601, "ctx":"main","msg":"No TransportLayer configured during NetworkInterface startup"}
mongo | {"t":{"$date":"2021-03-03T16:12:16.357+00:00"},"s":"I", "c":"NETWORK", "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
mongo | {"t":{"$date":"2021-03-03T16:12:16.358+00:00"},"s":"I", "c":"STORAGE", "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/data/db","architecture":"64-bit","host":"50862789f3e0"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.358+00:00"},"s":"I", "c":"CONTROL", "id":23403, "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"4.4.1","gitVersion":"ad91a93a5a31e175f5cbf8c69561e788bbc55ce1","openSSLVersion":"OpenSSL 1.1.1 11 Sep 2018","modules":[],"allocator":"tcmalloc","environment":{"distmod":"ubuntu1804","distarch":"x86_64","target_arch":"x86_64"}}}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.358+00:00"},"s":"I", "c":"CONTROL", "id":51765, "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"Ubuntu","version":"18.04"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.358+00:00"},"s":"I", "c":"CONTROL", "id":21951, "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"net":{"bindIp":"*"}}}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.363+00:00"},"s":"W", "c":"STORAGE", "id":22271, "ctx":"initandlisten","msg":"Detected unclean shutdown - Lock file is not empty","attr":{"lockFile":"/data/db/mongod.lock"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.363+00:00"},"s":"I", "c":"STORAGE", "id":22270, "ctx":"initandlisten","msg":"Storage engine to use detected by data files","attr":{"dbpath":"/data/db","storageEngine":"wiredTiger"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.363+00:00"},"s":"W", "c":"STORAGE", "id":22302, "ctx":"initandlisten","msg":"Recovering data from the last clean checkpoint."}
mongo | {"t":{"$date":"2021-03-03T16:12:16.363+00:00"},"s":"I", "c":"STORAGE", "id":22297, "ctx":"initandlisten","msg":"Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem","tags":["startupWarnings"]}
mongo | {"t":{"$date":"2021-03-03T16:12:16.364+00:00"},"s":"I", "c":"STORAGE", "id":22315, "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=482M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"E", "c":"STORAGE", "id":22435, "ctx":"initandlisten","msg":"WiredTiger error","attr":{"error":28,"message":"[1614787936:849204][1:0x7fb51c291a80], connection: __posix_file_write, 615: /data/db/journal/WiredTigerTmplog.0000000001: handle-write: pwrite: failed to write 128 bytes at offset 0: No space left on device"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"E", "c":"STORAGE", "id":22435, "ctx":"initandlisten","msg":"WiredTiger error","attr":{"error":28,"message":"[1614787936:849345][1:0x7fb51c291a80], connection: __log_fs_write, 218: journal/WiredTigerTmplog.0000000001: fatal log failure: No space left on device"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"E", "c":"STORAGE", "id":22435, "ctx":"initandlisten","msg":"WiredTiger error","attr":{"error":-31804,"message":"[1614787936:849371][1:0x7fb51c291a80], connection: __log_fs_write, 218: the process must exit and restart: WT_PANIC: WiredTiger library panic"}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"F", "c":"-", "id":23089, "ctx":"initandlisten","msg":"Fatal assertion","attr":{"msgid":50853,"file":"src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp","line":446}}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"F", "c":"-", "id":23090, "ctx":"initandlisten","msg":"\n\n***aborting after fassert() failure\n\n"}
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"F", "c":"CONTROL", "id":4757800, "ctx":"initandlisten","msg":"Writing fatal message","attr":{"message":"Got signal: 6 (Aborted).\n"}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.062+00:00"},"s":"I", "c":"CONTROL", "id":31431, "ctx":"initandlisten","msg":"BACKTRACE: {bt}","attr":{"bt":{"backtrace":[{"a":"564C8C80D9F1","b":"564C89B45000","o":"2CC89F1","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1E1"},{"a":"564C8C80F029","b":"564C89B45000","o":"2CCA029","s":"_ZN5mongo15printStackTraceEv","s+":"29"},{"a":"564C8C80C886","b":"564C89B45000","o":"2CC7886","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"},{"a":"7FB51A69D8A0","b":"7FB51A68B000","o":"128A0","s":"funlockfile","s+":"50"},{"a":"7FB51A2D8F47","b":"7FB51A29A000","o":"3EF47","s":"gsignal","s+":"C7"},{"a":"7FB51A2DA8B1","b":"7FB51A29A000","o":"408B1","s":"abort","s+":"141"},{"a":"564C8AA4DBDA","b":"564C89B45000","o":"F08BDA","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"},{"a":"564C8A73BC21","b":"564C89B45000","o":"BF6C21","s":"_ZN5mongo12_GLOBAL__N_141mdb_handle_error_with_startup_suppressionEP18__wt_event_handlerP12__wt_sessioniPKc.cold.1026","s+":"16"},{"a":"564C8AC1CFBB","b":"564C89B45000","o":"10D7FBB","s":"__eventv","s+":"3FB"},{"a":"564C8A74CB3F","b":"564C89B45000","o":"C07B3F","s":"__wt_panic_func","s+":"10B"},{"a":"564C8ABD1691","b":"564C89B45000","o":"108C691","s":"__log_fs_write","s+":"4D1"},{"a":"564C8ABD1D80","b":"564C89B45000","o":"108CD80","s":"__wt_log_fill","s+":"40"},{"a":"564C8ABD21ED","b":"564C89B45000","o":"108D1ED","s":"__wt_log_allocfile","s+":"3DD"},{"a":"564C8ABD2713","b":"564C89B45000","o":"108D713","s":"__log_newfile","s+":"1A3"},{"a":"564C8ABD41CB","b":"564C89B45000","o":"108F1CB","s":"__wt_log_open","s+":"59B"},{"a":"564C8ABA1A93","b":"564C89B45000","o":"105CA93","s":"__wt_logmgr_create","s+":"283"},{"a":"564C8ABA29F8","b":"564C89B45000","o":"105D9F8","s":"__wt_connection_workers","s+":"28"},{"a":"564C8AB9BB29","b":"564C89B45000","o":"1056B29","s":"wiredtiger_open","s+":"24E9"},{"a":"564C8AB4AEAA","b":"564C89B45000","o":"1005EAA","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_","s+":"BA"},{"a":"564C8AB52A8A","b":"564C89B45000","o":"100DA8A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"12DA"},{"a":"564C8AB309B0","b":"564C89B45000","o":"FEB9B0","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"},{"a":"564C8B3F683E","b":"564C89B45000","o":"18B183E","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4AE"},{"a":"564C8AAEB1E7","b":"564C89B45000","o":"FA61E7","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1569","s+":"3F7"},{"a":"564C8AAEF280","b":"564C89B45000","o":"FAA280","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPcS2_","s+":"650"},{"a":"564C8AA5DB99","b":"564C89B45000","o":"F18B99","s":"main","s+":"9"},{"a":"7FB51A2BBB97","b":"7FB51A29A000","o":"21B97","s":"__libc_start_main","s+":"E7"},{"a":"564C8AAEA69A","b":"564C89B45000","o":"FA569A","s":"_start","s+":"2A"}],"processInfo":{"mongodbVersion":"4.4.1","gitVersion":"ad91a93a5a31e175f5cbf8c69561e788bbc55ce1","compiledModules":[],"uname":{"sysname":"Linux","release":"4.19.121-linuxkit","version":"#1 SMP Tue Dec 1 17:50:32 UTC 2020","machine":"x86_64"},"somap":[{"b":"564C89B45000","elfType":3,"buildId":"832AC9AE6CC5692FB33A92460CF800BB1B8C176A"},{"b":"7FB51A68B000","path":"/lib/x86_64-linux-gnu/libpthread.so.0","elfType":3,"buildId":"BC3C06107774266C5F7DB3F1F380A3DA68AF90FA"},{"b":"7FB51A29A000","path":"/lib/x86_64-linux-gnu/libc.so.6","elfType":3,"buildId":"D3CF764B2F97AC3EFE366DDD07AD902FB6928FD7"}]}}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8C80D9F1","b":"564C89B45000","o":"2CC89F1","s":"_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606","s+":"1E1"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8C80F029","b":"564C89B45000","o":"2CCA029","s":"_ZN5mongo15printStackTraceEv","s+":"29"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8C80C886","b":"564C89B45000","o":"2CC7886","s":"_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP9siginfo_tPv","s+":"66"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"7FB51A69D8A0","b":"7FB51A68B000","o":"128A0","s":"funlockfile","s+":"50"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"7FB51A2D8F47","b":"7FB51A29A000","o":"3EF47","s":"gsignal","s+":"C7"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"7FB51A2DA8B1","b":"7FB51A29A000","o":"408B1","s":"abort","s+":"141"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AA4DBDA","b":"564C89B45000","o":"F08BDA","s":"_ZN5mongo25fassertFailedWithLocationEiPKcj","s+":"12B"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8A73BC21","b":"564C89B45000","o":"BF6C21","s":"_ZN5mongo12_GLOBAL__N_141mdb_handle_error_with_startup_suppressionEP18__wt_event_handlerP12__wt_sessioniPKc.cold.1026","s+":"16"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AC1CFBB","b":"564C89B45000","o":"10D7FBB","s":"__eventv","s+":"3FB"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8A74CB3F","b":"564C89B45000","o":"C07B3F","s":"__wt_panic_func","s+":"10B"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABD1691","b":"564C89B45000","o":"108C691","s":"__log_fs_write","s+":"4D1"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABD1D80","b":"564C89B45000","o":"108CD80","s":"__wt_log_fill","s+":"40"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABD21ED","b":"564C89B45000","o":"108D1ED","s":"__wt_log_allocfile","s+":"3DD"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABD2713","b":"564C89B45000","o":"108D713","s":"__log_newfile","s+":"1A3"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABD41CB","b":"564C89B45000","o":"108F1CB","s":"__wt_log_open","s+":"59B"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABA1A93","b":"564C89B45000","o":"105CA93","s":"__wt_logmgr_create","s+":"283"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8ABA29F8","b":"564C89B45000","o":"105D9F8","s":"__wt_connection_workers","s+":"28"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AB9BB29","b":"564C89B45000","o":"1056B29","s":"wiredtiger_open","s+":"24E9"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AB4AEAA","b":"564C89B45000","o":"1005EAA","s":"_ZN5mongo18WiredTigerKVEngine15_openWiredTigerERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_","s+":"BA"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AB52A8A","b":"564C89B45000","o":"100DA8A","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mmbbbb","s+":"12DA"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AB309B0","b":"564C89B45000","o":"FEB9B0","s":"_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE","s+":"120"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8B3F683E","b":"564C89B45000","o":"18B183E","s":"_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE","s+":"4AE"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AAEB1E7","b":"564C89B45000","o":"FA61E7","s":"_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1569","s+":"3F7"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AAEF280","b":"564C89B45000","o":"FAA280","s":"_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPcS2_","s+":"650"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AA5DB99","b":"564C89B45000","o":"F18B99","s":"main","s+":"9"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"7FB51A2BBB97","b":"7FB51A29A000","o":"21B97","s":"__libc_start_main","s+":"E7"}}}
mongo | {"t":{"$date":"2021-03-03T16:12:17.063+00:00"},"s":"I", "c":"CONTROL", "id":31427, "ctx":"initandlisten","msg":" Frame: {frame}","attr":{"frame":{"a":"564C8AAEA69A","b":"564C89B45000","o":"FA569A","s":"_start","s+":"2A"}}}
mongo exited with code 14
redisdb_1 | 1:C 03 Mar 2021 16:05:30.152 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redisdb_1 | 1:C 03 Mar 2021 16:05:30.152 # Redis version=6.0.8, bits=64, commit=00000000, modified=0, pid=1, just started
redisdb_1 | 1:C 03 Mar 2021 16:05:30.152 # Configuration loaded
redisdb_1 | 1:M 03 Mar 2021 16:05:30.154 * Running mode=standalone, port=6379.
redisdb_1 | 1:M 03 Mar 2021 16:05:30.154 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redisdb_1 | 1:M 03 Mar 2021 16:05:30.154 # Server initialized
redisdb_1 | 1:M 03 Mar 2021 16:05:30.155 * Ready to accept connections
redisdb_1 | 1:signal-handler (1614787539) Received SIGTERM scheduling shutdown...
redisdb_1 | 1:M 03 Mar 2021 16:05:39.663 # User requested shutdown...
redisdb_1 | 1:M 03 Mar 2021 16:05:39.664 # Redis is now ready to exit, bye bye...
redisdb_1 | 1:C 03 Mar 2021 16:06:20.814 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redisdb_1 | 1:C 03 Mar 2021 16:06:20.814 # Redis version=6.0.8, bits=64, commit=00000000, modified=0, pid=1, just started
redisdb_1 | 1:C 03 Mar 2021 16:06:20.814 # Configuration loaded
redisdb_1 | 1:M 03 Mar 2021 16:06:20.816 * Running mode=standalone, port=6379.
redisdb_1 | 1:M 03 Mar 2021 16:06:20.816 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redisdb_1 | 1:M 03 Mar 2021 16:06:20.816 # Server initialized
redisdb_1 | 1:M 03 Mar 2021 16:06:20.816 * Ready to accept connections
redisdb_1 | 1:signal-handler (1614787590) Received SIGTERM scheduling shutdown...
redisdb_1 | 1:M 03 Mar 2021 16:06:30.427 # User requested shutdown...
redisdb_1 | 1:M 03 Mar 2021 16:06:30.427 # Redis is now ready to exit, bye bye...
redisdb_1 | 1:C 03 Mar 2021 16:06:58.419 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redisdb_1 | 1:C 03 Mar 2021 16:06:58.419 # Redis version=6.0.8, bits=64, commit=00000000, modified=0, pid=1, just started
redisdb_1 | 1:C 03 Mar 2021 16:06:58.419 # Configuration loaded
redisdb_1 | 1:M 03 Mar 2021 16:06:58.424 * Running mode=standalone, port=6379.
redisdb_1 | 1:M 03 Mar 2021 16:06:58.424 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
redisdb_1 | 1:M 03 Mar 2021 16:06:58.424 # Server initialized
redisdb_1 | 1:M 03 Mar 2021 16:06:58.425 * Ready to accept connections
cryptostore_1 | 2021-03-03 16:12:27,316 : INFO : Starting cryptostore
cryptostore_1 | 2021-03-03 16:12:27,317 : INFO : Cryptostore running on PID 1
cryptostore_1 | 2021-03-03 16:12:27,318 : INFO : Backfill running on PID 14
cryptostore_1 | 2021-03-03 16:12:27,321 : INFO : Spawner started
cryptostore_1 | 2021-03-03 16:12:27,322 : INFO : Spawner running on PID 16
cryptostore_1 | 2021-03-03 16:12:27,325 : INFO : Aggregator started
cryptostore_1 | 2021-03-03 16:12:27,327 : INFO : Cryptostore started
cryptostore_1 | 2021-03-03 16:12:27,327 : INFO : Aggregator running on PID 17
cryptostore_1 | 2021-03-03 16:12:27,328 : INFO : loading config file locally: /config.yaml at 2021-03-03 16:12:27.328082
cryptostore_1 | 2021-03-03 16:12:27,330 : INFO : loading config file locally: /config.yaml at 2021-03-03 16:12:27.330223
cryptostore_1 | 2021-03-03 16:12:27,335 : INFO : applying local config file: /config.yaml at 2021-03-03 16:12:27.335479
cryptostore_1 | 2021-03-03 16:12:27,335 : INFO : start: ['COINBASE', 'BITMEX'] stop: []
cryptostore_1 | 2021-03-03 16:12:27,337 : INFO : message: {"op": "start", "exchange": "COINBASE", "collector": {"l3_book": {"symbols": ["BTC-USD", "ETH-USD"], "book_delta": true, "book_interval": 10000}, "trades": ["BTC-USD", "ETH-USD", "ETH-BTC"]}, "config": {"cache": "redis", "redis": {"ip": "redisdb", "port": 6379, "del_after_read": true, "start_flush": true, "socket": null}, "storage": ["arctic"], "arctic": "mongodb://mongo:27017", "storage_interval": 60, "storage_retries": 5, "storage_retry_wait": 30, "plugins": {"backfill": {"module": ["cryptostore.plugin.backfill", "Backfill"], "config": "config.yaml"}}, "backfill": {"COINBASE": {"BTC-USD": {"start": "2017-01-01"}}}}}
cryptostore_1 | 2021-03-03 16:12:27,338 : INFO : Starting {'op': 'start', 'exchange': 'COINBASE', 'collector': {'l3_book': {'symbols': ['BTC-USD', 'ETH-USD'], 'book_delta': True, 'book_interval': 10000}, 'trades': ['BTC-USD', 'ETH-USD', 'ETH-BTC']}, 'config': {'cache': 'redis', 'redis': {'ip': 'redisdb', 'port': 6379, 'del_after_read': True, 'start_flush': True, 'socket': None}, 'storage': ['arctic'], 'arctic': 'mongodb://mongo:27017', 'storage_interval': 60, 'storage_retries': 5, 'storage_retry_wait': 30, 'plugins': {'backfill': {'module': ['cryptostore.plugin.backfill', 'Backfill'], 'config': 'config.yaml'}}, 'backfill': {'COINBASE': {'BTC-USD': {'start': '2017-01-01'}}}}}
cryptostore_1 | 2021-03-03 16:12:27,339 : INFO : applying local config file: /config.yaml at 2021-03-03 16:12:27.339911
cryptostore_1 | 2021-03-03 16:12:27,342 : INFO : message: {"op": "start", "exchange": "BITMEX", "collector": {"l2_book": {"symbols": ["XBTUSD"], "max_depth": 10}, "trades": ["XBTUSD"]}, "config": {"cache": "redis", "redis": {"ip": "redisdb", "port": 6379, "del_after_read": true, "start_flush": true, "socket": null}, "storage": ["arctic"], "arctic": "mongodb://mongo:27017", "storage_interval": 60, "storage_retries": 5, "storage_retry_wait": 30, "plugins": {"backfill": {"module": ["cryptostore.plugin.backfill", "Backfill"], "config": "config.yaml"}}, "backfill": {"COINBASE": {"BTC-USD": {"start": "2017-01-01"}}}}}
cryptostore_1 | 2021-03-03 16:12:27,343 : INFO : Starting {'op': 'start', 'exchange': 'BITMEX', 'collector': {'l2_book': {'symbols': ['XBTUSD'], 'max_depth': 10}, 'trades': ['XBTUSD']}, 'config': {'cache': 'redis', 'redis': {'ip': 'redisdb', 'port': 6379, 'del_after_read': True, 'start_flush': True, 'socket': None}, 'storage': ['arctic'], 'arctic': 'mongodb://mongo:27017', 'storage_interval': 60, 'storage_retries': 5, 'storage_retry_wait': 30, 'plugins': {'backfill': {'module': ['cryptostore.plugin.backfill', 'Backfill'], 'config': 'config.yaml'}}, 'backfill': {'COINBASE': {'BTC-USD': {'start': '2017-01-01'}}}}}
cryptostore_1 | 2021-03-03 16:12:27,345 : INFO : Collector for COINBASE running on PID 19
cryptostore_1 | 2021-03-03 16:12:27,349 : INFO : Collector for BITMEX running on PID 20
cryptostore_1 | 2021-03-03 16:12:27,351 : INFO : Flushing cache
cryptostore_1 | 2021-03-03 16:12:27,442 : INFO : Reading BITMEX-l2_book-XBTUSD
cryptostore_1 | 2021-03-03 16:12:27,443 : INFO : No data for BITMEX-l2_book-XBTUSD
cryptostore_1 | 2021-03-03 16:12:27,443 : INFO : Reading BITMEX-trades-XBTUSD
cryptostore_1 | 2021-03-03 16:12:27,444 : INFO : No data for BITMEX-trades-XBTUSD
cryptostore_1 | 2021-03-03 16:12:27,444 : INFO : Reading COINBASE-l3_book-BTC-USD
cryptostore_1 | 2021-03-03 16:12:27,444 : INFO : No data for COINBASE-l3_book-BTC-USD
cryptostore_1 | 2021-03-03 16:12:27,445 : INFO : Reading COINBASE-l3_book-ETH-USD
cryptostore_1 | 2021-03-03 16:12:27,445 : INFO : No data for COINBASE-l3_book-ETH-USD
cryptostore_1 | 2021-03-03 16:12:27,445 : INFO : Reading COINBASE-trades-BTC-USD
cryptostore_1 | 2021-03-03 16:12:27,446 : INFO : No data for COINBASE-trades-BTC-USD
cryptostore_1 | 2021-03-03 16:12:27,446 : INFO : Reading COINBASE-trades-ETH-USD
cryptostore_1 | 2021-03-03 16:12:27,447 : INFO : No data for COINBASE-trades-ETH-USD
cryptostore_1 | 2021-03-03 16:12:27,447 : INFO : Reading COINBASE-trades-ETH-BTC
cryptostore_1 | 2021-03-03 16:12:27,447 : INFO : No data for COINBASE-trades-ETH-BTC
cryptostore_1 | Process Collector-1:2:
cryptostore_1 | Traceback (most recent call last):
cryptostore_1 | File "/usr/local/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
cryptostore_1 | self.run()
cryptostore_1 | File "/cryptostore/collector.py", line 120, in run
cryptostore_1 | fh.add_feed(self.exchange, timeout=timeout, max_depth=depth, snapshot_interval=snap_interval, book_interval=window, subscription={callback_type: self.exchange_config[callback_type]}, callbacks=cb)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/cryptofeed/feedhandler.py", line 180, in add_feed
cryptostore_1 | self.feeds.append((_EXCHANGES[feed](config=self.config, **kwargs), timeout))
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/cryptofeed/exchange/bitmex.py", line 44, in __init__
cryptostore_1 | raise ValueError("{} is not active on BitMEX".format(pair))
cryptostore_1 | ValueError: XBTUSD is not active on BitMEX
cryptostore_1 | 2021-03-03 16:12:32,840 : WARNING : COINBASE: Missing sequence number detected for BTC-USD. Received 22234622704, expected 22234622499
cryptostore_1 | 2021-03-03 16:12:32,840 : WARNING : COINBASE: Resetting data for BTC-USD
cryptostore_1 | 2021-03-03 16:13:27,322 : INFO : Reading BITMEX-l2_book-XBTUSD
cryptostore_1 | 2021-03-03 16:13:27,324 : INFO : No data for BITMEX-l2_book-XBTUSD
cryptostore_1 | 2021-03-03 16:13:27,324 : INFO : Reading BITMEX-trades-XBTUSD
cryptostore_1 | 2021-03-03 16:13:27,325 : INFO : No data for BITMEX-trades-XBTUSD
cryptostore_1 | 2021-03-03 16:13:27,325 : INFO : Reading COINBASE-l3_book-BTC-USD
cryptostore_1 | 2021-03-03 16:13:27,491 : INFO : l3_book-COINBASE-BTC-USD: Read 20942 messages from Redis
cryptostore_1 | 2021-03-03 16:13:58,841 : ERROR : Aggregator running on PID 17 died due to exception
cryptostore_1 | Traceback (most recent call last):
cryptostore_1 | File "/cryptostore/aggregator/aggregator.py", line 108, in loop
cryptostore_1 | store.write(exchange, dtype, pair, time.time())
cryptostore_1 | File "/cryptostore/data/storage.py", line 37, in write
cryptostore_1 | s.write(exchange, data_type, pair, timestamp)
cryptostore_1 | File "/cryptostore/data/arctic.py", line 59, in write
cryptostore_1 | if exchange not in self.con.list_libraries():
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 206, in list_libraries
cryptostore_1 | return self._list_libraries_cached(newer_than_secs) if self.is_caching_enabled() else self._list_libraries()
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 197, in is_caching_enabled
cryptostore_1 | _ = self._conn # Ensures the connection exists and cache is initialized with it.
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/decorators.py", line 50, in f_retry
cryptostore_1 | return f(*args, **kwargs)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 152, in _conn
cryptostore_1 | self._cache = Cache(self.__conn)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/_cache.py", line 26, in __init__
cryptostore_1 | if cache_col not in self._cachedb.list_collection_names():
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/database.py", line 863, in list_collection_names
cryptostore_1 | for result in self.list_collections(session=session, **kwargs)]
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/database.py", line 826, in list_collections
cryptostore_1 | _cmd, read_pref, session)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1461, in _retryable_read
cryptostore_1 | read_pref, session, address=address)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1278, in _select_server
cryptostore_1 | server = topology.select_server(server_selector)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 243, in select_server
cryptostore_1 | address))
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 200, in select_servers
cryptostore_1 | selector, server_timeout, address)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 217, in _select_servers_loop
cryptostore_1 | (self._error_message(selector), timeout, self.description))
cryptostore_1 | pymongo.errors.ServerSelectionTimeoutError: mongo:27017: [Errno -2] Name or service not known, Timeout: 30.0s, Topology Description: <TopologyDescription id: 603fb5a885a899315e9edfb0, topology_type: Single, servers: [<ServerDescription ('mongo', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('mongo:27017: [Errno -2] Name or service not known')>]>
cryptostore_1 | Task exception was never retrieved
cryptostore_1 | future: <Task finished coro=<Aggregator.loop() done, defined at /cryptostore/aggregator/aggregator.py:43> exception=ServerSelectionTimeoutError("mongo:27017: [Errno -2] Name or service not known, Timeout: 30.0s, Topology Description: <TopologyDescription id: 603fb5a885a899315e9edfb0, topology_type: Single, servers: [<ServerDescription ('mongo', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('mongo:27017: [Errno -2] Name or service not known')>]>")>
cryptostore_1 | Traceback (most recent call last):
cryptostore_1 | File "/cryptostore/aggregator/aggregator.py", line 108, in loop
cryptostore_1 | store.write(exchange, dtype, pair, time.time())
cryptostore_1 | File "/cryptostore/data/storage.py", line 37, in write
cryptostore_1 | s.write(exchange, data_type, pair, timestamp)
cryptostore_1 | File "/cryptostore/data/arctic.py", line 59, in write
cryptostore_1 | if exchange not in self.con.list_libraries():
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 206, in list_libraries
cryptostore_1 | return self._list_libraries_cached(newer_than_secs) if self.is_caching_enabled() else self._list_libraries()
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 197, in is_caching_enabled
cryptostore_1 | _ = self._conn # Ensures the connection exists and cache is initialized with it.
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/decorators.py", line 50, in f_retry
cryptostore_1 | return f(*args, **kwargs)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/arctic.py", line 152, in _conn
cryptostore_1 | self._cache = Cache(self.__conn)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/arctic/_cache.py", line 26, in __init__
cryptostore_1 | if cache_col not in self._cachedb.list_collection_names():
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/database.py", line 863, in list_collection_names
cryptostore_1 | for result in self.list_collections(session=session, **kwargs)]
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/database.py", line 826, in list_collections
cryptostore_1 | _cmd, read_pref, session)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1461, in _retryable_read
cryptostore_1 | read_pref, session, address=address)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/mongo_client.py", line 1278, in _select_server
cryptostore_1 | server = topology.select_server(server_selector)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 243, in select_server
cryptostore_1 | address))
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 200, in select_servers
cryptostore_1 | selector, server_timeout, address)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/pymongo/topology.py", line 217, in _select_servers_loop
cryptostore_1 | (self._error_message(selector), timeout, self.description))
cryptostore_1 | pymongo.errors.ServerSelectionTimeoutError: mongo:27017: [Errno -2] Name or service not known, Timeout: 30.0s, Topology Description: <TopologyDescription id: 603fb5a885a899315e9edfb0, topology_type: Single, servers: [<ServerDescription ('mongo', 27017) server_type: Unknown, rtt: None, error=AutoReconnect('mongo:27017: [Errno -2] Name or service not known')>]>
^CGracefully stopping... (press Ctrl+C again to force)
Stopping cryptostore_cryptostore_1 ... done
Stopping cryptostore_redisdb_1 ... done
Thank you for reading!
the error from mongo is:
mongo | {"t":{"$date":"2021-03-03T16:12:16.849+00:00"},"s":"E", "c":"STORAGE", "id":22435, "ctx":"initandlisten","msg":"WiredTiger error","attr":{"error":28,"message":"[1614787936:849345][1:0x7fb51c291a80], connection: __log_fs_write, 218: journal/WiredTigerTmplog.0000000001: fatal log failure: No space left on device"}}
there is not space left on the device - i.e. no hard drive space. You'll need to fix that
Thank you for answering. After fixing the problem you pointed out, it seems to be working.
But still, one error is remaining the following. It says symbol XBTUSD does not exists. But I retrieved XBTUSD data by the cryptofeed. I wonder what is wrong...
cryptostore_1 | Process Collector-1:1:
cryptostore_1 | Traceback (most recent call last):
cryptostore_1 | File "/usr/local/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap
cryptostore_1 | self.run()
cryptostore_1 | File "/cryptostore/collector.py", line 120, in run
cryptostore_1 | fh.add_feed(self.exchange, timeout=timeout, max_depth=depth, snapshot_interval=snap_interval, book_interval=window, subscription={callback_type: self.exchange_config[callback_type]}, callbacks=cb)
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/cryptofeed/feedhandler.py", line 180, in add_feed
cryptostore_1 | self.feeds.append((_EXCHANGES[feed](config=self.config, **kwargs), timeout))
cryptostore_1 | File "/usr/local/lib/python3.7/site-packages/cryptofeed/exchange/bitmex.py", line 44, in __init__
cryptostore_1 | raise ValueError("{} is not active on BitMEX".format(pair))
cryptostore_1 | ValueError: XBTUSD is not active on BitMEX
if you are using the latest version from cryptofeed, the bitmex symbols have been normalized, so its BTC-USD now, not XBTUSD
That seems to be working. Thanks!