Remote load crashes with used by two filter
bianpengyuan opened this issue · comments
Remote load works fine with a filter chain which has only one remote load filter. When two filters use remote load, envoy crashes with the following backtrace:
[2020-05-08 18:31:33.459][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:91] Backtrace (use tools/stack_decode.py to get line numbers):
[2020-05-08 18:31:33.459][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:92] Envoy version: 66a976c412a2dcbe9aa039e1596667e4ade226d8/1.14.1/Modified/DEBUG/BoringSSL
[2020-05-08 18:31:33.539][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #0: Envoy::TerminateHandler::logOnTerminate()::$_0::operator()() [0x5582f038e5af]
[2020-05-08 18:31:33.607][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #1: Envoy::TerminateHandler::logOnTerminate()::$_0::__invoke() [0x5582f038e549]
[2020-05-08 18:31:33.675][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #2: std::__terminate() [0x5582f12bdd43]
[2020-05-08 18:31:33.743][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #3: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee04fa56]
[2020-05-08 18:31:33.812][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #4: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:33.881][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #5: Envoy::Extensions::Common::Wasm::Wasm::~Wasm() [0x5582ee026a15]
[2020-05-08 18:31:33.949][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #6: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee03e9b6]
[2020-05-08 18:31:33.949][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #7: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:34.016][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #8: Envoy::Extensions::Common::Wasm::WasmHandle::~WasmHandle() [0x5582ee04febb]
[2020-05-08 18:31:34.016][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #9: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee04fa56]
[2020-05-08 18:31:34.016][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #10: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:34.084][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #11: std::__1::shared_ptr<>::operator=() [0x5582ef598473]
[2020-05-08 18:31:34.151][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #12: Envoy::ThreadLocal::InstanceImpl::removeSlot()::$_10::operator()() [0x5582ef58b86e]
[2020-05-08 18:31:34.219][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #13: std::__1::__invoke<>() [0x5582ef58b7dd]
[2020-05-08 18:31:34.287][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #14: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef58b78d]
[2020-05-08 18:31:34.356][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #15: std::__1::__function::__alloc_func<>::operator()() [0x5582ef58b75d]
[2020-05-08 18:31:34.424][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #16: std::__1::__function::__func<>::operator()() [0x5582ef58a8ae]
[2020-05-08 18:31:34.491][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #17: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:34.558][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #18: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:34.625][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #19: Envoy::Event::DispatcherImpl::runPostCallbacks() [0x5582ef74d659]
[2020-05-08 18:31:34.692][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #20: Envoy::Event::DispatcherImpl::DispatcherImpl()::$_1::operator()() [0x5582ef750068]
[2020-05-08 18:31:34.760][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #21: std::__1::__invoke<>() [0x5582ef75002d]
[2020-05-08 18:31:34.827][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #22: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef74ffdd]
[2020-05-08 18:31:34.894][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #23: std::__1::__function::__alloc_func<>::operator()() [0x5582ef74ffad]
[2020-05-08 18:31:34.961][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #24: std::__1::__function::__func<>::operator()() [0x5582ef74f0fe]
[2020-05-08 18:31:34.961][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #25: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:34.961][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #26: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:35.028][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #27: Envoy::Event::TimerImpl::TimerImpl()::$_0::operator()() [0x5582ef78c7cd]
[2020-05-08 18:31:35.095][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #28: Envoy::Event::TimerImpl::TimerImpl()::$_0::__invoke() [0x5582ef78c776]
[2020-05-08 18:31:35.163][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #29: event_process_active_single_queue [0x5582f0271d11]
[2020-05-08 18:31:35.231][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #30: event_process_active [0x5582f026c40a]
[2020-05-08 18:31:35.299][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #31: event_base_loop [0x5582f026b2dc]
[2020-05-08 18:31:35.366][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #32: Envoy::Event::LibeventScheduler::run() [0x5582ef78b398]
[2020-05-08 18:31:35.502][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #34: Envoy::Server::WorkerImpl::threadRoutine() [0x5582ef723221]
[2020-05-08 18:31:35.569][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #35: Envoy::Server::WorkerImpl::start()::$_3::operator()() [0x5582ef728e1c]
[2020-05-08 18:31:35.636][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #36: std::__1::__invoke<>() [0x5582ef728ddd]
[2020-05-08 18:31:35.703][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #37: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef728d8d]
[2020-05-08 18:31:35.771][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #38: std::__1::__function::__alloc_func<>::operator()() [0x5582ef728d5d]
[2020-05-08 18:31:35.838][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #39: std::__1::__function::__func<>::operator()() [0x5582ef727e8e]
[2020-05-08 18:31:35.838][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #40: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:35.838][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #41: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:35.905][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #42: Envoy::Thread::ThreadImplPosix::ThreadImplPosix()::$_0::operator()() [0x5582f0405892]
[2020-05-08 18:31:35.972][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #43: Envoy::Thread::ThreadImplPosix::ThreadImplPosix()::$_0::__invoke() [0x5582f0405865]
[2020-05-08 18:31:35.972][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #44: start_thread [0x7f0ee111f6ba]
[2020-05-08 18:31:35.972][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:104] Caught Aborted, suspect faulting address 0x70c6e33100006d60
[2020-05-08 18:31:35.972][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:91] Backtrace (use tools/stack_decode.py to get line numbers):
[2020-05-08 18:31:35.972][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:92] Envoy version: 66a976c412a2dcbe9aa039e1596667e4ade226d8/1.14.1/Modified/DEBUG/BoringSSL
[2020-05-08 18:31:36.039][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #0: Envoy::SignalAction::sigHandler() [0x5582f03875ac]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #1: __restore_rt [0x7f0ee1129390]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #2: Envoy::TerminateHandler::logOnTerminate()::$_0::__invoke() [0x5582f038e549]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #3: std::__terminate() [0x5582f12bdd43]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #4: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee04fa56]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #5: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #6: Envoy::Extensions::Common::Wasm::Wasm::~Wasm() [0x5582ee026a15]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #7: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee03e9b6]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #8: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #9: Envoy::Extensions::Common::Wasm::WasmHandle::~WasmHandle() [0x5582ee04febb]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #10: std::__1::__shared_ptr_emplace<>::__on_zero_shared() [0x5582ee04fa56]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #11: std::__1::__shared_weak_count::__release_shared() [0x5582f129793e]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #12: std::__1::shared_ptr<>::operator=() [0x5582ef598473]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #13: Envoy::ThreadLocal::InstanceImpl::removeSlot()::$_10::operator()() [0x5582ef58b86e]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #14: std::__1::__invoke<>() [0x5582ef58b7dd]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #15: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef58b78d]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #16: std::__1::__function::__alloc_func<>::operator()() [0x5582ef58b75d]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #17: std::__1::__function::__func<>::operator()() [0x5582ef58a8ae]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #18: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #19: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #20: Envoy::Event::DispatcherImpl::runPostCallbacks() [0x5582ef74d659]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #21: Envoy::Event::DispatcherImpl::DispatcherImpl()::$_1::operator()() [0x5582ef750068]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #22: std::__1::__invoke<>() [0x5582ef75002d]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #23: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef74ffdd]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #24: std::__1::__function::__alloc_func<>::operator()() [0x5582ef74ffad]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #25: std::__1::__function::__func<>::operator()() [0x5582ef74f0fe]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #26: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #27: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #28: Envoy::Event::TimerImpl::TimerImpl()::$_0::operator()() [0x5582ef78c7cd]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #29: Envoy::Event::TimerImpl::TimerImpl()::$_0::__invoke() [0x5582ef78c776]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #30: event_process_active_single_queue [0x5582f0271d11]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #31: event_process_active [0x5582f026c40a]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #32: event_base_loop [0x5582f026b2dc]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #33: Envoy::Event::LibeventScheduler::run() [0x5582ef78b398]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #34: Envoy::Event::DispatcherImpl::run() [0x5582ef74d56a]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #35: Envoy::Server::WorkerImpl::threadRoutine() [0x5582ef723221]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #36: Envoy::Server::WorkerImpl::start()::$_3::operator()() [0x5582ef728e1c]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #37: std::__1::__invoke<>() [0x5582ef728ddd]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #38: std::__1::__invoke_void_return_wrapper<>::__call<>() [0x5582ef728d8d]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #39: std::__1::__function::__alloc_func<>::operator()() [0x5582ef728d5d]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #40: std::__1::__function::__func<>::operator()() [0x5582ef727e8e]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #41: std::__1::__function::__value_func<>::operator()() [0x5582ec964e75]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #42: std::__1::function<>::operator()() [0x5582ec964e35]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #43: Envoy::Thread::ThreadImplPosix::ThreadImplPosix()::$_0::operator()() [0x5582f0405892]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #44: Envoy::Thread::ThreadImplPosix::ThreadImplPosix()::$_0::__invoke() [0x5582f0405865]
[2020-05-08 18:31:36.040][28009][critical][backtrace] [bazel-out/k8-dbg/bin/external/envoy/source/server/_virtual_includes/backtrace_lib/server/backtrace.h:96] #45: start_thread [0x7f0ee111f6ba]
bianpengyuan/proxy@cfe923a has the test code that reproduces this. Specifically checkout out that branch, and run
make build
make build_wasm
export WASM=true
export ENVOY_DEBUG=debug # optional if envoy debug is desired.
go test -v ./test/envoye2e/stats_plugin/... -run ^TestStatsRemoteLoad$
The test starts a local file server to serve Wasm files. Run the test as this will fail with crash. Uncomment either https://github.com/bianpengyuan/proxy/blob/cfe923a029c6e049ee6a54bab777c8c08d2aac8e/test/envoye2e/stats_plugin/stats_test.go#L308 (disable metadata exchange filter) or https://github.com/bianpengyuan/proxy/blob/cfe923a029c6e049ee6a54bab777c8c08d2aac8e/test/envoye2e/stats_plugin/stats_test.go#L316 (disable stats filter), test will pass.
And during the test, I found that even with just one filter does remote load and the other one does local file, envoy also crashes, but I think it should because of the same reason.
The test passes for me.
OK the error is coming out of the onDone call.
Still need to fix master