[rabbitmq-users] Unable to start rabbitmq after network partition

[Ryan Brown]

I have experienced a network partition in my rmq four node cluster and am
havinf all kinds of troubles. Most pertinent is that attempting to start it
on one of the nodes just hangs.

Instance details:

Rabbit version: 3.2.1
Erlang version: R16B02



$ sudo invoke-rc.d rabbitmq-server start
* Starting message broker rabbitmq-server
... Never returns

The sasl log show the following:


=CRASH REPORT==== 30-Jul-2015::09:57:56 ===
crasher:
initial call: gen:init_it/6
pid: <0.29086.0>
registered_name: []
exception exit: {{bad_return_value,
{error,
{{badmatch,{[{25,<7146.913.0>}],[]}},
[{gm,'-record_new_member_in_group/5-fun-1-',4,
[]},
{mnesia_tm,apply_fun,3,
[{file,"mnesia_tm.erl"},{line,830}]},
{mnesia_tm,execute_transaction,5,
[{file,"mnesia_tm.erl"},{line,810}]},
{rabbit_misc,
'-execute_mnesia_transaction/1-fun-0-',1,
[]},
{worker_pool_worker,handle_call,3,[]},
{gen_server2,handle_msg,2,[]},
{proc_lib,wake_up,3,
[{file,"proc_lib.erl"},{line,249}]}]}}},
{gen_server2,call,
[<7146.1467.0>,
{add_on_right,{37,<0.29086.0>}},
infinity]}}
in function gen_server2:terminate/3
ancestors: [<0.29085.0>,rabbit_mirror_queue_slave_sup,rabbit_sup,
<0.158.0>]
messages: []
links: [<0.29085.0>]
dictionary: [{random_seed,{3917,519,10539}}]
trap_exit: false
status: running
heap_size: 987
stack_size: 27
reductions: 273
neighbours:

[Michael Klishin]

Post by Ryan Brown
Rabbit version: 3.2.1
Erlang version: R16B02
$ sudo invoke-rc.d rabbitmq-server start
* Starting message broker rabbitmq-server
... Never returns
=CRASH REPORT==== 30-Jul-2015::09:57:56 ===
initial call: gen:init_it/6
pid: <0.29086.0>
registered_name: []
exception exit: {{bad_return_value,
{error,
{{badmatch,{[{25,<7146.913.0>}],[]}},
[{gm,'-record_new_member_in_group/5-fun-1-',4,

There is a bunch of very similar issues in our legacy bug tracker
(as in, not on GitHub), several were fixed in 3.3.x and 3.4.x.
--
MK

Staff Software Engineer, Pivotal/RabbitMQ

[Ryan Brown]

Ok, thank you Michael. Unfortunately there is not much I can do at the
moment then. But this does raise the urgency to upgrade.

Thanks again.

Post by Michael Klishin

Post by Ryan Brown
Rabbit version: 3.2.1
Erlang version: R16B02
$ sudo invoke-rc.d rabbitmq-server start
* Starting message broker rabbitmq-server
... Never returns
=CRASH REPORT==== 30-Jul-2015::09:57:56 ===
initial call: gen:init_it/6
pid: <0.29086.0>
registered_name: []
exception exit: {{bad_return_value,
{error,
{{badmatch,{[{25,<7146.913.0>}],[]}},
[{gm,'-record_new_member_in_group/5-fun-1-',4,

There is a bunch of very similar issues in our legacy bug tracker
(as in, not on GitHub), several were fixed in 3.3.x and 3.4.x.
--
MK
Staff Software Engineer, Pivotal/RabbitMQ