Issue

This Content is from Stack Overflow. Question asked by Cor Leonis

I was following a tutorial on transformer models and used the JParaCrawl corpus to train a machine translation model. However, after about 22 hours of running the epoch i got this message:

As I understand it, this is caused by an error in the iostream where the UUID of the stream does not match with index 0 of the incoming message. What could be causing this and how would I go about fixing it?

Bad pipe message: %s [b'*x81xaaxd2xfcx87>:txc2_9FGcxd6xf0xbf ,xcdux85xb0x9axxc2x8dpx94wxd1Sx1cx93x11Oxa1xd2xfexeenxfcx9exefxa2Txf5x0fxc2x10x00x08x13x02x13x03x13x01x00xffx01x00x00x8fx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x0cx00nx00x1dx00x17x00x1ex00x19x00x18x00#x00x00x00', b'x00x00x17x00x00x00rx00x1ex00x1cx04x03x05x03x06x03x08x07x08x08']
Bad pipe message: %s [b'x14<jxf5xeaxeaxdf~7nxacxacxe3+xa7x83x01Jx00x00>xc0x14xc0nx009x008x007x006xc0x0fxc0x05x005xc0x13xc0tx003x00']
Bad pipe message: %s [b'Nxeax89xefx16#xe7{xcdx9e1x93uqx0exbe#nx00x00xa6xc0,xc00x00xa3x00x9fxccxa9xccxa8xccxaaxc0xafxc0xadxc0xa3xc0x9fxc0]xc0axc0Wxc0Sxc0+xc0/x00xa2x00x9exc0xaexc0xacxc0xa2xc0x9exc0\xc0`xc0Vxc0Rxc0$xc0(x00kx00', b"sxc0wx00xc4x00xc3xc0#xc0'x00gx00@xc0rxc0vx00xbex00xbdxc0nxc0x14x009x008x00x88x00x87xc0txc0x13x003x002x00x9ax00x99x00Ex00Dxc0x07xc0x11xc0x08xc0x12x00x16x00x13x00x9dxc0xa1xc0x9dxc0Qx00x9cxc0xa0xc0x9cxc0Px00=x00xc0x00<x00xbax005x00x84x00/x00x96x00Ax00x05x00nx00xffx01x00"]
Bad pipe message: %s [b'xacx10x96.x8cxe4pxadx96x8aOxx0ex0bxc7xfcxf1kx00x00xa2xc0x14xc0nx009x008x007x006x00x88x00x87x00x86x00x85xc0x19x00:x00x89xc0x0fxc0x05x005x00x84xc0x13xc0tx003x002x001x000x00x9ax00x99x00x98x00x97x00Ex00Dx00Cx00Bxc0x18x004x00x9bx00Fxc0x0exc0x04x00/x00x96x00Ax00x07xc0x11xc0x07xc0x16x00x18xc0x0cxc0x02x00x05x00x04xc0x12xc0x08x00x16x00x13x00x10x00rxc0x17x00x1bxc0rxc0x03x00nx00x15x00x12x00x0fx00x0cx00x1ax00tx00x14x00x11x00x19x00x08x00x06x00x17x00x03xc0x10xc0x06xc0x15xc0x0bxc0x01x00x02x00x01x00xff']
Bad pipe message: %s [b')Rxe4xd4x99x91jxf5xe3x0e_xed:x9djxb3x12Wx00x00xa2xc0x14xc0nx009x008x007x006x00x88x00x87x00x86x00x85xc0x19x00:x00x89xc0x0fxc0x05x005x00x84xc0x13xc0tx003x002x001x000x00x9ax00x99x00x98x00x97x00Ex00Dx00Cx00', b'x18x004x00x9bx00Fxc0x0exc0x04x00/x00x96x00Ax00x07xc0x11xc0x07xc0x16x00x18xc0x0cxc0x02x00x05x00x04xc0x12xc0x08x00x16x00x13x00x10x00rxc0x17x00x1bxc0rxc0x03x00nx00x15x00x12x00x0fx00x0c']
Bad pipe message: %s [b'Yx19xc2@~2}x92xaax90xdfKx15xb9}x125x8ex00x00>xc0x14xc0nx009x008x007x006xc0x0fxc0x05x005xc0x13xc0tx003x002x001x000xc0x0exc0x04x00/x00x9ax00x99x00x98x00x97x00x96x00x07xc0x11xc0x07xc0x0cxc0x02x00x05x00x04x00xffx02x01x00x00Cx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x1cx00x1ax00x17x00x19x00', b'x1bx00x18x00x1ax00x16x00x0ex00rx00x0bx00x0cx00tx00nx00#x00x00x00x0fx00x01']
Bad pipe message: %s [b'@x00?x00>x003x002x001x000xc01xc0-xc0)xc0%xc0x0exc0x04x00x9cx00<x00/x00x9ax00x99x00x98x00x97x00x96x00x07xc0x11xc0x07xc0x0cxc0x02x00x05x00x04x00xffx02x01x00x00gx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x1cx00x1ax00x17x00x19x00x1cx00x1b']
Bad pipe message: %s [b'x08nx08x0bx08x04x08', b'x06x04x01x05']
Bad pipe message: %s [b'']
Bad pipe message: %s [b'']
Bad pipe message: %s [b'x03x02x03x04x00-x00x02x01x01x003x00&x00$x00x1dx00 xd6xfaxdcLyx97xd0xf1j7x9b-xd7Jx14x15Axb8x95lax05']
Bad pipe message: %s [b'Bxb9Vx9execxf8xd6#-xcdxdbxb5x11xc1x97Dx0cx1e x98x93xe3x1fxc4x84ox07xd2xabx0bx14x80Hxbaxb5xbaxeexb7nr3x94aCx89xcaxa1x0ex19fxbcx00x08x13x02x13x03x13', b'']
Bad pipe message: %s [b'xe2xc9t9xa4x9bxc3x16x1dxba/Zcx1c!xdaxa4x80 x112x8ex8ax84Rx01xc8xa0;x00x8cxf7C@^xbax8bxfex1fx8fxcfBx90x0excbxa2Rxf9xacjx8ax00x08x13x02x13x03x13x01x00xffx01x00x00x8fx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x0cx00nx00x1dx00x17x00x1ex00x19x00x18x00#x00x00x00x16x00']
Bad pipe message: %s [b"xa4xf9xa8xcaxa8x08MYI&c,xa5xf0xddxccxd6xddx00x00xa6xc0,xc00x00xa3x00x9fxccxa9xccxa8xccxaaxc0xafxc0xadxc0xa3xc0x9fxc0]xc0axc0Wxc0Sxc0+xc0/x00xa2x00x9exc0xaexc0xacxc0xa2xc0x9exc0\xc0`xc0Vxc0Rxc0$xc0(x00kx00jxc0sxc0wx00xc4x00xc3xc0#xc0'x00gx00@xc0r"]
Bad pipe message: %s [b'x00xbex00xbdxc0nxc0x14x009x008x00x88x00x87xc0txc0x13x003x002x00x9ax00x99x00Ex00Dxc0x07xc0x11xc0x08xc0x12x00x16x00x13x00x9dxc0xa1xc0x9dxc0Qx00x9cxc0xa0xc0x9cxc0Px00=x00xc0x00<x00xbax005x00x84x00/x00x96x00Ax00x05x00nx00xffx01x00x00jx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x0cx00nx00x1dx00x17x00x1ex00x19x00x18x00#x00x00x00x16x00x00x00x17x00x00x00rx000x00.x04x03x05x03x06x03x08x07x08x08x08tx08nx08x0bx08x04x08x05x08x06x04x01x05x01x06x01x03x03x02x03x03x01x02x01x03x02x02x02x04x02x05']
Bad pipe message: %s [b'x02']
Bad pipe message: %s [b'#rx93x9bxd6fxc8xf7xbcxfbx1bxfb]xe5nxe2x1awx00x00xa2xc0x14xc0nx009x008x007x006x00x88x00x87x00x86x00x85xc0']
Bad pipe message: %s [b':x00x89xc0x0fxc0x05x005x00x84xc0x13xc0tx003x002x001x000x00']
Bad pipe message: %s [b'x99x00x98x00x97x00Ex00Dx00Cx00Bxc0x18x004x00x9bx00Fxc0x0exc0x04x00/x00x96x00Ax00x07xc0x11xc0x07xc0x16x00x18xc0x0cxc0x02x00x05x00x04xc0x12xc0x08x00x16x00x13x00x10x00rxc0x17x00x1bxc0rxc0x03x00nx00x15x00x12x00x0fx00x0cx00x1ax00tx00x14x00x11x00x19x00x08x00x06x00x17x00x03xc0x10xc0x06xc0x15xc0x0bxc0x01x00x02x00x01x00xffx02x01x00x00Cx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x1cx00x1ax00x17x00']
Bad pipe message: %s [b'x1cx00x1bx00x18x00x1ax00x16x00x0ex00rx00x0bx00x0cx00tx00nx00#x00']
Bad pipe message: %s [b'{qSxb4xbaxb1Wx1fxedFkxbaxf8J]Hxf1xf6x00x00xa2xc0x14xc0nx009x008x007x006x00x88x00x87x00x86x00x85xc0x19x00:x00x89xc0x0fxc0x05x005x00x84xc0x13xc0tx003x002x001x000x00x9ax00x99x00x98x00x97x00Ex00Dx00Cx00Bxc0x18x004x00x9bx00Fxc0x0exc0x04x00/x00x96x00Ax00x07xc0x11xc0x07xc0x16x00x18xc0x0cxc0x02x00x05x00x04xc0x12xc0x08x00x16x00x13x00x10x00rxc0x17x00x1bxc0rxc0x03x00nx00x15x00x12x00x0fx00x0cx00x1ax00tx00x14x00x11x00x19x00x08x00x06x00x17x00x03xc0x10xc0x06xc0x15xc0x0bxc0x01x00x02x00x01x00xffx02x01x00x00Cx00x00x00x0ex00x0cx00x00t127.0.0.1x00x0bx00x04x03x00x01x02x00nx00x1cx00x1ax00x17x00x19x00x1cx00x1bx00x18x00x1ax00x16x00x0ex00rx00x0b']
Bad pipe message: %s [b'xe4x88x1azmox99xe3xdfnRixf8x17xc5xe6x9fx81x00x00xa2xc0x14xc0nx009x008x007x006x00x88x00x87x00x86x00x85xc0x19x00:x00x89xc0x0fxc0x05x005x00x84xc0x13xc0tx003x002x001x000x00x9ax00x99x00x98x00x97x00Ex00Dx00Cx00Bxc0x18x004x00x9bx00Fxc0x0exc0x04x00/x00x96x00Ax00x07xc0x11xc0x07xc0x16x00x18xc0x0cxc0x02x00x05x00x04xc0x12xc0x08x00x16x00x13x00x10x00rxc0x17x00x1bxc0rxc0x03x00nx00x15x00x12x00x0fx00x0cx00x1ax00tx00x14x00x11x00x19x00x08x00x06x00x17x00x03xc0x10xc0x06xc0x15xc0x0bxc0x01x00x02x00x01x00xffx02x01x00x15x03'] ```

Solution

This question is not yet answered, be the first one who answer using the comment. Later the confirmed answer will be published as the solution.

This Question and Answer are collected from stackoverflow and tested by JTuto community, is licensed under the terms of CC BY-SA 2.5. - CC BY-SA 3.0. - CC BY-SA 4.0.