00:01:05  * jhendricksquit (Quit: Leaving.)
00:12:38  * jhendricksjoined
00:15:36  * therealkoopaquit (Remote host closed the connection)
00:16:12  * therealkoopajoined
00:20:52  * therealkoopaquit (Ping timeout: 256 seconds)
00:51:17  * therealkoopajoined
00:56:25  * therealkoopaquit (Ping timeout: 268 seconds)
00:59:35  * therealkoopajoined
01:02:15  * chorrelljoined
01:04:30  * therealkoopaquit (Ping timeout: 256 seconds)
01:06:20  * trentmquit (Quit: Leaving.)
01:18:11  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
01:20:01  * ed209quit (Remote host closed the connection)
01:20:08  * ed209joined
01:37:45  * dap_quit (Quit: Leaving.)
01:48:29  * therealkoopajoined
01:49:12  * therealkoopaquit (Remote host closed the connection)
01:49:44  * therealkoopajoined
01:54:32  * therealkoopaquit (Ping timeout: 260 seconds)
02:01:49  * jhendricksquit (Quit: Leaving.)
02:41:42  * therealkoopajoined
02:43:56  * bahamatquit (Quit: Leaving.)
03:22:41  * therealkoopaquit (Remote host closed the connection)
03:54:38  * mellocquit (Quit: Leaving.)
03:56:23  * bahamatjoined
04:18:06  * trentmjoined
04:23:47  * therealkoopajoined
04:26:24  * trentmquit (Quit: Leaving.)
04:28:37  * therealkoopaquit (Ping timeout: 252 seconds)
04:46:39  * trentmjoined
04:55:20  * bahamatquit (Quit: Leaving.)
04:56:18  * trentmquit (Quit: Leaving.)
04:58:06  * trentmjoined
05:15:38  * trentmquit (Quit: Leaving.)
05:24:50  * therealkoopajoined
05:29:05  * therealkoopaquit (Ping timeout: 244 seconds)
05:58:02  * bahamatjoined
06:25:35  * therealkoopajoined
06:30:20  * therealkoopaquit (Ping timeout: 258 seconds)
06:57:46  * mhicksquit (Quit: Leaving.)
07:04:09  * bahamatquit (Quit: Leaving.)
07:26:22  * therealkoopajoined
07:32:19  * therealkoopaquit (Ping timeout: 268 seconds)
07:43:37  * therealkoopajoined
07:47:57  * therealkoopaquit (Ping timeout: 240 seconds)
08:33:40  * wizard113__joined
08:44:14  * therealkoopajoined
08:44:52  * wizard113__quit (Remote host closed the connection)
08:48:48  * therealkoopaquit (Ping timeout: 245 seconds)
09:45:09  * therealkoopajoined
09:49:29  * therealkoopaquit (Ping timeout: 244 seconds)
10:20:01  * ed209quit (Remote host closed the connection)
10:20:08  * ed209joined
10:45:51  * therealkoopajoined
10:50:00  * therealkoopaquit (Ping timeout: 246 seconds)
11:46:28  * therealkoopajoined
11:51:04  * therealkoopaquit (Ping timeout: 256 seconds)
12:47:14  * therealkoopajoined
12:51:44  * therealkoopaquit (Ping timeout: 250 seconds)
13:48:02  * therealkoopajoined
13:52:58  * therealkoopaquit (Ping timeout: 265 seconds)
14:02:17  * therealkoopajoined
14:03:36  * therealkoopaquit (Remote host closed the connection)
14:03:57  * therealkoopajoined
14:56:13  * headw01joined
15:07:20  * therealkoopaquit
15:27:54  * mhicksjoined
15:54:34  <metsuke>@bahamas10, it looks like the process stopped about a third of the way through uploading the files: manta-sync: AssertionError: undefined (object) is required
15:54:44  <metsuke>I will try again though
16:35:36  * chorrelljoined
16:36:58  * dap_joined
16:56:40  * chorrellquit (Quit: My MacBook has gone to sleep. ZZZzzz…)
17:06:29  * chorrelljoined
17:08:18  * jhendricksjoined
17:22:07  <bahamas10>metsuke: well, at least it got past the initial file listing step - that's progress!
17:22:35  <bahamas10>but, that error message is fairly lame.
17:30:33  <metsuke>it's already done with 70K files out of 550K left, so it is still working much better than before. I'll report back once anything else happens, thanks
17:31:28  <bahamas10>metsuke: great. the patch in the `metsuke` branch definitely fixes the initial file listing memory exhausting bug... i'm just not sure why it would fail half way through like that
17:32:10  <bahamas10>my initial thought would be the local file list becoming out of sync with the files after the list is created - are the files you are uploading still being modified?
17:33:07  <metsuke>No, I didn't sync the files once I started trying to upload, so they should be the same
17:35:04  <bahamas10>ok. i'll try to come up with a patch to make error messages more verbose - having the filename and line number associated with that assertion is a must
17:46:17  * wizard113joined
17:51:44  * wizard113quit (Ping timeout: 265 seconds)
17:58:54  * bahamatjoined
18:04:15  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
18:04:34  * wizard113joined
18:07:47  * mellocjoined
18:13:53  <metsuke>hm, ran into it again after about 100K files
18:29:26  * wizard113quit (Remote host closed the connection)
19:31:58  <bahamas10>metsuke: the stack from the error message is removed as a result of the manta client creation here https://github.com/joyent/node-manta/blob/master/lib/create_client.js#L243-L247
19:32:10  <bahamas10>try running your script with the DEBUG env variable set to 1
19:32:16  <bahamas10>ie. DEBUG=1 ./manta-sync ...
19:32:41  <bahamas10>that way, when that error is encountered we will have a stacktrace to work with
19:37:25  <rmustacc>bahamas10: Presumably you could go from the core, no?
19:41:53  <bahamas10>metsuke: i don't know how to read it. mdb and gdb don't seem to like it, and i know very little about what freebsd dumps
19:57:15  <metsuke>I'm running with DEBUG=1
19:57:50  <bahamas10>rmustacc i tagged metsuke accidentely, that last message was meant for you.
19:58:07  <bahamas10>metsuke: great thanks; assuming it fails again we should know more
20:20:00  * ed209quit (Remote host closed the connection)
20:20:08  * ed209joined
21:05:32  * headw01quit (Read error: No route to host)
21:10:23  <metsuke>bahamas10: https://gist.github.com/metsuke0/733726b995cee5619d2a240843b561e3
21:10:28  <metsuke>that is the error
21:27:25  <melloc>metsuke: Looks like it's this: https://github.com/joyent/node-manta/issues/261
21:27:43  <melloc>It was fixed in a recent version of node-manta.
21:29:42  <melloc>The release that contains the fix is 3.1.1.
21:29:59  <melloc>But manta-sync depends on manta ~3.0.0.
21:30:54  <melloc>Although that function is called when there's a read error, anyways.
21:32:57  <metsuke>melloc: makes some sense then: https://gist.github.com/metsuke0/e4cff10bee26ef60f670babcd9205545
21:35:02  <melloc>If you remove that manta@3.0.0, it should use the manta@3.1.3. You can then run it again, and hopefully get the other error it was trying to report.
21:35:36  <melloc>(You could also bump the dependency in the package.json in the manta-sync folder and run npm install in that directory to pull down the newer one.)
21:37:03  <metsuke>that sounds better, I chose the latter
21:42:15  * thojoined
21:43:36  * thopart
22:31:20  * headw01joined
23:00:59  * bahamatquit (Quit: Leaving.)
23:02:16  * bahamatjoined
23:17:22  * bahamatquit (Quit: Leaving.)
23:18:20  * bahamatjoined
23:21:41  * jhendricksquit (Quit: Leaving.)
23:22:26  * jhendricksjoined
23:23:43  * jhendricksquit (Client Quit)
23:28:27  * jhendricksjoined