00:00:31  * chorrelljoined
00:05:52  * trentmquit (Quit: Leaving.)
00:09:12  * yunong_quit (Remote host closed the connection)
00:17:54  * trentmjoined
00:18:57  * dap_joined
00:20:05  * ryancnelsonquit (Quit: Leaving.)
00:26:55  * trentmquit (Quit: Leaving.)
00:30:54  * pmooneyquit (Ping timeout: 264 seconds)
00:39:20  * philipheinser_quit (Quit: (null))
00:41:39  * dap_quit (Quit: Leaving.)
00:49:39  * fredkquit (Quit: Leaving.)
01:12:10  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
01:20:00  * ed209quit (Remote host closed the connection)
01:20:07  * ed209joined
01:27:24  * trentmjoined
01:35:29  * yunong_joined
01:39:07  * trentmquit (Quit: Leaving.)
01:41:48  * yunong_quit (Remote host closed the connection)
01:56:07  * happy-dudequit (Quit: Connection closed for inactivity)
02:21:55  * pmooneyjoined
02:26:29  * pmooneyquit (Ping timeout: 245 seconds)
02:32:17  * trentmjoined
03:10:44  * yunong_joined
03:19:46  * pmooneyjoined
04:36:04  * pmooneyquit (Ping timeout: 245 seconds)
05:21:58  * pmooneyjoined
05:26:47  * pmooneyquit (Ping timeout: 256 seconds)
06:07:35  * yunong_quit (Remote host closed the connection)
06:41:05  * trentmquit (Quit: Leaving.)
07:19:20  * therealkoopajoined
07:42:49  * therealkoopaquit (Remote host closed the connection)
08:03:55  * therealkoopajoined
08:10:32  * therealkoopaquit (Remote host closed the connection)
09:01:54  * bixu_quit
09:08:13  * yunong_joined
09:10:16  * bixu_joined
09:13:24  * yunong_quit (Ping timeout: 272 seconds)
10:20:01  * ed209quit (Remote host closed the connection)
10:20:08  * ed209joined
10:44:13  * bixu__joined
10:44:25  * bixu_quit (Read error: Connection reset by peer)
10:54:07  * pmooneyjoined
10:58:35  * pmooneyquit (Ping timeout: 246 seconds)
11:16:10  * marselljoined
12:55:18  * chorrelljoined
13:38:05  * bixu__quit (Remote host closed the connection)
14:03:33  * axisysjoined
14:03:56  * axisysquit (Changing host)
14:03:57  * axisysjoined
14:03:57  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
14:22:33  * bixu_joined
14:26:49  * chorrelljoined
14:29:06  * bixu_quit
14:35:04  * pmooneyjoined
14:38:04  * yunong_joined
14:45:33  * yunong_quit (Remote host closed the connection)
14:53:17  * yunong_joined
14:57:30  * yunong_quit (Ping timeout: 244 seconds)
15:32:28  * marsellquit (Ping timeout: 265 seconds)
15:32:44  * marselljoined
15:54:06  * yunong_joined
16:01:56  * yunong_quit (Ping timeout: 252 seconds)
16:02:51  * fredkjoined
16:04:03  * ryancnelsonjoined
16:14:06  * dap_joined
16:17:12  * trentmjoined
16:24:19  * trentmquit (Quit: Leaving.)
16:37:23  * therealkoopajoined
16:41:47  * therealkoopaquit (Remote host closed the connection)
17:06:02  * trentmjoined
17:14:35  * trentmquit (Quit: Leaving.)
17:15:49  * chorrellquit (Quit: Textual IRC Client: www.textualapp.com)
18:07:19  * happy-dudejoined
19:12:10  * chorrelljoined
19:21:45  * yunong_joined
19:28:53  * yunong_quit (Remote host closed the connection)
19:36:09  * gmvjoined
19:37:48  <gmv>hi all
19:38:16  <gmv>I'm toying around with manta and I have trouble with the job that downloads images
19:38:31  * yunong_joined
19:38:47  <gmv>the bb9264e2-f134-11e3-9ec7-478da02d1a13 image
19:38:59  * yunong_quit (Read error: Connection reset by peer)
19:39:18  <gmv>that should be the marlin image
19:39:26  * yunong_joined
19:39:50  <gmv>I get very slow download speeds from updates.joyent.com and the job timeouts at 3600 secs
19:40:18  <gmv>I try to fetch the image manually by running sdc-imgadm import bb9264e2-f134-11e3-9ec7-478da02d1a13 -S https://updates.joyent.com
19:40:55  <gmv>this times out as well at 1 hour
19:42:57  <gmv>if I login to imgapi0 zone, i see under /data/imgapi/images/bb9/bb9264e2-f134-11e3-9ec7-478da02d1a13
19:43:21  <gmv>4 files named file0.*
19:43:22  * yunong__joined
19:43:50  <gmv>sized from 1.7 to 7.1 GB each
19:44:02  <gmv>is this expected for the marlin image?
19:44:13  * yunong_quit (Ping timeout: 264 seconds)
19:45:20  <gmv>Does re-issuing the import command resume the download, or tries downloading all over again?
19:45:25  * ryancnelsonpart
19:53:36  * yunong__quit (Remote host closed the connection)
20:05:21  * yunong_joined
20:11:27  * trentmjoined
20:16:15  <dap_>gmv: Sorry about the trouble. There are some known issues that affect large downloads. We hope to be deploying the fix for that in the coming week or two. The marlin image is quite large, and that's why you tend to see it with that one.
20:18:37  <gmv>thanks for replying dap_ . Do you have any workarounds for me to try currently or should I wait for the fixes?
20:20:01  * ed209quit (Remote host closed the connection)
20:20:08  * ed209joined
20:21:06  <dap_>If you can find the path on updates.joyent.com for the image (which I bet you can get sdc-imgadm to print with "-v"), you can try fetching with "curl -o the_image_file -C -". You can rerun that command as many times as you need and curl will pick up where it left off.
20:21:10  <dap_>Sorry, I know that kind of sucks.
20:22:00  <dap_>Anyway, once you've got it, you've also got to grab the manifest file (much smaller) and then you can do: sdc-imgadm import -f the_image_file -m the_manifest_file
20:22:20  <dap_>You can also tell your Manta to use a different Marlin image. It just means less software will be available for compute zones.
20:22:41  <trentm>https://updates.joyent.com/images/$uuid/file <--- the path
20:22:54  <dap_>nice
20:26:07  * chorrellquit (Quit: My Mac has gone to sleep. ZZZzzz…)
20:27:39  * pmooneyquit (Ping timeout: 246 seconds)
20:27:57  <gmv>there are queued download jobs, I'm cleaning up the mess before trying curl
20:32:02  <gmv>ok, I've got the file downloading (13G) via wget
20:32:21  <dap_>Okay. I don't know if wget has a similar flag to curl's "-C -".
20:32:26  <gmv>trentm: do you know the path to download the manifest?
20:32:42  <gmv>yes, it does, -c
20:32:56  <dap_>Cool.
20:33:04  <trentm>gmv: yes, remove the '/file'
20:33:12  <trentm>i.e. https://updates.joyent.com/image/$uuid
20:33:27  <gmv>fun fact: the headnode does not have the necessary certificates for wget to verify joyent's SSL cert
20:33:39  <gmv>trentm: thanks!
20:36:54  <gmv>dap_ trentm thank you both!
20:42:44  * yunong_quit (Remote host closed the connection)
20:57:43  <gmv>bad luck
20:57:48  <gmv>curl: (33) HTTP server doesn't seem to support byte ranges. Cannot resume.
20:57:54  <gmv>wget reports the same
20:58:14  <gmv>doesn't manta support byte range downloads?
21:02:37  <dap_>Yeah, it does
21:02:45  <dap_>But I guess imgapi doesn't
21:05:23  <dap_>Sigh. Sorry. I believe I have a copy of this image in /dap/public/testmarlinimage0 (ironically, I was using it to test the issue with broken downloads). If you use "mget" to fetch it, it will automatically resume the download if it fails.
21:11:14  <gmv>why do you mention imgapi? I have skipped imgapi, I'm using wget or curl
21:11:26  <dap_>But you're hitting updates.joyent.com, right?
21:12:05  <gmv>yes
21:12:33  <gmv>i guess I'm not hitting manta directly, I'm going through another service?
21:12:42  <dap_>Yeah. That's running imgapi (a different instance than the one in your SDC install), and that's proxying requests to Manta.
21:14:14  <gmv>and I was wondering why i am not seeing the usual us-east.manta.joyent.com domain in the url
21:14:20  <gmv>:)
21:16:15  <trentm>sorry that imgapi doesn't have range support yet
21:17:00  <gmv>i'm trying manta just for fun, so I'm grateful it's open source
21:17:05  <trentm>https://smartos.org/bugview/IMGAPI-154
21:17:25  <gmv>btw, seriously impressive job, both manta and sdc 7
21:24:08  <gmv>i did some math on why i'm only getting 5 mbps from updates.joyent.com on a 30mbps ethernet line
21:24:56  <gmv>i'm looking at my headnode and there is 128000 bytes tcp send window hi water value
21:25:50  <gmv>I have 199 ms roundtrip latency with updates.manta.com (i'm in Greece)
21:26:16  <gmv>if i've done my math correctly that gives me 5.12 mbps (625KB/sec) max speed
21:27:19  <gmv>that's 6 hours download time for the marlin image (best scenario)
21:27:44  <gmv>and the job limit is 1 hour. I stood no change in the first place of having this working :)
21:27:52  <trentm>this help? (this is just ignorant cut 'n paste from tuning commands I was given but don't grok)
21:27:52  <trentm>ipadm set-prop -t -p max_buf=2097152 tcp || true
21:27:52  <trentm>ndd -set /dev/tcp tcp_recv_hiwat 2097152
21:27:52  <trentm>ndd -set /dev/tcp tcp_xmit_hiwat 2097152
21:27:52  <trentm>ndd -set /dev/tcp tcp_conn_req_max_q 2048
21:27:52  <trentm>ndd -set /dev/tcp tcp_conn_req_max_q0 8192
21:28:16  * yunong_joined
21:28:19  <rmustacc>It may help a little, but given that the Internet and an ocean are in the way, it's less likely to.
21:28:37  * yunong_quit (Read error: Connection reset by peer)
21:28:38  <gmv>not for me, for updates.joyent.com maybe :)
21:28:40  <rmustacc>gmv: You should be able to manually download the image and install it.
21:29:07  <gmv>rmustacc: thanks, dap_ and trentm have instructed me how to do this manually
21:32:06  <rmustacc>Oh great.
22:08:08  * therealkoopajoined
22:08:41  * therealkoopaquit (Remote host closed the connection)
22:10:02  * therealkoopajoined
22:15:40  * therealkoopaquit (Remote host closed the connection)
22:18:38  * dap_1joined
22:21:26  * dap_quit (Ping timeout: 246 seconds)
22:43:17  * gmvquit
23:29:24  * pmooneyjoined