04:56:21  * jerrysvjoined
05:09:30  * jerrysvquit
07:53:25  * bonswouarjoined
08:22:27  * Guest96084quit (Changing host)
08:22:27  * Guest96084joined
08:22:32  * Guest96084changed nick to kenansulayman
13:23:38  * brycebarilquit
13:23:49  * brycebariljoined
14:01:03  * ralphthe1injachanged nick to ralphtheninja
14:20:19  * daleharveyquit (Ping timeout: 246 seconds)
14:21:22  * nrwquit (Ping timeout: 246 seconds)
14:24:03  * daleharveyjoined
14:24:45  * nrwjoined
15:41:50  * bonswouarquit (Read error: Connection reset by peer)
16:17:12  * dguttmanjoined
18:48:15  * sethvincentjoined
20:23:38  * gyaresuquit (Quit: ...uh oh)
20:30:47  * gyaresujoined
20:30:47  * gyaresuquit (Changing host)
20:30:47  * gyaresujoined
21:32:52  <dguttman>hey all, I’m running into a really strange issue
21:33:14  <dguttman>createReadStream() is super slow
21:34:29  <dguttman>it takes 5 seconds before the first chunk of data, then there’s a 7 second pause, then the next chunk (24 items), then a 7 second pause, then the next chunk (37 items)
21:34:40  <dguttman>total of ~20 seconds for 88 items
21:36:36  <dguttman>keys are ~100B, values are ~600B
21:37:26  <dguttman>a direct get is decently fast though
21:39:34  <dguttman>db is about 44G
21:39:55  <dguttman>did a repair, but didn’t help
22:06:52  <dguttman>hmm, now playing with a clone of the db, and it’s even worse
22:07:17  <dguttman>createReadStream stalls for ~ 16 seconds and then gets killed
22:07:30  <dguttman>the process eats up all the memory
22:07:42  <dguttman>get still works fine
22:08:09  <dguttman>dropping down to leveldown and creating an iterator leads to the same issue as createReadStream...
22:20:31  <dguttman>anyone experience anything like this, or have suggestions how to figure out what’s going on?
22:50:10  <ogd>dguttman: how big are the values?
22:50:20  <ogd>dguttman: (key/value sizes)
23:13:55  <dguttman>ogd: keys are ~100B, values are ~600B
23:14:05  <ogd>dguttman: huh weird
23:14:26  <ogd>dguttman: can you reproduce it on another computer?
23:15:24  <dguttman>ogd: closest to that is I launched a new instance/volume from a snapshot
23:15:39  <dguttman>the new instance was even worse than the original
23:15:46  <dguttman>wouldn’t return *any* data
23:16:03  <ogd>dguttman: i havent seen anything like that before sorry
23:16:35  <dguttman>all good, wanted to avoid chalking it up to an AWS/EBS issue
23:16:53  <dguttman>but going to just nuke it, move on, and hopefully it won’t happen again
23:19:21  <dguttman>ogd: have you experienced any performance degradation at certain numbers of keys / data size?
23:19:49  <ogd>dguttman: nope, biggest leveldb ive had is ~65 million keys and it worked fine (it was locally on an ssd)
23:23:20  <dguttman>ogd: cool, good to know
23:27:47  * bret_joined
23:28:52  * nrw_joined
23:30:18  * bretquit (Read error: Connection reset by peer)
23:32:10  * bret_changed nick to bret
23:32:20  * nrwquit (Ping timeout: 253 seconds)
23:32:52  * nrw_changed nick to nrw
23:33:51  * dguttman_joined
23:34:20  * dguttmanquit (Ping timeout: 265 seconds)
23:34:21  * dguttman_changed nick to dguttman
23:59:19  * kenansulaymanquit (*.net *.split)
23:59:21  * bretquit (*.net *.split)
23:59:22  * gyaresuquit (*.net *.split)
23:59:22  * jameskyburzquit (*.net *.split)
23:59:23  * nolanlawsonquit (*.net *.split)
23:59:23  * mitzip_quit (*.net *.split)
23:59:23  * yoshuawuytsquit (*.net *.split)
23:59:24  * null_radixquit (*.net *.split)
23:59:26  * juulquit (*.net *.split)
23:59:26  * ogdquit (*.net *.split)
23:59:26  * jfojtlquit (*.net *.split)
23:59:28  * karissaquit (*.net *.split)
23:59:28  * dlitz_quit (*.net *.split)
23:59:28  * commandolinequit (*.net *.split)
23:59:29  * sorribasquit (*.net *.split)
23:59:29  * daleharveyquit (*.net *.split)
23:59:30  * bensternthalquit (*.net *.split)
23:59:30  * tdfischerquit (*.net *.split)
23:59:30  * mafintoshquit (*.net *.split)
23:59:32  * chrisdickinsonquit (*.net *.split)
23:59:32  * nrwquit (*.net *.split)
23:59:33  * timoxley_quit (*.net *.split)
23:59:33  * substackquit (*.net *.split)
23:59:33  * wangbusquit (*.net *.split)
23:59:33  * eugenewarequit (*.net *.split)
23:59:33  * AustinMathernequit (*.net *.split)
23:59:34  * ehdquit (*.net *.split)
23:59:34  * richardlittquit (*.net *.split)
23:59:34  * Raynosquit (*.net *.split)
23:59:34  * tixzquit (*.net *.split)
23:59:34  * calvinmetcalfquit (*.net *.split)
23:59:34  * l1xquit (*.net *.split)
23:59:35  * brycebarilquit (*.net *.split)
23:59:36  * jez0990quit (*.net *.split)
23:59:36  * jcrugzzquit (*.net *.split)
23:59:36  * ryanjquit (*.net *.split)
23:59:37  * ggreerquit (*.net *.split)
23:59:37  * dguttmanquit (*.net *.split)
23:59:39  * ralphtheninjaquit (*.net *.split)
23:59:40  * chiltsquit (*.net *.split)
23:59:40  * phpnodequit (*.net *.split)
23:59:40  * gildeanquit (*.net *.split)
23:59:41  * hij1nxquit (*.net *.split)
23:59:41  * hughskquit (*.net *.split)
23:59:42  * _jungh4nsquit (*.net *.split)