00:02:54  * eugenewarequit (Ping timeout: 256 seconds)
00:16:49  * st_lukequit (Remote host closed the connection)
00:29:03  * eugenewarejoined
00:29:26  * eugenewarequit (Read error: Connection reset by peer)
00:31:18  * thl0joined
00:34:50  * thl0quit (Remote host closed the connection)
00:43:05  * werlequit (Quit: Leaving.)
00:50:49  * dominictarrquit (Quit: dominictarr)
00:58:00  * eugenewarejoined
01:07:20  * eugenewarequit (Quit: Leaving.)
01:08:15  * eugenewarejoined
01:14:24  * eugenewarequit (Quit: Leaving.)
01:19:32  * rvaggjoined
01:23:14  * thl0joined
01:25:04  * eugenewarejoined
01:30:52  * babof1tosquit (Read error: Connection reset by peer)
01:31:12  * babof1tosjoined
01:31:59  * levelbotjoined
01:33:33  <mbalho>thl0: ok so the response i got from github is that you have your script cache results across runs
01:33:45  <mbalho>thl0: use the etag / conditional crap
01:34:04  <mbalho>thl0: and they are happy to incrase your limit for the first 3 days (a standard thing they do i guess)
01:34:17  <mbalho>thl0: because on consecutive runs you should only be getting the new data which is below the limit
01:34:37  <mbalho>thl0: so you can email them and ask for a three day rate limit increase basically
01:38:15  <thl0>mbalho: ok, I'm already looking into that, but it's not trivial, since I'm dealing with paged data (only get 100 repos at a time for instance)
01:38:44  <thl0>mbalho: so I have to store multiple etags per resource, bc it may take multiple pages to get it
01:39:05  <thl0>mbalho: I may just use the If-Modified-Since header instead and see how that goes
01:39:46  <thl0>mbalho: thanks for your help though
01:44:53  * st_lukejoined
01:45:53  * no9quit (Ping timeout: 240 seconds)
01:47:44  * ralphtheninjaquit (Ping timeout: 256 seconds)
01:51:59  * st_lukequit (Remote host closed the connection)
02:07:34  * eugenewarequit (Quit: Leaving.)
02:33:14  * timoxleyjoined
03:05:29  * st_lukejoined
03:21:20  * st_lukequit (Remote host closed the connection)
03:26:21  * timoxleyquit (Quit: Computer has gone to sleep.)
03:38:00  * thl0quit (Remote host closed the connection)
03:53:51  <levelbot>[npm] leveldown-hyper@0.5.0 <http://npm.im/leveldown-hyper>: A Node.js LevelDB binding, primary backend for LevelUP (HyperDex fork) (@rvagg)
03:54:23  <rvagg>^^ the hyperdex leveldb fork, see propaganda here if you want to give it a try: http://hyperdex.org/performance/leveldb/
04:16:50  * timoxleyjoined
04:26:52  * eugenewarejoined
04:48:09  <brycebaril>rvagg: I was reading about that this morning, nice fast implementation.
04:48:51  <brycebaril>It talked a lot about getting the speedup when multiple threads were in use, does leveldown enable that?
04:49:12  <rvagg>yeah, leveldown uses libuv of course which has 4 worker threads
04:49:20  <rvagg>so node is naturally multithreadded
04:49:34  <rvagg>but... take their benchmarks with a grain of salt and do your own tests suited to your particualr use-case
04:49:37  <brycebaril>ahh, I see
04:50:08  <brycebaril>Yeah, of course.
04:51:07  <brycebaril>If their numbers are right, great. If not, hey -- it's still hella fast.
05:05:51  * timoxleyquit (Quit: Computer has gone to sleep.)
05:21:38  * timoxleyjoined
07:43:56  * dominictarrjoined
07:44:23  * eugenewarequit (Quit: Leaving.)
07:56:25  * babof1tosquit (Read error: Connection reset by peer)
07:56:44  * babof1tosjoined
08:19:04  * dominictarrquit (Quit: dominictarr)
08:20:23  * ChrisPartridgequit (Ping timeout: 252 seconds)
08:22:24  * no9joined
08:32:05  * dominictarrjoined
08:57:40  * dominictarrquit (Quit: dominictarr)
09:32:17  * ChrisPartridgejoined
09:37:27  * timoxleyquit (Quit: Computer has gone to sleep.)
09:39:44  * thl0joined
09:51:37  * thl0_joined
09:52:49  * thl0quit (Ping timeout: 246 seconds)
09:53:05  * no9quit (Ping timeout: 248 seconds)
10:02:26  * eugenewarejoined
10:07:00  * no9joined
10:24:44  * timoxleyjoined
10:35:21  * eugenewarequit (Quit: Leaving.)
10:35:51  * ralphtheninjajoined
10:37:16  * eugenewarejoined
11:20:21  * ramitosjoined
11:20:58  * st_lukejoined
12:22:55  <rvagg>for y'all: http://r.va.gg/2013/06/leveldown-alternatives.html
12:26:22  <rvagg>hij1nx, st_luke, juliangruber in particular, you might be interested ^^
12:31:32  * thl0_quit (Remote host closed the connection)
12:35:17  <st_luke>thanks
12:37:02  * st_lukequit
13:13:19  <levelbot>[npm] firedup@0.0.7 <http://npm.im/firedup>: A node.js implementation of firebase based on levelup (@nharbour)
13:14:27  <eugeneware>rvagg: that's awesome. I was just wondering if someone should port the hyperdex port to leveldown. Now I don't have to :-)
13:14:46  <rvagg>eugeneware: np, let me know how you go with it
13:15:19  <hij1nx>rvagg: super inspiring
13:21:54  <eugeneware>does anyone know of a monotonic hashing function that can be used for hash rings?
13:22:09  <rvagg>eugeneware: http://npm.im/flake
13:23:08  <eugeneware>rvagg: ta! That's perfect.
13:23:18  * no9quit (Ping timeout: 256 seconds)
13:23:35  <eugeneware>rvagg: I want to play around with the vector space hashing ideas that hyperdex is using. Thanks.
13:25:51  <eugeneware>rvagg: Not 100% what I was after. I'd like to make sure that a key such as name!alan and name!alex will have their hash values close to each other.
13:27:06  <eugeneware>rvagg: so that hash(name!alan) and hash(name!alex) would probably hash to the same server, whereas hash(name!wayne) & hash(name!william) would go to another.
13:28:11  <rvagg>eugeneware: oh right, that's sort of couchbaseish
13:28:18  <rvagg>eugeneware: you might have to write something of your own for that
13:28:39  <rvagg>eugeneware: but keep us informed in here, we see all your activity and it's good to be aware of what others are doing, particularly when they're as active as you
13:29:08  <eugeneware>rvagg: yeah. I searched npm/github, and couldn't find anything like that. I'll let you know what I find!
13:29:34  <eugeneware>rvagg: yeah. I noticed that big brother ircbot was keeping an eye one things ;-)
13:30:42  <rvagg>eugeneware: and don't forget to put your stuff on the wiki! https://github.com/rvagg/node-levelup/wiki/Modules
13:31:09  <eugeneware>rvagg: will do! I was wondering if a place like that existed. awesome.
13:32:40  <rvagg>we were discussing your byteup package the other day and about how tricky it is to extend the encodings; we need to make it much easier to insert custom encodings, there's some stuff about it here if you have thoughts to add: https://github.com/rvagg/node-levelup/issues/51
13:34:51  <rvagg>eugeneware: and lastly, before I disappear to bed, you may not be aware that we have an aussie Node (ish) channel on freenode: #polyhack -- it's a bunch of noders with some ruby, php, haskell, java and even CF people, you're welcome to join
13:35:31  * thl0joined
13:36:26  * no9joined
13:52:50  <juliangruber>rvagg: awesome post!
13:53:10  * chirinojoined
14:06:33  * thl0quit (Remote host closed the connection)
14:37:28  * thl0joined
14:38:42  * b4bofitosjoined
14:39:19  * babof1tosquit (Read error: Connection reset by peer)
14:45:53  * thl0quit (Ping timeout: 248 seconds)
14:56:19  * thl0joined
15:03:12  * timoxleyquit (Quit: Textual IRC Client: www.textualapp.com)
15:03:40  * brianloveswordsquit (Max SendQ exceeded)
15:04:49  * brianloveswordsjoined
15:05:13  * hij1nxquit (Quit: WeeChat 0.3.2)
15:06:02  * hij1nxjoined
15:06:13  * babof1tosjoined
15:06:45  * b4bofitosquit (Ping timeout: 248 seconds)
15:14:11  * werlejoined
16:28:31  * dominictarrjoined
16:43:47  * thl0quit (Remote host closed the connection)
16:47:12  <chapel>eugeneware: I also made an id generator similar to snowflake/flake but binary, I use it with bytewise
16:47:45  <chapel>https://github.com/chapel/unid really need to write a readme
16:51:15  <chapel>rvagg: just wanted to say that I love what you're doing with level related stuff in node
16:52:08  <chapel>your blog post about alternatives is great, further solidifies my resolve to push leveldb/up as the way to go
17:05:50  * dominictarrquit (Quit: dominictarr)
17:07:32  * dominictarrjoined
17:08:32  * dominictarrquit (Client Quit)
17:14:19  * thl0joined
17:22:45  * thl0quit (Ping timeout: 248 seconds)
17:40:15  * thl0joined
17:42:20  * werlequit (Quit: Leaving.)
17:50:04  <juliangruber>about to hack on leveldb with dominictarr and hij1nx in berlin :)
17:50:27  <chapel>nice juliangruber
17:59:17  * chirinoquit (Quit: Leaving...)
18:39:35  * enigmuriatic1joined
18:39:53  <enigmuriatic1>how do i select everything from a database? i'm using a haskell binding
18:47:33  * thl0quit (Ping timeout: 248 seconds)
18:48:52  * thl0joined
18:52:49  <thl0>enigmuriatic1: if you just wanna dump it, you can use level-dump
18:53:10  <enigmuriatic1>thanks, thl0. is that a bash command?
18:53:14  <thl0>otherwise just selecting range { start: '', end: '\xff' } should do it
18:53:28  <thl0>no it's an npm module (npm install level-dump)
18:53:49  <thl0>enigmuriatic1: https://github.com/thlorenz/level-dump
18:56:51  <enigmuriatic1>thl0, why is it a js file?
18:57:52  <enigmuriatic1>i was hoping it would be a bash command; not sure i can use it in my haskell script otherwise
19:02:02  <thl0>enigmuriatic1: maybe wrong leveldb channel? this is mostly for nodejs leveldb wrapper, maybe ask in #leveldb
19:12:10  <thl0>juliangruber: is hij1nx there? I wanted to ask him some more questions --
20:35:49  * no9quit (Ping timeout: 248 seconds)
20:48:42  * no9joined
20:59:48  * chirinojoined
21:02:18  * b4bofitosjoined
21:02:29  * babof1tosquit (Ping timeout: 248 seconds)
21:13:04  * chirinoquit (Quit: Computer has gone to sleep.)
21:46:33  * dominictarrjoined
21:54:45  * dominictarrquit (Quit: dominictarr)
22:18:01  * thl0quit (Ping timeout: 276 seconds)
22:19:57  * hij1nxquit (Ping timeout: 245 seconds)
22:45:28  * hij1nxjoined
22:50:58  <rvagg>enigmuriatic1: it's ok to talk leveldb-specific stuff in here, just don't expect much of a response because we're mostly Node poeple; tho there are some non-Node people here too
22:53:29  * rescrvjoined
22:55:52  * chirinojoined
23:01:03  * chirinoquit (Ping timeout: 260 seconds)
23:05:41  * chirinojoined
23:07:59  * dominictarrjoined
23:11:19  * chirinoquit (Ping timeout: 276 seconds)
23:38:20  * thl0joined
23:41:16  * thl0quit (Remote host closed the connection)
23:49:18  * dominictarrquit (Quit: dominictarr)