frsyuki

7 ms·

1.
How Uber engineering evaluated JSON encoding and compression algorithms(eng.uber.com)
9 points by frsyuki 11y ago|1 comments
2.
by frsyuki 11y ago
ACK of network transfer is available ("require_ack_response" option). This option ends up choice of at-most-once semantics vs. at-least-once semantics. You need to choose and you can choose. Fuentd provides "buffer_type file&
3.
Fluentd vs. Logstash(pandastrike.com)
3 points by frsyuki 11y ago|0 comments
4.
by frsyuki 14y ago
Did you guys see this video?: http://vimeo.com/53261709 Github uses MessagePack for their internal RPC protocol.
5.
by frsyuki 14y ago
Here is a benchmark result of msgpack, json, bson and protobuf: https://gist.github.com/4348013 An important point we should consider here is that actual performance depends on implementation.
6.
MessagePack for Ruby version 5(gist.github.com)
5 points by frsyuki 14y ago|0 comments
7.
Verelo + PagerDuty: New integration is live(blog.pagerduty.com)
4 points by frsyuki 14y ago|0 comments
8.
Understanding the Book-Crossing Dataset: Setup(blog.treasure-data.com)
4 points by frsyuki 14y ago|0 comments
9.
by frsyuki 14y ago
Disclaimer: I'm authoer of MessagePack for C++/Ruby and committer of one for Java. As for strings, JSON has to allocate memory and copy to deserialize strings because strings are escaped. MessagePack does't have to allocate/copy because the
10.
by frsyuki 14y ago
We're using MessagePack in a Rails application to log user behaviors and analyze them. Compared with other serialization libraries such as Protocol Buffers, Avro or BSON, one of the advantages of MessagePack is compatibility with JSON. (In
11.
by frsyuki 14y ago
MessagePack includes a concept named "type conversion" to support types which are not supported by its wire format. With the concept, we can serialize/deserialize user-defined classes as well as strings with encodings. So far, MessagePack f
12.
by frsyuki 14y ago
Although the original blog post focuses on JavaScript and browsers, MessagePack itself doesn't mainly focus on them. A major use case of MessagePack is to store serialized objects in memcached. A blog post written by Pinterest describes thi
13.
My thoughts on MessagePack(gist.github.com)
131 points by frsyuki 14y ago|26 comments
14.
JSX - a faster, safer, easier alternative to JavaScript(jsx.github.com)
53 points by frsyuki 14y ago|69 comments
15.
by frsyuki 14y ago
We're also using Fluentd as well as original JSON-based logging libraries. Fluentd deals with JSON-based logs. JSON is good for human facing interface because it is human readable and GREPable. On the other side, Fluentd handles logs in Mes
16.
by frsyuki 14y ago
Spitting out sprintfs means parsing texts. JSON might be slow since it's text, but binary based formats should be faster especially the log includes many integers.
17.
by frsyuki 14y ago
There are binary-based serialization formats such as MessagePack [1] or BSON [2] that doesn't need escapeing overhead. You can simply replace JSON with MessagePack since MessagePack is compatible with JSON. [1] Why Not MessagePack? http://
18.
LINE Storage: Storing billions of rows in Sharded-Redis and HBase per Month(tech.naver.jp)
3 points by frsyuki 14y ago|1 comments
19.
Enabling Facebook’s Log Infrastructure with Fluentd(blog.treasure-data.com)
19 points by frsyuki 15y ago|2 comments
20.
Japan’s Rakuten Acquires UK E-commerce Site Play.com For $39.1 Million(techcrunch.com)
4 points by frsyuki 15y ago|0 comments
21.
Architectural Evolution: From Middleware to The Cloud(jamesward.com)
3 points by frsyuki 15y ago|0 comments
22.
What Every Data Programmer Needs to Know About Disks(oscon.com)
46 points by frsyuki 15y ago|10 comments
23.
NextGen MapReduce Hits Apache Hadoop Mainline(hortonworks.com)
6 points by frsyuki 15y ago|0 comments
24.
by frsyuki 15y ago
You can use type-conversion APIs with MessagePack if you use C++, Java or C#. It converts deserialized objects (=dynamically-typed) into statically-typed objects using templates (C++) or reflection + dynamic code generation (Java and C#). Y
25.
by frsyuki 15y ago
Compatibility with JSON is a characteristic of MessagePack. If you're already using JSON, you can use MessagePack as a faster/smaller substitution of JSON. Since Protocol Buffers brings their original semantics, you must change lots of code
26.
by frsyuki 15y ago
Schemaless (dynamic typing) is the most obvious difference. I wrote about the pros/cons of schema here: http://news.ycombinator.com/item?id=2836242
27.
by frsyuki 15y ago
It works very well at least on ARM. I've used MessagePack on iPhone 3GS for the format of a dictionary file (> 100MB). I utilized mmap and zero-copy deserialization feature of MessagePack. And I received (and merged) some patches sent b
28.
CloudFS is now HekaFS(cloudfs.org)
1 points by frsyuki 15y ago|0 comments
29.
by frsyuki 15y ago
(Note: I'm author of MessagePack)
30.
by frsyuki 15y ago
I've described about the difference between MessagePack and BSON: "Performant Entity Serialization: BSON vs MessagePack (vs JSON)" http://stackoverflow.com/questions/6355497/performant-entity...

More ›