Golang Serialization Benchmark

Serializers

This project test the below go serializers, which compares with go standard json and xml.

• skycoin/src/cipher/encoder
• encoding/json
• encoding/xml
• github.com/tinylib/msgp
• github.com/golang/protobuf
• github.com/gogo/protobuf
• github.com/google/flatbuffers
• Apache/Thrift
• Apache/Avro
• andyleap/gencode
• ugorji/go/codec
• go-memdump
• colfer
• zebrapack
• gotiny
• github.com/ugorji/go/codec
• hprose-golang
• vmihailenco/msgpack.v2
• Sereal
• ffjson
• easyjson
• jsoniter

Excluded Serializers

Given existed benchmark by alecthomas，the below serializers are excluded from this test because of their poor performance.

• encoding/gob
• github.com/alecthomas/binary
• github.com/davecgh/go-xdr/xdr
• labix.org/v2/mgo/bson
• github.com/DeDiS/protobuf
• gopkg.in/vmihailenco/msgpack.v2
• bson

Test Environment

go version: 1.11

You'll need to install some tools. On OS X:

brew install thrift flatbuffers

• For skyencoder, you need to install the tool and get go generate to generate code:

  go get github.com/skycoin/skyencoder/cmd/skyencoder
  go generate

• For MessagePack，you need install the tool and use go generate to generate code:

  go get github.com/tinylib/msgp
  go generate

• For ProtoBuf, you need to install protoc，protobuf lib and generate code：

  go get github.com/golang/protobuf
  go generate

• For gogo/protobuf, use the below commands：

  go get github.com/gogo/protobuf/gogoproto
  go get -u github.com/gogo/protobuf/protoc-gen-gogofaster
  go generate

• For flatbuffers, you need to install [flatbuffers compiler](https://github.com/google/flatbuffers/releases, and flatbuffers lib：

  go get github.com/google/flatbuffers/go
  go generate

• For thrift, you need to install thrift compiler, and thrift lib：

  go get git.apache.org/thrift.git/lib/go/thrift
  go generate

• For Avro, you need to install goavro and checkout v1.0.5：

  go get github.com/linkedin/goavro
  cd $GOPATH/src/github.com/linkedin/goavro
  git checkout v1.0.5
  cd -
  go generate

• For gencode, you need to install gencode, and geneate code by gencode：

  go get github.com/andyleap/gencode
  gencode go -schema=gencode.schema -package gosercomp

• For easyjson, you need to install easyjson:

  go get github.com/mailru/easyjson
  go generate

• For zebraPack , you need to install zebraPack, and generate code：

  go get github.com/glycerine/zebrapack
  go generate zebrapack_data.go

• For ugorji/go/codec you need to install codecgen and codec lib:

  go get -tags=unsafe  -u github.com/ugorji/go/codec/codecgen
  go get -tags=unsafe -u github.com/ugorji/go/codec

  codecgen -o data_codec.go data.go

• For niubaoshu/gotiny you need to checkout v0.0.2:

	go get github.com/niubaoshu/gotiny
	cd $GOPATH/src/github.com/niubaoshu/gotiny
	git checkout v0.0.2

ugorji/go/codec supports msgpack、cbor、binc、json, and this project test its cbor and msgpack.

Actually，you can use go generate to generate code.

Test:

go test -bench=. -benchmem

Test Data Model

All tests are using the same data model as below:

type ColorGroup struct {
    ID     int `json:"id" xml:"id,attr""`
    Name   string `json:"name" xml:"name"`
    Colors []string `json:"colors" xml:"colors"`
}
`

Benchmark

Results generated on Mid-2015 Macbook Pro base model:

goos: darwin
goarch: amd64
pkg: github.com/smallnest/gosercomp
BenchmarkMarshalByJson-8                       	 2000000	       693 ns/op	     128 B/op	       2 allocs/op
BenchmarkUnmarshalByJson-8                     	 1000000	      2168 ns/op	     216 B/op	       8 allocs/op
BenchmarkMarshalByXml-8                        	  500000	      3584 ns/op	    4800 B/op	      11 allocs/op
BenchmarkUnmarshalByXml-8                      	  200000	     12458 ns/op	    3018 B/op	      73 allocs/op
BenchmarkMarshalByMsgp-8                       	20000000	       116 ns/op	      80 B/op	       1 allocs/op
BenchmarkUnmarshalByMsgp-8                     	 5000000	       235 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByProtoBuf-8                   	10000000	       200 ns/op	      48 B/op	       1 allocs/op
BenchmarkUnmarshalByProtoBuf-8                 	 3000000	       494 ns/op	     160 B/op	      10 allocs/op
BenchmarkMarshalByGogoProtoBuf-8               	10000000	       118 ns/op	      48 B/op	       1 allocs/op
BenchmarkUnmarshalByGogoProtoBuf-8             	 3000000	       415 ns/op	     144 B/op	       8 allocs/op
BenchmarkMarshalByFlatBuffers-8                	 5000000	       381 ns/op	      16 B/op	       1 allocs/op
BenchmarkUnmarshalByFlatBuffers-8              	2000000000	         0.35 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByFlatBuffers_withFields-8   	10000000	       140 ns/op	       0 B/op	       0 allocs/op
BenchmarkMarshalByThrift-8                     	 3000000	       458 ns/op	      64 B/op	       1 allocs/op
BenchmarkUnmarshalByThrift-8                   	 1000000	      1269 ns/op	     656 B/op	      11 allocs/op
BenchmarkMarshalByAvro-8                       	 3000000	       513 ns/op	      48 B/op	       6 allocs/op
BenchmarkUnmarshalByAvro-8                     	  500000	      3168 ns/op	    1672 B/op	      62 allocs/op
BenchmarkMarshalByGencode-8                    	30000000	        42.4 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByGencode-8                  	10000000	       125 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByUgorjiCodecAndCbor-8         	 2000000	       713 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndCbor-8       	 2000000	       618 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByUgorjiCodecAndMsgp-8         	 2000000	       669 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndMsgp-8       	 2000000	       644 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByUgorjiCodecAndBinc-8         	 2000000	       703 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndBinc-8       	 1000000	      1062 ns/op	     824 B/op	      10 allocs/op
BenchmarkMarshalByUgorjiCodecAndJson-8         	 2000000	       847 ns/op	     112 B/op	       3 allocs/op
BenchmarkUnmarshalByUgorjiCodecAndJson-8       	 2000000	       788 ns/op	      48 B/op	       6 allocs/op
BenchmarkMarshalByEasyjson-8                   	 5000000	       302 ns/op	     128 B/op	       1 allocs/op
BenchmarkUnmarshalByEasyjson-8                 	 3000000	       452 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByFfjson-8                     	 1000000	      1031 ns/op	     424 B/op	       9 allocs/op
BenchmarkUnmarshalByFfjson-8                   	 1000000	      1479 ns/op	     480 B/op	      13 allocs/op
BenchmarkMarshalByJsoniter-8                   	 3000000	       529 ns/op	      96 B/op	       2 allocs/op
BenchmarkUnmarshalByJsoniter-8                 	 3000000	       589 ns/op	      32 B/op	       5 allocs/op
BenchmarkUnmarshalByGJSON-8                    	 1000000	      1680 ns/op	     624 B/op	       7 allocs/op
BenchmarkMarshalByGoMemdump-8                  	  300000	      4686 ns/op	    1032 B/op	      30 allocs/op
BenchmarkUnmarshalByGoMemdump-8                	 1000000	      1348 ns/op	    2400 B/op	      12 allocs/op
BenchmarkMarshalBySky-8                        	 2000000	       761 ns/op	     112 B/op	       7 allocs/op
BenchmarkUnmarshalBySky-8                      	 2000000	       701 ns/op	     216 B/op	      11 allocs/op
BenchmarkMarshalBySkyencoder-8                 	20000000	        75.3 ns/op	       0 B/op	       0 allocs/op
BenchmarkMarshalBySkyencoderWithAlloc-8        	20000000	       112 ns/op	      64 B/op	       1 allocs/op
BenchmarkUnmarshalBySkyencoder-8               	10000000	       206 ns/op	      96 B/op	       6 allocs/op
BenchmarkMarshalByColfer-8                     	50000000	        33.7 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByColfer-8                   	10000000	       213 ns/op	      96 B/op	       6 allocs/op
BenchmarkMarshalByZebrapack-8                  	10000000	       262 ns/op	     182 B/op	       0 allocs/op
BenchmarkUnmarshalByZebrapack-8                	 5000000	       291 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByGotiny-8                     	20000000	        86.9 ns/op	       0 B/op	       0 allocs/op
BenchmarkUnmarshalByGotiny-8                   	10000000	       176 ns/op	      32 B/op	       5 allocs/op
BenchmarkMarshalByHprose-8                     	 3000000	       455 ns/op	     210 B/op	       1 allocs/op
BenchmarkUnmarshalByHprose-8                   	 2000000	       654 ns/op	     288 B/op	       9 allocs/op
BenchmarkMarshalBySereal-8                     	 1000000	      2202 ns/op	     792 B/op	      22 allocs/op
BenchmarkUnmarshalBySereal-8                   	 2000000	       696 ns/op	      80 B/op	       6 allocs/op
BenchmarkMarshalByMsgpackV2-8                  	 1000000	      2008 ns/op	     192 B/op	       4 allocs/op
BenchmarkUnmarshalByMsgpackv2-8                	 1000000	      1585 ns/op	     232 B/op	      11 allocs/op
BenchmarkMarshalMsgZColorGroup-8               	20000000	        77.3 ns/op	      80 B/op	       1 allocs/op
BenchmarkAppendMsgZColorGroup-8                	30000000	        39.3 ns/op	 356.08 MB/s	       0 B/op	       0 allocs/op
BenchmarkUnmarshalZColorGroup-8                	20000000	        80.6 ns/op	 173.66 MB/s	       0 B/op	       0 allocs/op
BenchmarkEncodeZColorGroup-8                   	20000000	        66.2 ns/op	 211.60 MB/s	      16 B/op	       1 allocs/op
BenchmarkDecodeZColorGroup-8                   	10000000	       129 ns/op	 108.12 MB/s	       0 B/op	       0 allocs/op

Size of marshalled results

    gosercomp_test.go:99: json:				 65 bytes
    gosercomp_test.go:102: xml:				 137 bytes
    gosercomp_test.go:105: msgp:				 47 bytes
    gosercomp_test.go:108: protobuf:				 36 bytes
    gosercomp_test.go:111: gogoprotobuf:			 36 bytes
    gosercomp_test.go:115: flatbuffers:			 108 bytes
    gosercomp_test.go:121: thrift:				 63 bytes
    gosercomp_test.go:135: avro:				 32 bytes
    gosercomp_test.go:144: gencode:				 34 bytes
    gosercomp_test.go:150: UgorjiCodec_Cbor:		 47 bytes
    gosercomp_test.go:156: UgorjiCodec_Msgp:		 47 bytes
    gosercomp_test.go:162: UgorjiCodec_Bin:			 53 bytes
    gosercomp_test.go:164: UgorjiCodec_Json:		 91 bytes
    gosercomp_test.go:167: easyjson:			 65 bytes
    gosercomp_test.go:170: ffjson:				 65 bytes
    gosercomp_test.go:173: jsoniter:			 65 bytes
    gosercomp_test.go:177: memdump:				 200 bytes
    gosercomp_test.go:180: colfer:				 35 bytes
    gosercomp_test.go:183: sky:				 52 bytes
    gosercomp_test.go:186: skyencoder:				 52 bytes
    gosercomp_test.go:189: zebrapack:			 48 bytes
    gosercomp_test.go:193: gotiny:				 32 bytes
    gosercomp_test.go:198: hprose:				 32 bytes
    gosercomp_test.go:202: sereal:				 76 bytes
    gosercomp_test.go:205: msgpackv2:			 47 bytes