otherlang.md 7.34 KB
Newer Older
Kenton Varda's avatar
Kenton Varda committed
1 2
---
layout: page
Kenton Varda's avatar
Kenton Varda committed
3
title: Other Languages
Kenton Varda's avatar
Kenton Varda committed
4 5 6 7
---

# Other Languages

8 9
Cap'n Proto's reference implementation is in C++.  Implementations in other languages are
maintained by respective authors and have not been reviewed by me
10 11 12
([@kentonv](https://github.com/kentonv)). Below are the implementations I'm aware
of. Some of these projects are more "ready" than others; please consult each
project's documentation for details.
13

14
##### Serialization + RPC
15

16
* [C++](cxx.html) by [@kentonv](https://github.com/kentonv)
17
* [Erlang](http://ecapnp.astekk.se/) by [@kaos](https://github.com/kaos)
Kenton Varda's avatar
Kenton Varda committed
18
* [Go](https://github.com/zombiezen/go-capnproto2) by [@zombiezen](https://github.com/zombiezen) (forked from [@glycerine](https://github.com/glycerine)'s serialization-only version, below)
19
* [Javascript (Node.js only)](https://github.com/kentonv/node-capnp) by [@kentonv](https://github.com/kentonv)
20
* [Python](http://jparyani.github.io/pycapnp/) by [@jparyani](https://github.com/jparyani)
21
* [Rust](https://github.com/dwrensha/capnproto-rust) by [@dwrensha](https://github.com/dwrensha)
22

23
##### Serialization only
24

25
* [C](https://github.com/opensourcerouting/c-capnproto) by [OpenSourceRouting](https://www.opensourcerouting.org/) / [@eqvinox](https://github.com/eqvinox) (originally by [@jmckaskill](https://github.com/jmckaskill))
26
* [C#](https://github.com/mgravell/capnproto-net) by [@mgravell](https://github.com/mgravell)
27
* [Go](https://github.com/glycerine/go-capnproto) by [@glycerine](https://github.com/glycerine) (originally by [@jmckaskill](https://github.com/jmckaskill))
28
* [Java](https://github.com/dwrensha/capnproto-java/) by [@dwrensha](https://github.com/dwrensha)
29 30
* [Javascript](https://github.com/popham/capnp-js-base) by [@popham](https://github.com/popham)
* [Javascript](https://github.com/jscheid/capnproto-js) (older, abandoned) by [@jscheid](https://github.com/jscheid)
31
* [Lua](https://github.com/cloudflare/lua-capnproto) by [CloudFlare](http://www.cloudflare.com/) / [@calio](https://github.com/calio)
32
* [Nim](https://github.com/zielmicha/capnp.nim) by [@zielmicha](https://github.com/zielmicha)
33
* [OCaml](https://github.com/pelzlpj/capnp-ocaml) by [@pelzlpj](https://github.com/pelzlpj)
Kenton Varda's avatar
Kenton Varda committed
34
* [Ruby](https://github.com/cstrahan/capnp-ruby) by [@cstrahan](https://github.com/cstrahan)
35
* [Scala](https://github.com/katis/capnp-scala) by [@katis](https://github.com/katis)
Kenton Varda's avatar
Kenton Varda committed
36

37
##### Tools
Kenton Varda's avatar
Kenton Varda committed
38

39 40 41 42
These are other misc projects related to Cap'n Proto that are not actually implementations in
new languages.

* [Common Test Framework](https://github.com/kaos/capnp_test) by [@kaos](https://github.com/kaos)
43 44
* [Sublime Syntax Highlighting](https://github.com/joshuawarner32/capnproto-sublime) by
  [@joshuawarner32](https://github.com/joshuawarner32)
45 46
* [Vim Syntax Highlighting](https://github.com/peter-edge/vim-capnp) by [@peter-edge](https://github.com/peter-edge)
  (originally by [@cstrahan](https://github.com/cstrahan))
47
* [Wireshark Dissector Plugin](https://github.com/kaos/wireshark-plugins) by [@kaos](https://github.com/kaos)
48 49 50 51

## Contribute Your Own!

We'd like to support many more languages in the future!
Kenton Varda's avatar
Kenton Varda committed
52 53 54

If you'd like to own the implementation of Cap'n Proto in some particular language,
[let us know](https://groups.google.com/group/capnproto)!
55 56 57 58

**You should e-mail the list _before_ you start hacking.**  We don't bite, and we'll probably have
useful tips that will save you time.  :)

59
**Do not implement your own schema parser.**  The schema language is more complicated than it
60 61 62 63
looks, and the algorithm to determine offsets of fields is subtle.  If you reuse the official
parser, you won't risk getting these wrong, and you won't have to spend time keeping your parser
up-to-date.  In fact, you can still write your code generator in any language you want, using
compiler plugins!
64 65 66

### How to Write Compiler Plugins

67 68 69 70 71
The Cap'n Proto tool, `capnp`, does not actually know how to generate code.  It only parses schemas,
then hands the parse tree off to another binary -- known as a "plugin" -- which generates the code.
Plugins are independent executables (written in any language) which read a description of the
schema from standard input and then generate the necessary code.  The description is itself a
Cap'n Proto message, defined by
72
[schema.capnp](https://github.com/sandstorm-io/capnproto/blob/master/c%2B%2B/src/capnp/schema.capnp).
Kenton Varda's avatar
Kenton Varda committed
73
Specifically, the plugin receives a `CodeGeneratorRequest`, using
74
[standard serialization](encoding.html#serialization-over-a-stream)
Kenton Varda's avatar
Kenton Varda committed
75 76
(not packed).  (Note that installing the C++ runtime causes schema.capnp to be placed in
`$PREFIX/include/capnp` -- `/usr/local/include/capnp` by default).
77 78 79 80 81

Of course, because the input to a plugin is itself in Cap'n Proto format, if you write your
plugin directly in the language you wish to support, you may have a bootstrapping problem:  you
somehow need to generate code for `schema.capnp` before you write your code generator.  Luckily,
because of the simplicity of the Cap'n Proto format, it is generally not too hard to do this by
82 83
hand.  Remember that you can use `capnp compile -ocapnp schema.capnp` to get a dump of the sizes
and offsets of all structs and fields defined in the file.
84

85 86 87 88
`capnp compile` normally looks for plugins in `$PATH` with the name `capnpc-[language]`, e.g.
`capnpc-c++` or `capnpc-capnp`.  However, if the language name given on the command line contains
a slash character, `capnp` assumes that it is an exact path to the plugin executable, and does not
search `$PATH`.  Examples:
89 90

    # Searches $PATH for executable "capnpc-mylang".
91
    capnp compile -o mylang addressbook.capnp
92 93

    # Uses plugin executable "myplugin" from the current directory.
94
    capnp compile -o ./myplugin addressbook.capnp
95 96 97 98

If the user specifies an output directory, the compiler will run the plugin with that directory
as the working directory, so you do not need to worry about this.

99
For examples of plugins, take a look at
100 101
[capnpc-capnp](https://github.com/sandstorm-io/capnproto/blob/master/c%2B%2B/src/capnp/compiler/capnpc-capnp.c%2B%2B)
or [capnpc-c++](https://github.com/sandstorm-io/capnproto/blob/master/c%2B%2B/src/capnp/compiler/capnpc-c%2B%2B.c%2B%2B).
Kenton Varda's avatar
Kenton Varda committed
102 103 104

### Supporting Dynamic Languages

105 106 107
Dynamic languages have no compile step.  This makes it difficult to work `capnp compile` into the
workflow for such languages.  Additionally, dynamic languages are often scripting languages that do
not support pointer arithmetic or any reasonably-performant alternative.
Kenton Varda's avatar
Kenton Varda committed
108 109 110

Fortunately, dynamic languages usually have facilities for calling native code.  The best way to
support Cap'n Proto in a dynamic language, then, is to wrap the C++ library, in particular the
111
[C++ dynamic API](cxx.html#dynamic-reflection).  This way you get reasonable performance while
Kenton Varda's avatar
Kenton Varda committed
112 113
still avoiding the need to generate any code specific to each schema.

Kenton Varda's avatar
Kenton Varda committed
114 115 116 117 118 119 120 121 122
To parse the schema files, use the `capnp::SchemaParser` class (defined in `capnp/schema-parser.h`).
This way, schemas are loaded at the same time as all the rest of the program's code -- at startup.
An advanced implementation might consider caching the compiled schemas in binary format, then
loading the cached version using `capnp::SchemaLoader`, similar to the way e.g. Python caches
compiled source files as `.pyc` bytecode, but that's up to you.

### Testing Your Implementation

The easiest way to test that you've implemented the spec correctly is to use the `capnp` tool
123 124
to [encode](capnp-tool.html#encoding-messages) test inputs and
[decode](capnp-tool.html#decoding-messages) outputs.