index.rst 2.11 KB
Newer Older
Scott Cyphers's avatar
Scott Cyphers committed
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46
.. ops/index.rst

Core Ops
========

An ``Op``'s primary role is to function as a node in a directed acyclic graph 
dependency computation graph.  

*Core ops* are ops that are available and generally useful to all framework 
bridges and that can be compiled by all transformers. A framework bridge may 
define framework-specific ops to simplify graph construction, provided that the 
bridge can enable every transformer to replace all such ops with equivalent 
subgraphs composed of core ops. Similary, transformers may define 
transformer-specific ops to represent kernels or other intermediate operations. 

If a framework supports extending the set of ops it offers, a bridge may even 
expose transformer-specific ops to the framework user.

Our design philosophy is that the graph is not a script for running kernels; 
rather, our compilation will match ``ops`` to appropriate kernels for the 
backend(s) in use. Thus, we expect that adding of new Core ops should be 
infrequent and that most functionality instead gets added with new functions 
that build sub-graphs from existing core ops.   

It is easiest to define a new op by adapting an existing op. Some of the tasks 
that must be performed are:

- Op constructor:

  * Checking type-consistency of arguments 
  * Specifying the result type for a call 

- Serializer/Deserializer

- Transformer handlers:

  * Interpreter (reference) implementation of behavior. The
    implementation should favor clarity over efficiency.



Alphabetical list of Core ``ops``
----------------------------------

Not currently a comprehensive list.  

L.S. Cook's avatar
L.S. Cook committed
47
.. tabularcolumns:: column spec
Scott Cyphers's avatar
Scott Cyphers committed
48 49 50 51 52 53 54

.. toctree::
   :maxdepth: 1

   abs.rst
   acos.rst
   add.rst
55
   allreduce.rst
Scott Cyphers's avatar
Scott Cyphers committed
56 57 58 59
   asin.rst
   atan.rst
   avg_pool.rst
   avg_pool_backprop.rst
60 61
   broadcast.rst
   ceiling.rst
62
   concat.rst
63 64
   constant.rst
   convert.rst
Scott Cyphers's avatar
Scott Cyphers committed
65
   convolution.rst
66 67
   cos.rst
   cosh.rst
68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84
   divide.rst
   dot.rst
   equal.rst
   exp.rst
   floor.rst
   function_call.rst
   greater_eq.rst
   greater.rst
   less_eq.rst
   less.rst
   log.rst
   maximum.rst
   minimum.rst
   multiply.rst
   negative.rst
   not_equal.rst
   not.rst
85 86 87
   softmax.rst