Programming with a Differentiable Forth Interpreter


"In this approach, the programmer specifies a program sketch ... in a traditional programming language. This sketch defines one part of the neural network behaviour. The other part is learned using training data. The core insight that enables this approach is the fact that most programming languages can be formulated in terms of an abstract machine that executes the commands of the language. We implement these machines as neural networks, constraining parts of the networks to follow the sketched behaviour. ... "
<https://arxiv.org/pdf/1605.06640v3.pdf>