Razvan Pascanu

Affiliate Member

r.pascanu@gmail.com

Senior Research Scientist, Google DeepMind

Research Topics

Continual Learning

Deep Learning

Deep Neural Networks

Few-Shot Learning

Generalization

Geometric Deep Learning

Graph Neural Networks

Lifelong Learning

Machine Learning Theory

Mechanistic Interpretability

Neural Networks

Optimization

Recurrent Neural Networks

Reinforcement Learning

Representation Learning

Website

Google Scholar

Publications

Theano: A CPU and GPU Math Compiler in Python

James Bergstra

Olivier Breuleux

Frédéric Bastien

Pascal Lamblin

Razvan Pascanu

Guillaume Desjardins

Joseph P. Turian

David Warde-Farley

Yoshua Bengio

Theano is a compiler for mathematical expressions in Python that combines the convenience of NumPy's syntax with the speed of optimized nati… (see more)ve machine language. The user composes mathematical expressions in a high-level description that mimics NumPy's syntax and semantics, while being statically typed and functional (as opposed to imperative). These expressions allow Theano to provide symbolic differentiation. Before performing computation, Theano optimizes the choice of expressions, translates them into C++ (or CUDA for GPU), compiles them into dynamically loaded Python modules, all automatically. Common machine learn- ing algorithms implemented with Theano are from 1:6 to 7:5 faster than competitive alternatives (including those implemented with C/C++, NumPy/SciPy and MATLAB) when compiled for the CPU and between 6:5 and 44 faster when compiled for the GPU. This paper illustrates how to use Theano, outlines the scope of the compiler, provides benchmarks on both CPU and GPU processors, and explains its overall design.

2010-01-01

SciPy (published)

doi.org

Theano: A CPU and GPU Math Compiler in Python

James Bergstra

Olivier Breuleux

Frédéric Bastien

Pascal Lamblin

Razvan Pascanu

Guillaume Desjardins

Joseph Turian

David Warde-Farley