prlz77

An information compressor in a pale blue dot.

GSOC2017: RNNs on tiny-dnn

Recurrent Neural Networks (RNNs) are now central to many applications, from speech recognition to Computer Vision. Some examples are Image captioning, Visual Question Answering (VQA), autonomous driving, and even Lip reading.

During this Google Summer of Code, I have extended the tiny-dnn framework with an RNN API, thus making it able to train on sequential data, where data points depend on each other in the...

Read More


Regularizing CNNs with Locally Constrained Decorrelations (ICLR2017)

TL;DR We propose to locally decorrelate the feature weights of CNNs. When the proposed method, which we call OrthoReg, is used to regularize the 40 layers of Wide Residual Networks, we obtain state of the art results on CIFAR, and SVHN. Here is an example of the effects of...

Read More


An early overview of ICLR2017

Machine learning is accelerating, we have an idea and it is on arxiv the next day, NIPS2016 was bigger than ever and it is difficult to keep track of all the new interesting work.

Given that this is the first time I submit to ICLR, and taking advantage from all...

Read More


How to kill bash script children when crtl+c

Using a script to run multiple tasks in background can be very handy but it can also be anoying when we press crtl+c to interrupt and the background processes keep working. There are many approaches to solve this but I have found the cleanest one is to simply trap the...

Read More


Can not set ViewportOut in nvidia-settings

After plugging the second monitor, I could not find the correct resolution in nvidia-settings and it was impossible to do it manually. After having to solve this problem for the second time, I post it here so to remember.

  1. Look at nvidia-settings for the name of the monitors (In...

    Read More


torch.async-hdf5-reader

I decided to share this script I was using in order to accelerate the training of neural nets making them to gather data in parallel. So I wrote some tests to check it performs well its basic functions and commented the code a little bit.

Dependencies

It depends on...

Read More


Mac Book Pro randomly goes to sleep fix

Magnets can make your Mac to sleep. This was driving me mad since I always put it on a sleeve that closes with a magnet.

Here is the solution page: Apple support

Read More


matconv2caffe v0.1 released

Convert Matconvnet models to Caffe with matconv2caffe.

There is already a script to import caffe models to matconvnet thanks to @vedaldi. However, we needed the oposite so I made a script that converts the .caffemodel and extracts a deplotment .prototxt model definition and the average image. Currently it...

Read More


How I installed Caffe in OS X Yosemite

Update


Last time I had to compile it was much easier by using Cmake. It was as easy as creating a build folder and executing (after installing the dependencies):

cmake -D CMAKE_BUILD_TYPE=RELEASE -D WITH_CUDA=OFF -D CMAKE_INSTALL_PREFIX=$PWD ..

Then compiling with:

make -j

Of...

Read More