An information compressor in a pale blue dot.

Regularizing CNNs with Locally Constrained Decorrelations (ICLR2017)

TL;DR We propose to locally decorrelate the feature weights of CNNs. When the proposed method, which we call OrthoReg, is used to regularize the 40 layers of Wide Residual Networks, we obtain state of the art results on CIFAR, and SVHN. Here is an example of the effects of our local regularizer:

Dataset Size
Step Size
Max Iter
Delta Stop
Average nearest neighbor distance

I encourage the reader to continue reading for better understanding of this example.

Read More

An early overview of ICLR2017

Machine learning is accelerating, we have an idea and it is on arxiv the next day, NIPS2016 was bigger than ever and it is difficult to keep track of all the new interesting work.

Given that this is the first time I submit to ICLR, and taking advantage from all...

Read More

How to kill bash script children when crtl+c

Using a script to run multiple tasks in background can be very handy but it can also be anoying when we press crtl+c to interrupt and the background processes keep working. There are many approaches to solve this but I have found the cleanest one is to simply trap the...

Read More

Can not set ViewportOut in nvidia-settings

After plugging the second monitor, I could not find the correct resolution in nvidia-settings and it was impossible to do it manually. After having to solve this problem for the second time, I post it here so to remember.

  1. Look at nvidia-settings for the name of the monitors (In...

    Read More


I decided to share this script I was using in order to accelerate the training of neural nets making them to gather data in parallel. So I wrote some tests to check it performs well its basic functions and commented the code a little bit.


It depends on...

Read More

Mac Book Pro randomly goes to sleep fix

Magnets can make your Mac to sleep. This was driving me mad since I always put it on a sleeve that closes with a magnet.

Here is the solution page: Apple support

Read More

matconv2caffe v0.1 released

Convert Matconvnet models to Caffe with matconv2caffe.

There is already a script to import caffe models to matconvnet thanks to @vedaldi. However, we needed the oposite so I made a script that converts the .caffemodel and extracts a deplotment .prototxt model definition and the average image. Currently it...

Read More

How I installed Caffe in OS X Yosemite


Last time I had to compile it was much easier by using Cmake. It was as easy as creating a build folder and executing (after installing the dependencies):


Then compiling with:

make -j


Read More