Difference between revisions of "Competence centre LifeWatch/Citizen Science/Task 4.2"
Line 2: | Line 2: | ||
==Caffe installation== | ==Caffe installation== | ||
===Caffe installation in Altamira=== | |||
For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the [http://caffe.berkeleyvision.org/installation.html official installation guide] and a [http://www.andrewjanowczyk.com/installing-caffe-on-the-ohio-super-computing-osc-ruby-cluster/ specific guide] for installing Caffe on a Supercomputer cluster. | For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the [http://caffe.berkeleyvision.org/installation.html official installation guide] and a [http://www.andrewjanowczyk.com/installing-caffe-on-the-ohio-super-computing-osc-ruby-cluster/ specific guide] for installing Caffe on a Supercomputer cluster. | ||
Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [https://www.osc.edu/documentation/howto/locally-installing-software]. | Not having root access to Altamira, Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [https://www.osc.edu/documentation/howto/locally-installing-software]. | ||
The software and libraries already available at Altamira are: | The software and libraries already available at Altamira are: | ||
* PYTHON 2.7.10 | * PYTHON 2.7.10 | ||
Line 23: | Line 25: | ||
* LMDB | * LMDB | ||
* ATLAS | * ATLAS | ||
Modules can be loaded all at once by loading /gpfs/res_scratch/lifewatch/iheredia/.usr/local/share/modulefiles/common. | Modules can be loaded all at once by loading /gpfs/res_scratch/lifewatch/iheredia/.usr/local/share/modulefiles/common. | ||
Line 29: | Line 30: | ||
;Comments: | ;Comments: | ||
At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher. | At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher. | ||
===Caffe installation in Yong=== | |||
Having root access, installing caffe is straightforward in [http://caffe.berkeleyvision.org/install_apt.html Ubuntu]. Yong runs with Nvidia's Quadro 4000 GPU which neither enable CuDNN support. This GPU has a very limited memory which enables training in small simple dataset which require small networks (eg. MNIST) but is not capable to store (and therefore train) more complex networks needed to learn more onvolved dataset (eg. ImageNet). |
Revision as of 13:27, 1 April 2016
Pattern recognition will be implemented through machine learning with deep neural networks (aka deep learning). Caffe is a deep learning framework created at UC Berkeley.
Caffe installation
Caffe installation in Altamira
For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the official installation guide and a specific guide for installing Caffe on a Supercomputer cluster.
Not having root access to Altamira, Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [1]. The software and libraries already available at Altamira are:
- PYTHON 2.7.10
- CUDA 7.0.28
- OPENMPI 1.8.3
- BOOST 1.54.0
- PROTOBUF 2.5.0
- GCC 4.6.3
- HDF5 1.8.10
The remaining libraries have been installed at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/lib. Those libraries are:
- gflags
- glog
- leveldb
- OpenCV
- snappy
- LMDB
- ATLAS
Modules can be loaded all at once by loading /gpfs/res_scratch/lifewatch/iheredia/.usr/local/share/modulefiles/common.
- Comments
At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher.
Caffe installation in Yong
Having root access, installing caffe is straightforward in Ubuntu. Yong runs with Nvidia's Quadro 4000 GPU which neither enable CuDNN support. This GPU has a very limited memory which enables training in small simple dataset which require small networks (eg. MNIST) but is not capable to store (and therefore train) more complex networks needed to learn more onvolved dataset (eg. ImageNet).