Alert.png The wiki is deprecated and due to be decommissioned by the end of September 2022.
The content is being migrated to other supports, new updates will be ignored and lost.
If needed you can get in touch with EGI SDIS team using operations @ egi.eu.

Difference between revisions of "Competence centre LifeWatch/Citizen Science/Task 4.2"

From EGIWiki
Jump to navigation Jump to search
(Created page with "[http://caffe.berkeleyvision.org/ Caffe] is a deep learning framework created at UC Berkeley. For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have fo...")
 
Line 1: Line 1:
[http://caffe.berkeleyvision.org/ Caffe] is a deep learning framework created at UC Berkeley.
Pattern recognition will be implemented through machine learning with deep neural networks (aka deep learning). [http://caffe.berkeleyvision.org/ Caffe] is a deep learning framework created at UC Berkeley.


==Caffe installation==


For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the [http://caffe.berkeleyvision.org/installation.html official installation guide] and a [http://www.andrewjanowczyk.com/installing-caffe-on-the-ohio-super-computing-osc-ruby-cluster/ specific guide] for installing Caffe on a Supercomputer cluster.  
For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the [http://caffe.berkeleyvision.org/installation.html official installation guide] and a [http://www.andrewjanowczyk.com/installing-caffe-on-the-ohio-super-computing-osc-ruby-cluster/ specific guide] for installing Caffe on a Supercomputer cluster.  


Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [https://www.osc.edu/documentation/howto/locally-installing-software].
Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [https://www.osc.edu/documentation/howto/locally-installing-software].
The software/libraries already available at Altamira were PYTHON 2.7.10, CUDA 7.0.28, OPENMPI 1.8.3, BOOST 1.54.0, PROTOBUF 2.5.0, GCC 4.6.3 and HDF5 1.8.10. The remainingn libraries had been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/lib.
The software/libraries already available at Altamira were:
* PYTHON 2.7.10
* CUDA 7.0.28
* OPENMPI 1.8.3
* BOOST 1.54.0
* PROTOBUF 2.5.0
* GCC 4.6.3
* HDF5 1.8.10
 
The remaining libraries had been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/lib. Those are:
* gflags
* glog
* leveldb
* OpenCV
* Snappy
* LMDB
* ATLAS
* CuDNN
 
Modules can be loaded all at once by loading the share/modulefiles/common.  
Modules can be loaded all at once by loading the share/modulefiles/common.  


 
;Comments:
----
Comments:


At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher.  
At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher.  
Hopefully they will soon be replaced with Tesla Kepler GPUs.
Hopefully they will soon be replaced with Tesla Kepler GPUs.

Revision as of 16:40, 19 January 2016

Pattern recognition will be implemented through machine learning with deep neural networks (aka deep learning). Caffe is a deep learning framework created at UC Berkeley.

Caffe installation

For the installation of Caffe in Altamira Supercomputer at IFCA (Spain) we have followed both the official installation guide and a specific guide for installing Caffe on a Supercomputer cluster.

Caffe has been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/src/caffe. For more information on the local installation of software in a supercomputer please check [1]. The software/libraries already available at Altamira were:

  • PYTHON 2.7.10
  • CUDA 7.0.28
  • OPENMPI 1.8.3
  • BOOST 1.54.0
  • PROTOBUF 2.5.0
  • GCC 4.6.3
  • HDF5 1.8.10

The remaining libraries had been installed locally at /gpfs/res_scratch/lifewatch/iheredia/.usr/local/lib. Those are:

  • gflags
  • glog
  • leveldb
  • OpenCV
  • Snappy
  • LMDB
  • ATLAS
  • CuDNN

Modules can be loaded all at once by loading the share/modulefiles/common.

Comments

At this moment Altamira runs with Tesla M2090 GPUs with CUDA capability 2.0. Therefore Caffe has been compiled without CuDNN (the GPU-accelerated library of primitives for deep neural networks) which requires GPUs with CUDA capability of 3.0 or higher. Hopefully they will soon be replaced with Tesla Kepler GPUs.