深度学习框架-caffe安装-Mac OSX 10.12

深度学习框架-caffe安装

[Mac OSX 10.12]

参考资源

1.英文原文:(使用GPU)

[http://hoondy.com/2015/04/03/how-to-install-caffe-on-mac-os-x-10-10-for-dummies-like-me/]

2.基于1的两篇中文博客:

[http://ylzhao.blogspot.kr/2015/04/mac-os-x-1010caffe.html]

[http://www.jianshu.com/p/8795b882ea67]

3.无GPU,仅使用CPU的情况下的配置

[http://blog.csdn.net/u014696921/article/details/52156552]

[http://www.phperz.com/article/16/1006/298567.html]

—————————————————————————————

我的电脑配置

系统:MacBook Pro OS X Sierra 版本10.12.2

CPU:2.7 GHz Intel Core i5

显卡:Intel Iris Graphics 6100 1536 MB

*如果显卡是NVIDIA的,可以使用GPU,需要安装cuda,cuda driver和cuDNN GPU库,并且在Makefile配置成使用GPU。参考资源中【1】【2】是有NVIDIA显卡的所以安装了cuda,cuda driver和cuDNN GPU库,最后的caffe的Makefile.config文件中配置成使用GPU。

*由于我电脑配置的不是NVIDIA显卡,所以不能使用cuda加速了,所以只能安装个CPU模式。可以忽略安装cuda,cuda driver和cuDNN的安装步骤,最后的caffe的Makefile.config文件中配置成仅使用CPU。

详细安装步骤

  • Homebrew
  1. 根据 http://brew.sh/ 上面的说明安装Homebrew包管理

  • Anaconda Python
  1. 从https://store.continuum.io/cshop/anaconda/下载和安装Anaconda Python包(其中包括Caffe框架用到的hdf5)
  2. export PATH=~/anaconda/bin:$PATH

  • BLAS - Intel MKL
  1. 由于Mac OS X操作系统自带的BLAS库存在一些不稳定的问题,因此我选择安装Intel MKL库。如果你是在校大学生,可以使用学校邮箱从https://software.intel.com/en-us/qualify-for-free-software/student页面申请Intel Parallel Studio XE 2017安装包(后面不要忘记在Makefile.config中设置BLAS:=MKL)
  2. 确保在安装Intel Parallel XE时选择每一个组件(因为缺省情况下不会安装MKL组件)
  3. cd /opt/intel/mkl/lib/
  4. sudo ln -s . /opt/intel/mkl/lib/intel64(因为在编译Caffe时Caffe会从MKL的intel64目录中去搜索mkl的库,但是在安装MKL后,MKL的lib目录下并没有intel64这个目录,所以需要建立一个intel64目录到lib目录的软链接)

  • 通过Homebrew安装依赖项

brew edit opencv 在自动打开的vim编辑器中将下面两行

args << "-DPYTHON#{py_ver}_LIBRARY=#{py_lib}/libpython2.7.#{dylib}"

args << "-DPYTHON#{py_ver}_INCLUDE_DIR=#{py_prefix}/include/python2.7"

替换为

args << "-DPYTHON_LIBRARY=#{py_prefix}/lib/libpython2.7.dylib"

args << "-DPYTHON_INCLUDE_DIR=#{py_prefix}/include/python2.7"

***vim中具体操作是:

i 从当前光标处进入插入模式,开始修改内容,esc 退出插入模式,:wq 保存修改并退出。

brew install --fresh -vd snappy leveldb gflags glog szip lmdb homebrew/science/opencv

brew install --build-from-source --with-python --fresh -vd protobuf

brew install --build-from-source --fresh -vd boost boost-python

  • Github上面克隆Caffe的代码

git clone https://github.com/BVLC/caffe.git

cd caffe

cp Makefile.config.example Makefile.config

  • 配置Makefile.config
  1. 设置BLAS := mkl(BLAS (使用intel mkl还是OpenBLAS))
  2. 取消USE_CUDNN := 1注释
  3. 检查并设置Python路径

*** 首先修改文件权限:chmod g+w Makefile.config

***打开文件进行修改:sudo vim Makefile.config ;按“i”键开始修改,修改 :将# CPU_ONLY = 1前面的#去掉( 由于我没有NVIDIA的显卡,就没有安装CUDA,因此需要打开这个选项) 并按“tab”键,(默认从tab处执行),设置BLAS := mkl,检查并设置python路径,修改结束后按esc键,键入“:wq”保存并退出;

***以下是我的Makefile.config中的所有配置:(可以先在命令行中验证一下自己的文件路径,一定要根据自己路径进行设置!)

## Refer to http://caffe.berkeleyvision.org/installation.html

# Contributions simplifying and improving our build system are welcome!

# cuDNN acceleration switch (uncomment to build with cuDNN).

# USE_CUDNN := 1

# CPU-only switch (uncomment to build without GPU support).

CPU_ONLY := 1

# uncomment to disable IO dependencies and corresponding data layers

# USE_OPENCV := 0

# USE_LEVELDB := 0

# USE_LMDB := 0

# uncomment to allow MDB_NOLOCK when reading LMDB files (only if necessary)

# You should not set this flag if you will be reading LMDBs with any

# possibility of simultaneous read and write

# ALLOW_LMDB_NOLOCK := 1

# Uncomment if you\'re using OpenCV 3

# OPENCV_VERSION := 3

# To customize your choice of compiler, uncomment and set the following.

# N.B. the default for Linux is g++ and the default for OSX is clang++

# CUSTOM_CXX := g++

# CUDA directory contains bin/ and lib/ directories that we need.

CUDA_DIR := /usr/local/cuda

# On Ubuntu 14.04, if cuda tools are installed via

# "sudo apt-get install nvidia-cuda-toolkit" then use this instead:

# CUDA_DIR := /usr

# CUDA architecture setting: going with all of them.

# For CUDA < 6.0, comment the *_50 lines for compatibility.

CUDA_ARCH := -gencode arch=compute_20,code=sm_20 \

-gencode arch=compute_20,code=sm_21 \

-gencode arch=compute_30,code=sm_30 \

-gencode arch=compute_35,code=sm_35 \

-gencode arch=compute_50,code=sm_50 \

-gencode arch=compute_50,code=compute_50

# BLAS choice:

# atlas for ATLAS (default)

# mkl for MKL

# open for OpenBlas

BLAS := mkl

# Custom (MKL/ATLAS/OpenBLAS) include and lib directories.

# Leave commented to accept the defaults for your choice of BLAS

# (which should work)!

# BLAS_INCLUDE := /path/to/your/blas

# BLAS_LIB := /path/to/your/blas

# Homebrew puts openblas in a directory that is not on the standard search path

# BLAS_INCLUDE := $(shell brew --prefix openblas)/include

# BLAS_LIB := $(shell brew --prefix openblas)/lib

# This is required only if you will compile the matlab interface.

# MATLAB directory should contain the mex binary in /bin.

# MATLAB_DIR := /usr/local

# MATLAB_DIR := /Applications/MATLAB_R2012b.app

# NOTE: this is required only if you will compile the python interface.

# We need to be able to find Python.h and numpy/arrayobject.h.

PYTHON_INCLUDE := /usr/include/python2.7 \

/usr/lib/python2.7/dist-packages/numpy/core/include

# Anaconda Python distribution is quite popular. Include path:

# Verify anaconda location, sometimes it\'s in root.

ANACONDA_HOME := $(HOME)/anaconda

PYTHON_INCLUDE := $(ANACONDA_HOME)/include/python2.7 \

$(ANACONDA_HOME)/lib/python2.7/site-packages/numpy/core/include \

$(ANACONDA_HOME)/include \

# Uncomment to use Python 3 (default is Python 2)

# PYTHON_LIBRARIES := boost_python3 python3.5m

# PYTHON_INCLUDE := /usr/include/python3.5m \

# /usr/lib/python3.5/dist-packages/numpy/core/include

# We need to be able to find libpythonX.X.so or .dylib.

# PYTHON_LIB := /usr/lib

PYTHON_LIB := $(ANACONDA_HOME)/lib

# Homebrew installs numpy in a non standard path (keg only)

# PYTHON_INCLUDE += $(dir $(shell python -c \'import numpy.core; print(numpy.core.__file__)\'))/include

# PYTHON_LIB += $(shell brew --prefix numpy)/lib

# Uncomment to support layers written in Python (will link against Python libs)

# WITH_PYTHON_LAYER := 1

# Whatever else you find you need goes here.

INCLUDE_DIRS := $(PYTHON_INCLUDE) /usr/local/include

LIBRARY_DIRS := $(PYTHON_LIB) /usr/local/lib /usr/lib

# If Homebrew is installed at a non standard location (for example your home directory) and you use it for general dependencies

# INCLUDE_DIRS += $(shell brew --prefix)/include

# LIBRARY_DIRS += $(shell brew --prefix)/lib

# Uncomment to use `pkg-config` to specify OpenCV library paths.

# (Usually not necessary -- OpenCV libraries are normally installed in one of the above $LIBRARY_DIRS.)

# USE_PKG_CONFIG := 1

# N.B. both build and distribute dirs are cleared on `make clean`

BUILD_DIR := build

DISTRIBUTE_DIR := distribute

# Uncomment for debugging. Does not work on OSX due to https://github.com/BVLC/caffe/issues/171

# DEBUG := 1

# The ID of the GPU that \'make runtest\' will use to run unit tests.

TEST_GPUID := 0

# enable pretty build (comment to see full commands)

Q ?= @

  • 设置环境变量
  1. export DYLD_FALLBACK_LIBRARY_PATH=/usr/local/cuda/lib:$HOME/anaconda/lib:/usr/local/lib:/usr/lib:/opt/intel/composer_xe_2015.2.132/compiler/lib:/opt/intel/composer_xe_2015.2.132/mkl/lib

***必须手动查看自己的文件路径!根据自己的路径添加环境变量,我的路径如下:

export DYLD_FALLBACK_LIBRARY_PATH=$HOME/caffe/.build_release/lib:/usr/local/cuda/lib:$HOME/anaconda/lib:/usr/local/lib:/usr/lib:/opt/intel/compilers_and_libraries_2017.1.126/mac/compiler/lib:/opt/intel/compilers_and_libraries_2017.1.126/mac/mkl/lib/

  • 编译Caffe
  1. make clean
  2. make all
  3. make test
  4. make runtest
  5. make pycaffe
  6. make distribute

***make all的时候注意库的链接路径,make runtest注意,会有这样的一个问题DYLD_FALLBACK_LIBRARY_PATH is cleared by the new System Integrity Protection ,所以要把System Integrity Protection禁止掉:具体操作:电脑重新开机同时按住command+r,进入恢复模式,然后打开终端,输入csrutil disable,就关闭SIP了,重新启动电脑即可。