基于openeuler aarch_64 下,从源码的角度搭建Tensorflow
安装过的人们都知道如果
pip install tensorflow
的话会报错Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
考虑到操作系统的的兼容性,现有的编译好的二进制安装包不适用openeuler,所以考虑这些因素,我们要自己搭建。
我们需要bazel交叉编译软件,有点类似cmake(上游下载的开源.sh文件已上传到仓库)bazel下载地址
chmod +x bazel-0.28.0-installer-linux-x86_64.sh
./bazel-0.28.0-installer-linux-x86_64.sh --user
bazel version
查看版本,configure.py查看tf所支持的版本(2.3版本所支持的bazel)
_TF_MIN_BAZEL_VERSION = '0.27.1'
_TF_MAX_BAZEL_VERSION = '0.29.1'
下载TF
git clone https://github.com/tensorflow/tensorflow
git barach -a
查看所有发行版本git checkout <version>
将分支同步到本地
开始编译
bazel build --config=opt --config=cuda //tensorflow:libtensorflow_cc.so
(C文件库)bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package
(wheel文件)bazel build --config=opt --config=cuda //tensorflow:libtensorflow.so
(生成C库)bazel build --config=opt //tensorflow/lite:libtensorflowlite.so
(Lite库)
bazel编译有的时候会出issue现bug,详见issue
openeuler搭建Bulid Not Successfully 的Bug情况汇总
源码编译链接
官网上说安装需要pip19以上
关于openeulerpip源默认指向python2该如何修改:
#!/usr/bin/python2=====>!/usr/bin/python3
# -*- coding: utf-8 -*-
import re
import sys
from pip._internal.cli.main import main
if __name__ == '__main__':
sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0])
sys.exit(main())
2、修改默认指向由于版本不同所发生的bug
from pip import main
ImportError: cannot import name 'main' from 'pip' (/usr/lib/python3.7/site-packages/pip/__init__.py)
source code change to this
from pip import __main__ //这行也要修改
if __name__ == '__main__':
sys.exit(__main__._main())//增加__main__._
PRODUCT
[root@openeuler lzb]# pip -V
pip 20.1.1 from /usr/local/lib/python3.7/site-packages/pip (python 3.7)
安装 TensorFlow pip 软件包依赖项(如果使用虚拟环境,请省略 --user 参数):
pip install -U --user pip six numpy wheel setuptools mock 'future>=0.17.1'
pip install -U --user keras_applications --no-deps
pip install -U --user keras_preprocessing --no-deps
setup.py ???? we can know the vesion and dependence on REQUIRED_PACKAGES
> REQUIRED_PACKAGES = [
> 'absl-py >= 0.7.0',
> 'astunparse == 1.6.3',
> 'flatbuffers >= 1.12',
> 'gast == 0.3.3',
> 'google_pasta >= 0.1.8',
> 'h5py >= 2.10.0, < 2.11.0',
> 'keras_preprocessing >= 1.1.1, < 1.2',
> # TODO(mihaimaruseac): numpy 1.19.0 has ABI breakage
> # https://github.com/numpy/numpy/pull/15355
> 'numpy >= 1.16.0, < 1.19.0',
> 'opt_einsum >= 2.3.2',
> 'protobuf >= 3.9.2',
> 'tensorboard >= 2.3.0, < 3',
> 'tensorflow_estimator >= 2.3.0, < 2.4.0',
> 'termcolor >= 1.1.0',
> 'wrapt >= 1.11.1',
> 'w**h*eel >= 0.26',
> 'six >= 1.12.0',
> ]