乐趣区

关于人工智能:昇腾-CANN-开发环境

昇腾 CANN 是华为开发的 AI 场景的异构计算架构,反对用户疾速构建基于昇腾平台的 AI 利用和业务。

本文为 Ubuntu 上手动部署开发环境(与运行环境拆散),装置 MindStudio 的过程。

注:也可通过 msInstaller 工具主动装置。只是本文实际时,装置服务遇到了中断问题。故给出了手动装置的形式。

根底阐明

要求:

  • Ubuntu x86 18.04

非昇腾设施: 仅能用于代码开发、编译等不依赖于昇腾芯片的纯开发流动。

开发和运行环境拆散部署:

获取软件包

  • 软件包(推理)

    • Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
    • Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
    • MindStudio_3.0.1_linux.tar.gz

下载页,中英文给到的版本可能不同。

配置用户(可选)

当用户应用非 root 用户装置时,须要操作该章节,否则请疏忽。

创立用户(non-root):

sudo -i

# 创立用户
groupadd HwHiAiUser
useradd -g HwHiAiUser -d /home/HwHiAiUser -m HwHiAiUser -s /bin/bash
passwd HwHiAiUser

# 增加权限
chmod u+w /etc/sudoers
vi /etc/sudoers
  # User privilege specification
  HwHiAiUser ALL=(ALL:ALL) ALL
chmod u-w /etc/sudoers

# 切换用户
su HwHiAiUser

装置依赖

sudo apt update
sudo apt-get install -y gcc g++ make cmake zlib1g zlib1g-dev libsqlite3-dev openssl libssl-dev libffi-dev unzip pciutils net-tools libblas-dev gfortran libblas3 libopenblas-dev

wget https://www.python.org/ftp/python/3.7.5/Python-3.7.5.tgz
tar -zxvf Python-3.7.5.tgz
cd Python-3.7.5
./configure --prefix=$HOME/python3.7.5 --enable-loadable-sqlite-extensions --enable-shared
make -j`nproc`
make install

sudo cp $HOME/python3.7.5/lib/libpython3.7m.so.1.0 /usr/lib

sudo ln -s $HOME/python3.7.5/bin/python3 /usr/bin/python3.7
sudo ln -s $HOME/python3.7.5/bin/pip3    /usr/bin/pip3.7
sudo ln -s $HOME/python3.7.5/bin/python3 /usr/bin/python3.7.5
sudo ln -s $HOME/python3.7.5/bin/pip3    /usr/bin/pip3.7.5

sudo ln -s $HOME/python3.7.5/bin/pip3      /usr/bin/pip3
sudo ln -s $HOME/python3.7.5/lib/python3.7 /usr/lib/python3.7

pip3.7.5 config set global.index-url https://mirrors.aliyun.com/pypi/simple/
pip3.7.5 install attrs psutil decorator numpy protobuf==3.11.3 scipy sympy cffi

装置开发包

$ chmod +x Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
$ ./Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run --install
Verifying archive integrity...  100%   SHA256 checksums are OK. All good.
Uncompressing ASCEND_RUN_PACKAGE  100%
[Toolkit] [20210610-20:42:05] [INFO] LogFile:/home/HwHiAiUser/var/log/ascend_seclog/ascend_toolkit_install.log
[Toolkit] [20210610-20:42:05] [INFO] install start
[Toolkit] [20210610-20:42:05] [INFO] The install path is /home/HwHiAiUser/Ascend !
[Toolkit] [20210610-20:42:05] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:42:05] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:42:05] [INFO] install package Ascend-acllib-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:42:08] [INFO] Ascend-acllib-1.78.t20.0.b200-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:42:08] [INFO] install package Ascend-pyACL-3.3.0.alpha003-linux.x86_64.run start
[Toolkit] [20210610-20:42:08] [INFO] Ascend-pyACL-3.3.0.alpha003-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:42:08] [INFO] install package Ascend-atc-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:42:41] [INFO] Ascend-atc-1.78.t20.0.b200-linux.x86_64.run --devel --pylocal --quiet --nox11   install success
[Toolkit] [20210610-20:42:41] [INFO] install package Ascend-opp-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:43:11] [INFO] Ascend-opp-1.78.t20.0.b200-linux.x86_64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:43:11] [INFO] install package Ascend-toolkit-1.78.t20.0.b200-linux.x86_64.run start
[Toolkit] [20210610-20:44:11] [INFO] Ascend-toolkit-1.78.t20.0.b200-linux.x86_64.run --devel --pylocal --quiet --nox11   install success
[Toolkit] [20210610-20:44:11] [INFO] install package Ascend310-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:12] [INFO] Ascend310-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:12] [INFO] install package Ascend910-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:13] [INFO] Ascend910-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:13] [INFO] install package Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:44:14] [INFO] Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:44:14] [INFO] /home/HwHiAiUser/Ascend/ascend_cann_install.info generate success
[Toolkit] [20210610-20:44:14] [INFO] Please make sure that:
Offline infer develop (cannot coexist with other scenes):
    LD_LIBRARY_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/acllib/lib64:
    PYTHONPATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/pyACL/python/site-packages/acl:
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
    ASCEND_AICPU_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest:
    ASCEND_OPP_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
    TOOLCHAIN_HOME includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
Third party AI framework develop (cannot coexist with other scenes):
    PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/ccec_compiler/bin:
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/bin:
    LD_LIBRARY_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/lib64:
    PYTHONPATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/fwkacllib/python/site-packages:
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
    ASCEND_OPP_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
    ASCEND_AICPU_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest:
    TOOLCHAIN_HOME includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
Model transformation and operator develop (cannot coexist with other scenes):
    PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/ccec_compiler/bin:
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/bin:
    LD_LIBRARY_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/lib64:
    PYTHONPATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/atc/python/site-packages:
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit/python/site-packages:
    ASCEND_OPP_PATH includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/opp:
    TOOLCHAIN_HOME includes :
        /home/HwHiAiUser/Ascend/ascend-toolkit/latest/toolkit:
[Toolkit] [20210610-20:44:15] [INFO] Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run install success,The install path is /home/HwHiAiUser/Ascend !
$ chmod +x Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
$ ./Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run --install
Verifying archive integrity...  100%   SHA256 checksums are OK. All good.
Uncompressing ASCEND_RUN_PACKAGE  100%
[Toolkit] [20210610-20:46:27] [INFO] LogFile:/home/HwHiAiUser/var/log/ascend_seclog/ascend_toolkit_install.log
[Toolkit] [20210610-20:46:27] [INFO] install start
[Toolkit] [20210610-20:46:27] [INFO] The install path is /home/HwHiAiUser/Ascend !
[Toolkit] [20210610-20:46:27] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:46:27] [WARNING] driver package maybe not installed
[Toolkit] [20210610-20:46:27] [INFO] The current OS is x86_64
[Toolkit] [20210610-20:46:27] [INFO] install package Ascend-acllib-1.78.t20.0.b200-linux.aarch64.run start
[Toolkit] [20210610-20:46:29] [INFO] Ascend-acllib-1.78.t20.0.b200-linux.aarch64.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:29] [INFO] install package Ascend310-aicpu_kernels-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:46:31] [INFO] Ascend310-aicpu_kernels-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:31] [INFO] install package Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run start
[Toolkit] [20210610-20:46:32] [INFO] Ascend310-aicpu_kernels_minirc-1.78.t20.0.b200.run --devel --quiet --nox11   install success
[Toolkit] [20210610-20:46:32] [INFO] Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run install success,The install path is /home/HwHiAiUser/Ascend !

创立 Docker 镜像(可选)

docker pull ubuntu:18.04

cat <<-EOF > Dockerfile
# syntax=docker/dockerfile:experimental
FROM ubuntu:18.04

ARG ASCEND_DIR=./ascend
# ./ascend
#  Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run
#  Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run
#  Python-3.7.5.tgz

COPY \${ASCEND_DIR} /ascend

RUN apt-get update \\
 && apt-get install -y gcc g++ make cmake zlib1g zlib1g-dev libsqlite3-dev \\
                       openssl libssl-dev libffi-dev unzip pciutils net-tools \\
 && rm -rf /var/lib/apt/lists/*

RUN cd /ascend \\
 && tar -zxvf Python-3.7.5.tgz \\
 && cd Python-3.7.5 \\
 && ./configure --prefix=/usr/local/python3.7.5 \\
                --enable-loadable-sqlite-extensions --enable-shared \\
 && make -j\$(nproc) && make install \\
 && cp /usr/local/python3.7.5/lib/libpython3.7m.so.1.0 /usr/lib \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3 \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3.7 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3.7 \\
 && ln -s /usr/local/python3.7.5/bin/python3 /usr/bin/python3.7.5 \\
 && ln -s /usr/local/python3.7.5/bin/pip3 /usr/bin/pip3.7.5 \\
 && pip3.7.5 install attrs psutil decorator numpy protobuf==3.11.3 scipy sympy \\
      cffi -i https://mirrors.aliyun.com/pypi/simple/ \\
 && rm -r /ascend/Python-3.7.5

RUN cd /ascend \\
 && chmod +x *.run \\
 && ./Ascend-cann-toolkit_5.0.2.alpha003_linux-x86_64.run \\
      --install-username=root --install-usergroup=root --install \\
 && ./Ascend-cann-toolkit_5.0.2.alpha003_linux-aarch64.run \\
      --install-username=root --install-usergroup=root --install

RUN echo '\nawk"/Please make sure that:/,/chmod_authority/"/var/log/ascend_seclog/ascend_toolkit_install.log' >> /root/.bashrc

CMD ["/bin/bash"]
EOF

docker build \
-t ascend/cann:5.0.2.alpha003 \
--build-arg ASCEND_DIR=./ascend \
-f ./Dockerfile .

docker run -it --rm ascend/cann:5.0.2.alpha003

装置 MindStudio

tar xzvf MindStudio_3.0.1_linux.tar.gz -C $HOME
sudo ln -s $HOME/MindStudio/bin/MindStudio.sh /usr/local/bin/MindStudio

首次运行 MindStudio 如果提醒依赖缺失,则运行提醒命令装置:

$ MindStudio
Checking MindStudio environment dependencies...
Success

Checking Python environment dependencies...
Success

Some dependencies are missing. Execute the following command first:
sudo  apt-get -y install xterm fonts-wqy-zenhei fonts-wqy-microhei  && /home/HwHiAiUser/python3.7.5/bin/pip3 install --user  grpcio coverage gnureadline pylint matplotlib requests pandas xlrd absl-py

此外,还需装置 JDK:

sudo apt-get -y install openjdk-8-jdk

最初,即可失常运行 MindStudio

配置 MindStudio

首次提醒导入设置:

抉择不导入 OK。若有以前设置,可设门路如:$HOME/.config/Huawei/MindStudioMS-3.0

接着抉择开发包门路:

之后用户体验改良 Argree

最初进入 MindStudio 首页:

参考

  • Ascend
  • 昇腾 CANN

GoCoding 集体实际的教训分享,可关注公众号!

退出移动版