关于pip:从源代码构建TensorFlow流程记录

京东科技隐衷计算产品部 曹雨晨为什么从源代码构建通常状况下,间接装置构建好的.whl即可。不过,当须要一些非凡配置(或者闲来无事想领会 TensorFlow 构建过程到底有多麻烦)的时候,则须要抉择从源代码构建TensorFlow。万幸文档凌乱的 TensorFlow 还是善意地为咱们提供了一整页的文档供参考 https://www.tensorflow.org/in... ,集体认为其中最须要关注的局部莫过于通过测试供参考的源配置(列于文末)。TF应用 Google 的开源构建工具 bazel 构建,并且源码的版本与 bazel 的版本高度相干,所以尽量匹配版本进行构建。 流程记录 TF v1.14.0 CPU on Ubuntu 18.04装置对应版本的 bazel依据打算构建的版本,查阅文末的对应配置,参考官网文档: https://bazel.build/install/u... 装置相应版本的 bazel,如本次打算构建的版本是 v1.14.0,对应的 bazel 版本是 0.24.1(此次应用0.26.1也是能够的)。 为不便,这里间接贴出对应 0.26.1 release 的页面: https://github.com/bazelbuild... ,点击assets找到对应的文件下载即可。 wget https://github.com/bazelbuild/bazel/releases/download/0.26.1/bazel-0.26.1-installer-linux-x86_64.shchmod +x bazel-version-installer-linux-x86_64.sh./bazel-version-installer-linux-x86_64.sh --user克隆 TensorFlow 仓库从 Github 上 clone 源码仓库 git clone https://github.com/tensorflow/tensorflow cd 到仓库目录并 git checkout到相应 tag,比方这次是构建 v1.14.0 版本: git checkout v1.14.0* 一些小调整,通常能够略过Build with C++17因为之后须要写的 Custom OP 依赖的另一个库是 C++17,而除了刚刚才公布的 v2.10 版,以前的 TF默认是应用 C++11,理论构建的时候,代码有一些 minor fix。此处参考 https://github.com/tensorflow... 批改 .bazelrc 里 build:c++17 的配置,在 tensorflow/core/lib/gif/gif_io.cc 中增加 #include<cstring>, 并在 tensorflow/stream_executor/stream_executor_pimpl.h 中增加 #include "absl/memory/memory.h"(否则 compile 时会报错找不到 absl::make_unique)(这里 make_unique 是 C++17 规范库里的用法,Google的abseil的make_unique办法则不便C++11的代码也能够应用它;最新的v2.10版因为默认应用C++17,曾经改为std::make_unique) ...

January 3, 2023 · 4 min · jiezi

关于pip:MacBook安装pip和Django

MacBook装置pip和DjangoMacBook零碎自带了python #查看python版本python -V#显示如下:Python 2.7.16#装置pipsudo easy_install pip#查看pip版本pip --version#回显如下:pip 19.2.3 from /Library/Python/2.7/site-packages/pip-19.2.3-py2.7.egg/pip (python 2.7)#应用pip装置djangosudo pip install django#查看django版本python -m django --version#回显如下:1.11.24

October 8, 2022 · 1 min · jiezi

关于pip:升级pip并安装库

明天用pip装置一些罕用库,而后呈现以下这段代码。 须要降级一下pip WARNING: You are using pip version 20.3.1; however, version 21.3.1 is available.You should consider upgrading via the 'c:\program files\python\python.exe -m pip install --upgrade pip' command参考阿里巴巴开源镜像站 首先切换应用国内阿里巴巴的pypi镜像源 a. 找到下列文件(windows目录:C:\Users\Administrator) ~/.pip/pip.conf b. 在上述文件中增加或批改: [global]index-url = https://mirrors.aliyun.com/pypi/simple/[install]trusted-host=mirrors.aliyun.com接着降级pipcmd下输出:python -m pip install --upgrade pip ok 接着就能够持续应用pip install xxxxx 装置库了

February 15, 2022 · 1 min · jiezi

关于pip:centos7安装pip并配置国内阿里镜像源

参考阿里巴巴开源镜像站 centos7装置pip并配置国内阿里镜像源 首先装置pip前须要装置epel-release yum -y install epel-release 装置pip yum -y install python-pip 查看pip版本 pip --version 配置阿里镜像源(批改pip.conf) cd ~mkdir .pipcd .piptouch pip.confvi pip.conf批改为以下并保留 [global]index-url = https://mirrors.aliyun.com/pypi/simple/[install]trusted-host=mirrors.aliyun.com   实现

December 24, 2021 · 1 min · jiezi

关于pip:Ubuntu安装pip并切换国内源

参考阿里巴巴开源镜像站 Ubuntu装置pip并切换国内源 先装置Python 3和pip3 查看Python 3和pip3 python3 --version pip3 --version 装置实现后 创立pip文件夹 并创立pip.conf文件 cd ~mkdir .piptouch pip.confsudo chmod 755 pip.confgedit pip.conf输出阿里云pypi镜像源保留即可 [global]index-url = https://mirrors.aliyun.com/pypi/simple/[install]trusted-host=mirrors.aliyun.com              

December 24, 2021 · 1 min · jiezi

关于pip:windows系统下跟换pypi国内阿里镜像源pip

参考阿里巴巴开源镜像站 简介PyPI (Python Package Index) 是 Python 编程语言的软件存储库。开发者能够通过 PyPI 查找和装置由 Python 社区开发和共享的软件,也能够将本人开发的库上传至 PyPI 。 windows零碎下跟换pypi国内镜像源(pip) 首先在c盘的C:\Users\本人的用户名\  下找到pip文件夹如图 没有就新建一个 而后再点进去创立 pip.ini 编辑 [global]index-url = https://mirrors.aliyun.com/pypi/simple/[install]trusted-host=mirrors.aliyun.com 保留 终端运行pip install sklearn测试 实现

December 24, 2021 · 1 min · jiezi

关于pip:pip-install-远程主机强迫关闭了一个现有的连接-解决方案

在公司内网,通过代理拜访外网时,应用pip install会呈现如下问题: 果决应用pip install wheel -i http://pypi.douban.com/simple --trusted-host pypi.douban.com --user解决问题

August 3, 2021 · 1 min · jiezi

关于pip:pip-及-conda-常用指令

pip# 根本pip show numpypip listpip list --outdated# 装置与卸载 packagepip install numpy# 同时装置多个包pip install numpy scipy matplotlibpip uninstall numpypip install SomePackage-1.0-py2.py3-none-any.whl# 导入导出 requirementspip install -r requirements.txtpip freeze > requirements.txt# 清空缓存pip cache remove *conda# 在 PowerShell 中应用须要初始化以下指令conda init powershell# 列呈现有 conda 环境conda env list# 创立新的环境conda create -n new_env# 创立一个指定 Python 版本的新环境(会主动装置指定版本最新的稳固版本)conda create -n new_env python=3.x# 从已有环境拷贝并创立一个新的环境conda create -n new_env --clone source_env# 删除一个环境conda remove -n del_env --all# 更新以后环境的 Pythonconda install python=3.7# 更新以后环境的所有包conda update --all# 清理缓存conda clean --all

July 1, 2021 · 1 min · jiezi

关于pip:Python-包管理工具-poetryqbit

官网文档:https://python-poetry.org/docs/将虚拟目录放在我的项目内 poetry config virtualenvs.in-project true软件包国内镜像(pyproject.toml) [[tool.poetry.source]]name = "aliyun"url = "https://mirrors.aliyun.com/pypi/simple/"default = true本文出自 qbit snap

June 30, 2021 · 1 min · jiezi

关于pip:AttributeError-module-socks-has-no-attribute-create

问题bug当运行 pip install $PAK_NAME时,显示如下谬误: ERROR: Exception:Traceback (most recent call last): File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 188, in _main status = self.run(options, args) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 185, in wrapper return func(self, options, args) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 333, in run reqs, check_supported_wheels=not options.target_dir File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 179, in resolve discovered_reqs.extend(self._resolve_one(requirement_set, req)) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 362, in _resolve_one abstract_dist = self._get_abstract_dist_for(req_to_install) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 313, in _get_abstract_dist_for self._populate_link(req) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 279, in _populate_link req.link = self.finder.find_requirement(req, upgrade) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/package_finder.py", line 901, in find_requirement req.name, specifier=req.specifier, hashes=hashes, File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/package_finder.py", line 883, in find_best_candidate candidates = self.find_all_candidates(project_name) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/package_finder.py", line 828, in find_all_candidates project_url, link_evaluator=link_evaluator, File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/package_finder.py", line 792, in process_project_url html_page = self._link_collector.fetch_page(project_url) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/collector.py", line 612, in fetch_page return _get_html_page(location, session=self.session) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/collector.py", line 451, in _get_html_page resp = _get_html_response(url, session=session) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/index/collector.py", line 166, in _get_html_response "Cache-Control": "max-age=0", File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/requests/sessions.py", line 543, in get return self.request('GET', url, **kwargs) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_internal/network/session.py", line 421, in request return super(PipSession, self).request(method, url, *args, **kwargs) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/requests/sessions.py", line 530, in request resp = self.send(prep, **send_kwargs) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/requests/sessions.py", line 643, in send r = adapter.send(request, **kwargs) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/requests/adapters.py", line 449, in send timeout=timeout File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/urllib3/connectionpool.py", line 387, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/http/client.py", line 1252, in request self._send_request(method, url, body, headers, encode_chunked) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/http/client.py", line 1298, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/http/client.py", line 1247, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/http/client.py", line 1026, in _send_output self.send(msg) File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/http/client.py", line 966, in send self.connect() File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/urllib3/connection.py", line 184, in connect conn = self._new_conn() File "/home/$USER_NAME/anaconda3/envs/py37/lib/python3.7/site-packages/pip/_vendor/urllib3/contrib/socks.py", line 90, in _new_conn conn = socks.create_connection(AttributeError: module 'socks' has no attribute 'create_connection'解决方案狐疑是之前配置的全局代理的起因,查看~/.bashrc,在底部发现之前增加代码如下: ...

December 2, 2020 · 2 min · jiezi

关于pip:pip临时换源提升下载速度

用pip管理工具装置python第三方库时,默认应用国外的源文件,因而在国内的下载速度较慢。可通过长期更换国内镜像来晋升下载速度。 pip长期换源在应用pip时,通过增加参数-i来指定pip源。如: 装置第三方库: # 默认应用国外pip源pip install 库名 # 指定pip源,加上参数-i和镜像地址pip install 库名 -i http://mirrors.aliyun.com/pypi/simple/更新第三方库同理: # 默认应用国外pip源pip install --upgrade 库名# 指定pip源,加上参数-i和镜像地址pip install --upgrade 库名 -i http://mirrors.aliyun.com/pypi/simple/更换罕用的国内镜像阿里云:-i http://mirrors.aliyun.com/pypi/simple/ 清华大学:-i https://pypi.tuna.tsinghua.edu.cn/simple 中国科技大学 -i https://pypi.mirrors.ustc.edu.cn/simple/ 华中理工大学:-i http://pypi.hustunique.com/ 山东理工大学:-i http://pypi.sdutlinux.org/  豆瓣:-i http://pypi.douban.com/simple/

November 13, 2020 · 1 min · jiezi