December 2017 – 一江春水向东流

未分类

centos7上Virtualenv从python3.4升级到Python3.7.4

目前我的虚拟环境python版本是3.4, 想升级到最新的3.7.4, 总结步骤如下: 首先激活当前env_py3环境, 并导出当前依赖包:

workon env_py3
pip freeze > requirements.txt

1 2	workon env_py3 pip freeze > requirements.txt

首先安装依赖: 注意: libffi-devel必须安装, 不然编译安装会失败而导致安装不完整, 而创建虚拟环境时会报错(No module named ‘_ctypes’ )

yum -y install gcc gcc-c++ zlib zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel
yum -y install libffi-devel

1 2	yum -y install gcc gcc-c++ zlib zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel yum -y install libffi-devel

下载安装python3.7:

wget https://www.python.org/ftp/python/3.7.4/Python-3.7.4.tgz
tar -zxvf Python-3.7.4.tgz
cd Python-3.7.4/
mkdir /usr/local/python3.7
./configure --prefix=/usr/local/python3.7
make && make install

wget https://www.python.org/ftp/python/3.7.4/Python-3.7.4.tgz

tar -zxvf Python-3.7.4.tgz

cd Python-3.7.4/

mkdir /usr/local/python3.7

./configure --prefix=/usr/local/python3.7

make && make install

创建软链接:

ln -s /usr/local/python3.7/bin/python3.7 /usr/bin/python3.7
ln -s /usr/local/python3.7/bin/pip3 /usr/bin/pip3

1 2	ln -s /usr/local/python3.7/bin/python3.7 /usr/bin/python3.7 ln -s /usr/local/python3.7/bin/pip3 /usr/bin/pip3

配置虚拟环境:

#配置虚拟环境创建时默认用python3.7
virtualenv -p /usr/local/python3.7/bin/python3 /root/.virtualenvs
ln -s /root/.virtualenvs/bin/activate /usr/bin/activate
source activate
#创建虚拟环境
mkvirtualenv -p /usr/local/python3.7/bin/python3 env_py3
#切换到虚拟环境
workon env_py3
#导入依赖包
pip install -r requirements.txt

#配置虚拟环境创建时默认用python3.7

virtualenv -p /usr/local/python3.7/bin/python3 /root/.virtualenvs

ln -s /root/.virtualenvs/bin/activate /usr/bin/activate

source activate

#创建虚拟环境

mkvirtualenv -p /usr/local/python3.7/bin/python3 env_py3

#切换到虚拟环境

workon env_py3

#导入依赖包

pip install -r requirements.txt

附: 我的系统配置文件: .bashrc:

## virtualenv
export PIP_REQUIRE_VIRTUALENV=true #pip安装东西的时候不安装到本地环境
export PIP_RESPECT_VIRTUALENV=true #在执行pip的时候让系统自动开启虚拟环境
export WORKON_HOME=$HOME/.virtualenvs #所有虚拟环境存储的目录
export PIP_VIRTUALENV_BASE=$WORKON_HOME
export VIRTUALENV_USE_DISTRIBUTE=1        #  总是使用 pip/distribute
#source /usr/local/bin/virtualenvwrapper.sh
source /usr/bin/virtualenvwrapper.sh 
#if [ -e $HOME/.local/bin/virtualenvwrapper.sh ];then
#    source $HOME/.local/bin/virtualenvwrapper.sh
#else if [ -e /usr/local/bin/virtualenvwrapper.sh ];then
#        source /usr/local/bin/virtualenvwrapper.sh
#    fi
#fi

# colourful man page
export LESS_TERMCAP_mb=$'\E[01;34m'
export LESS_TERMCAP_md=$'\E[01;34m'
export LESS_TERMCAP_me=$'\E[0m'
export LESS_TERMCAP_us=$'\E[01;32m'
export LESS_TERMCAP_ue=$'\E[0m'
export LESS_TERMCAP_so=$'\E[01;33;44m'
export LESS_TERMCAP_se=$'\E[0m'

TERM=xterm
export TERM

PATH="$PATH:$HOME/bin:/usr/local/python3.7/bin"
export PATH

## virtualenv

export PIP_REQUIRE_VIRTUALENV=true #pip安装东西的时候不安装到本地环境

export PIP_RESPECT_VIRTUALENV=true #在执行pip的时候让系统自动开启虚拟环境

export WORKON_HOME=$HOME/.virtualenvs #所有虚拟环境存储的目录

export PIP_VIRTUALENV_BASE=$WORKON_HOME

export VIRTUALENV_USE_DISTRIBUTE=1 # 总是使用 pip/distribute

#source /usr/local/bin/virtualenvwrapper.sh

source /usr/bin/virtualenvwrapper.sh

#if [ -e $HOME/.local/bin/virtualenvwrapper.sh ];then

# source $HOME/.local/bin/virtualenvwrapper.sh

#else if [ -e /usr/local/bin/virtualenvwrapper.sh ];then

# source /usr/local/bin/virtualenvwrapper.sh

# fi

#fi

# colourful man page

export LESS_TERMCAP_mb=$'\E[01;34m'

export LESS_TERMCAP_md=$'\E[01;34m'

export LESS_TERMCAP_me=$'\E[0m'

export LESS_TERMCAP_us=$'\E[01;32m'

export LESS_TERMCAP_ue=$'\E[0m'

export LESS_TERMCAP_so=$'\E[01;33;44m'

export LESS_TERMCAP_se=$'\E[0m'

TERM=xterm

export TERM

PATH="$PATH:$HOME/bin:/usr/local/python3.7/bin"

export PATH

旧的:升级python2.7.14：在系统上升级python还是需要慎重, 严重的会导致系统命令不可用, 建议最好不要覆盖系统原本的/usr/bin/python文件下面是升级脚本：

#!/bin/bash

export https_proxy=10.x.x.x:8888
export http_proxy=10.x.x.x:8888

py_version=`python -c "import platform;print platform.python_version()"`

mkdir /opt/packages
cd /opt/packages
wget https://www.python.org/ftp/python/2.7.14/Python-2.7.14.tgz
tar -zxvf Python-2.7.14.tgz

#pip freeze > requirments.txt

cd Python-2.7.14

#解决Python升级找不到Tkinter模块
yum -y install tkinter
#-ltk8.5 -ltcl8.5 默认是 8.2 ，请你系统实际tcl/tk版本修改
#rpm -qa | grep ^tk
#rpm -qa | grep ^tcl

#vi Modules/Setup.dist
#_tkinter _tkinter.c tkappinit.c -DWITH_APPINIT \
#-L/usr/local/lib \
#-I/usr/local/include \
#-ltk8.5 -ltcl8.5 \
#-lX11

yum -y install tcl-devel tk-devel

./configure --enable-shared --prefix=/usr/local CFLAGS=-fPIC LDFLAGS="-Wl,-rpath /usr/local/lib" --enable-unicode=ucs4
make -j24
sudo make install

cd ../

mv /usr/bin/python /usr/bin/python$py_version
ln -sf /usr/local/bin/python /usr/bin/python

py_version_new=`python -c "import platform;print platform.python_version()"`

if [ $py_version_new == "2.7.14" ]; then
	sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/bin/yum
	sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/libexec/urlgrabber-ext-down
	sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/bin/firewall-cmd
	sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /sbin/authconfig

	wget https://bootstrap.pypa.io/ez_setup.py
	python ez_setup.py
	wget https://bootstrap.pypa.io/get-pip.py
	python get-pip.py
	ln -sf /usr/local/bin/pip /usr/bin/pip
	ln -sf /usr/local/bin/pip /usr/bin/pip2

	echo "PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin" >> /etc/profile
	echo "export PATH" >> /etc/profile
	source /etc/profile
	#pip uninstall -r requirments.txt
	#pip install -r requirments.txt.128
	#pip install -U docker
	#pip install --upgrade --force-reinstall 'requests==2.18.4' urllib3

else
	echo "python 2.7.14 updated failed!!!"
fi

#!/bin/bash

export https_proxy=10.x.x.x:8888

export http_proxy=10.x.x.x:8888

py_version=`python -c "import platform;print platform.python_version()"`

mkdir /opt/packages

cd /opt/packages

wget https://www.python.org/ftp/python/2.7.14/Python-2.7.14.tgz

tar -zxvf Python-2.7.14.tgz

#pip freeze > requirments.txt

cd Python-2.7.14

#解决Python升级找不到Tkinter模块

yum -y install tkinter

#-ltk8.5 -ltcl8.5 默认是 8.2 ，请你系统实际tcl/tk版本修改

#rpm -qa | grep ^tk

#rpm -qa | grep ^tcl

#vi Modules/Setup.dist

#_tkinter _tkinter.c tkappinit.c -DWITH_APPINIT \

#-L/usr/local/lib \

#-I/usr/local/include \

#-ltk8.5 -ltcl8.5 \

#-lX11

yum -y install tcl-devel tk-devel

./configure --enable-shared --prefix=/usr/local CFLAGS=-fPIC LDFLAGS="-Wl,-rpath /usr/local/lib" --enable-unicode=ucs4

make -j24

sudo make install

cd ../

mv /usr/bin/python /usr/bin/python$py_version

ln -sf /usr/local/bin/python /usr/bin/python

py_version_new=`python -c "import platform;print platform.python_version()"`

if [ $py_version_new == "2.7.14" ]; then

sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/bin/yum

sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/libexec/urlgrabber-ext-down

sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /usr/bin/firewall-cmd

sed -i "s@\#\!.*/usr/bin/python@\#\!/usr/bin/python$py_version@g" /sbin/authconfig

wget https://bootstrap.pypa.io/ez_setup.py

python ez_setup.py

wget https://bootstrap.pypa.io/get-pip.py

python get-pip.py

ln -sf /usr/local/bin/pip /usr/bin/pip

ln -sf /usr/local/bin/pip /usr/bin/pip2

echo "PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin" >> /etc/profile

echo "export PATH" >> /etc/profile

source /etc/profile

#pip uninstall -r requirments.txt

#pip install -r requirments.txt.128

#pip install -U docker

#pip install --upgrade --force-reinstall 'requests==2.18.4' urllib3

else

echo "python 2.7.14 updated failed!!!"

解决升级python导致的salt启动失败： centos7重新编辑安装了python2.7.14, 原来是2.7.5，导致salt-minion启动失败。解决：由于之前备份了python执行文件为python2.7.5，新的Python安装在/usr/local/目录。由于脚本误把之前版本的pip包删除了，所以重新安装salt需要的模块：首先更改salt执行文件： sed -i ‘s|^#!/usr/bin/python$|#!/usr/bin/python2.7.5|’ /usr/bin/salt* 如提示没有yaml块，则安装之： wget http://pyyaml.org/download/pyyaml/PyYAML-3.12.tar.gz; tar -xvzf PyYAML-3.12.tar.gz; python2.7.5 setup.py install Read more…

By sean, 6 years12/13/2017 ago

未分类

梅林固件安装SS【shadowsocks】插件教程

梅林固件安装SS【shadowsocks】插件教程注：本教程不适用于N66U和AC66U两款机型。由于不可抗拒的因素现在已经无法再软件中心安装SS了，那么接下来我们就解决这个问题：手动安装shadowsocks 首先刷好梅林之后进入系统设置界面，在Enable SSH里选择LAN ONLY，其它不用动，选择下面的应用设置。之后用putty或者SecureCRT软件链接路由器，推荐使用SecureCRT, 点我下载打开securecrt，创建新连接，协议选择SSH2，地址选择你的路由器地址，端口22不变，用户名填路由器管理员，默认是admin。点击链接之后输入密码。登陆成功后如下图，可能是配色原因，默认为白色。接下来开始下载并且安装ss 一行一行的复制，然后右键在SecureCRT粘贴回车执行。

<span style="color: #333333;">cd /tmp</span>

1	<span style="color: #333333;">cd /tmp</span>

<span style="color: #333333;">wget --no-check-certificate https://raw.githubusercontent.com/koolshare/koolshare.github.io/acelan_softcenter_ui/shadowsocks/shadowsocks.tar.gz</span>

1	<span style="color: #333333;">wget --no-check-certificate https://raw.githubusercontent.com/koolshare/koolshare.github.io/acelan_softcenter_ui/shadowsocks/shadowsocks.tar.gz</span>

<span style="color: #333333;">tar -zxvf /tmp/shadowsocks.tar.gz</span>

1	<span style="color: #333333;">tar -zxvf /tmp/shadowsocks.tar.gz</span>

<span style="color: #333333;">chmod +x /tmp/shadowsocks/install.sh</span>

1	<span style="color: #333333;">chmod +x /tmp/shadowsocks/install.sh</span>

<span style="color: #333333;">sh /tmp/shadowsocks/install.sh</span>

1	<span style="color: #333333;">sh /tmp/shadowsocks/install.sh</span>

之后重启路由器你就会在软件中心中看见了shadowsocks了。另附 shadowsocks3.6.0下载，可直接在软件中心后台离线安装点我下载离线安装说明：使用chrome浏览器，进入路由器梅林固件页面，然后进入软件中心-离线安装中心，根据提示，将安装包改名为shadowsocks.tar.gz上传安装。可能会提示上传安装中而没有下一步指示，此时只需等待3分钟后刷新页面重新进入软件中心即可看到插件。转自：http://blog.sina.com.cn/s/blog_4891cbc50102x5ly.html

By sean, 6 years ago

HANDBOOK

Vim与Python真乃天作之合

Vim与Python真乃天作之合我注意到，有人在realpython.com宣扬Sublime Text 3。作为公司的资深开发人员（呃，也就是老古董），我觉得有义务介绍一个真正的Python开发环境给大家——我要推荐的当然就是Vim了。不错，Vim编辑器无处不在，速度快，从来不会崩溃。并且，它能做任何事情！不过，不利之处也有，就是Vim配置起来很让人头疼。但是，别担心，本文将告诉你如何配置一个强大的Vim环境，专门用于天天捣鼓Python开发。下面是最终效果预览。如果想充分地利用好本文，你应该对如何使用Vim和它的命令模式至少有一个基本的了解。如果你是初学者，你可以通过vim-adventure或者openvim网站学习。在继续阅读本文之前，请花点时间浏览那两个网站的内容。安装因为许多Unix衍生系统已经预装了Vim，我们首先要确认编辑器是否成功安装：

vim --version

1	vim --version

如果已经安装了，你应该看到类似下面的文字：

<span class="x">VIM - Vi IMproved 7.3 (2010 Aug 15, compiled Nov  5 2014 21:00:28)</span>
<span class="x">Compiled by root@apple.com</span>
<span class="x">Normal version without GUI.  Features included (+) or not (-):</span>
<span class="x">-arabic +autocmd -balloon_eval -browse +builtin_terms +byte_offset +cindent</span>
<span class="x">-clientserver -clipboard +cmdline_compl +cmdline_hist +cmdline_info +comments</span>
<span class="x">-conceal +cryptv +cscope +cursorbind +cursorshape +dialog_con +diff +digraphs</span>
<span class="x">-dnd -ebcdic -emacs_tags +eval +ex_extra +extra_search -farsi +file_in_path</span>
<span class="x">+find_in_path +float +folding -footer +fork() -gettext -hangul_input +iconv</span>
<span class="x">+insert_expand +jumplist -keymap -langmap +libcall +linebreak +lispindent</span>
<span class="x">+listcmds +localmap -lua +menu +mksession +modify_fname +mouse -mouseshape</span>
<span class="x">-mouse_dec -mouse_gpm -mouse_jsbterm -mouse_netterm -mouse_sysmouse</span>
<span class="x">+mouse_xterm +multi_byte +multi_lang -mzscheme +netbeans_intg -osfiletype</span>
<span class="x">+path_extra -perl +persistent_undo +postscript +printer -profile +python/dyn</span>
<span class="x">-python3 +quickfix +reltime -rightleft +ruby/dyn +scrollbind +signs</span>
<span class="x">+smartindent -sniff +startuptime +statusline -sun_workshop +syntax +tag_binary</span>
<span class="x">+tag_old_static -tag_any_white -tcl +terminfo +termresponse +textobjects +title</span>
<span class="x"> -toolbar +user_commands +vertsplit +virtualedit +visual +visualextra +viminfo</span>
<span class="x">+vreplace +wildignore +wildmenu +windows +writebackup -X11 -xfontset -xim -xsmp</span>
<span class="x"> -xterm_clipboard -xterm_save</span>
<span class="x">   system vimrc file: "</span><span class="p">$</span><span class="nv">VIM</span><span class="x">/vimrc"</span>
<span class="x">     user vimrc file: "</span><span class="p">$</span><span class="nv">HOME</span><span class="x">/.vimrc"</span>
<span class="x">      user exrc file: "</span><span class="p">$</span><span class="nv">HOME</span><span class="x">/.exrc"</span>
<span class="x">  fall-back for </span><span class="p">$</span><span class="nv">VIM</span><span class="x">: "/usr/share/vim"</span>
<span class="x">Compilation: gcc -c -I. -D_FORTIFY_SOURCE=0 -Iproto -DHAVE_CONFIG_H -arch i386 -arch x86_64 -g -Os -pipe</span>
<span class="x">Linking: gcc -arch i386 -arch x86_64 -o vim -lncurses</span>

VIM - Vi IMproved 7.3 (2010 Aug 15, compiled Nov 5 2014 21:00:28)

Compiled by root@apple.com

Normal version without GUI. Features included (+) or not (-):

-arabic +autocmd -balloon_eval -browse +builtin_terms +byte_offset +cindent

-clientserver -clipboard +cmdline_compl +cmdline_hist +cmdline_info +comments

-conceal +cryptv +cscope +cursorbind +cursorshape +dialog_con +diff +digraphs

-dnd -ebcdic -emacs_tags +eval +ex_extra +extra_search -farsi +file_in_path

+find_in_path +float +folding -footer +fork() -gettext -hangul_input +iconv

+insert_expand +jumplist -keymap -langmap +libcall +linebreak +lispindent

+listcmds +localmap -lua +menu +mksession +modify_fname +mouse -mouseshape

-mouse_dec -mouse_gpm -mouse_jsbterm -mouse_netterm -mouse_sysmouse

+mouse_xterm +multi_byte +multi_lang -mzscheme +netbeans_intg -osfiletype

+path_extra -perl +persistent_undo +postscript +printer -profile +python/dyn

-python3 +quickfix +reltime -rightleft +ruby/dyn +scrollbind +signs

+smartindent -sniff +startuptime +statusline -sun_workshop +syntax +tag_binary

+tag_old_static -tag_any_white -tcl +terminfo +termresponse +textobjects +title

-toolbar +user_commands +vertsplit +virtualedit +visual +visualextra +viminfo

+vreplace +wildignore +wildmenu +windows +writebackup -X11 -xfontset -xim -xsmp

-xterm_clipboard -xterm_save

system vimrc file: "$VIM/vimrc"

user vimrc file: "$HOME/.vimrc"

user exrc file: "$HOME/.exrc"

fall-back for $VIM: "/usr/share/vim"

Compilation: gcc -c -I. -D_FORTIFY_SOURCE=0 -Iproto -DHAVE_CONFIG_H -arch i386 -arch x86_64 -g -Os -pipe

Linking: gcc -arch i386 -arch x86_64 -o vim -lncurses

在这一步，你要确保已经满足以下两点要求： Vim编辑版本应该大于7.3。支持Python语言。在所选编辑器的功能中，确保你看到了+python。如果满足上述要求，接下来可以安装Vim扩展了。如果不满足，则需要安装/升级。 OS X 如果没有Homebrew，建议马上安装，并运行：

brew update
brew install vim

1 2	brew update brew install vim

Unix衍生系统 Debian或Ubuntu系统，可以使用下面的代码：

sudo apt-get remove vim-tiny
apt-get update
apt-get install vim

sudo apt-get remove vim-tiny

apt-get update

apt-get install vim

如果是其他版本的Linux系统，请查阅相应版本包管理器的文档。不清楚的话，可以先阅读这篇文章：安装Vim Windows Windows系统下安装Vim有很多种方法。请查阅官方文档。验证安装确保你已经安装了7.3版本以上、支持Python的Vim编辑器。你可以再次运行vim –version进行确认。如果你想知道Vim中使用的Python版本，你可以在编辑器中运行:python import sys; print(sys.version)。

2.7.6 (default, Sep  9 2014, 15:04:36)
[GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)]

1 2	2.7.6 (default, Sep 9 2014, 15:04:36) [GCC 4.2.1 Compatible Apple LLVM 6.0 (clang-600.0.39)]

这行命令会输出你的编辑器当前的Python版本。如果报错，那么你的编辑器就不支持Python语言，需要重装或重新编译。 Vim编辑器安装完成后，我们来看看如何将其设置为Python开发的强大环境。 Vim扩展 Vim本身能够满足开发人员的很多需求，但是它的可扩展性也极强，并且已经有一些杀手级的扩展，可以让Vim拥有“现代”集成开发环境的特性。所以，你所需要的第一件东西就是一个好用的扩展管理器。 Vim的扩展通常也被成为bundle或插件。 Vundle Vim有多个扩展管理器，但是我们强烈推荐Vundle。你可以把它想象成Vim的pip。有了Vundle，安装和更新包这种事情不费吹灰之力。我们现在来安装Vundle：

git clone https://github.com/gmarik/Vundle.vim.git ~/.vim/bundle/Vundle.vim

1	git clone https://github.com/gmarik/Vundle.vim.git ~/.vim/bundle/Vundle.vim

该命令将下载Vundle插件管理器，并将它放置在你的Vim编辑器bundles文件夹中。现在，你可以通过.vimrc配置文件来管理所有扩展了。将配置文件添加到你的用户的home文件夹中：

touch ~/.vimrc

1	touch ~/.vimrc

接下来，把下来的Vundle配置添加到配置文件的顶部：

set nocompatible              " required
filetype off                  " required

" set the runtime path to include Vundle and initialize
set rtp+=~/.vim/bundle/Vundle.vim
call vundle#begin()

" alternatively, pass a path where Vundle should install plugins
"call vundle#begin('~/some/path/here')

" let Vundle manage Vundle, required
Plugin 'gmarik/Vundle.vim'

" Add all your plugins here (note older versions of Vundle used Bundle instead of Plugin)


" All of your Plugins must be added before the following line
call vundle#end()            " required
filetype plugin indent on    " required

set nocompatible " required

filetype off " required

" set the runtime path to include Vundle and initialize

set rtp+=~/.vim/bundle/Vundle.vim

call vundle#begin()

" alternatively, pass a path where Vundle should install plugins

"call vundle#begin('~/some/path/here')

" let Vundle manage Vundle, required

Plugin 'gmarik/Vundle.vim'

" Add all your plugins here (note older versions of Vundle used Bundle instead of Plugin)

" All of your Plugins must be added before the following line

call vundle#end() " required

filetype plugin indent on " required

这样，你就完成了使用Vundle前的设置。之后，你就可以在配置文件中添加希望安装的插件，然后打开Vim编辑器，运行下面的命令：

:PluginInstall

1	:PluginInstall

这个命令告诉Vundle施展它的魔法——自动下载所有的插件，并为你进行安装和更新。 Read more…

By sean, 6 years ago