ubuntu20.04爬虫开发环境搭建以及常用软件安装

1.换源更新系统

sudo cp /etc/apt/sources.list /etc/apt/sources.list.bak
sudo vim /etc/apt/sources.list
#添加阿里源
deb http://mirrors.aliyun.com/ubuntu/ focal main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ focal main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ focal-security main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ focal-security main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ focal-updates main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ focal-updates main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ focal-proposed main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ focal-proposed main restricted universe multiverse
deb http://mirrors.aliyun.com/ubuntu/ focal-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ focal-backports main restricted universe multiverse

#添加清华源
deb https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal main restricted universe multiverse
# deb-src https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal main restricted universe multiverse
deb https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-updates main restricted universe multiverse
# deb-src https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-updates main restricted universe multiverse
deb https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-backports main restricted universe multiverse
# deb-src https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-backports main restricted universe multiverse
deb https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-security main restricted universe multiverse
# deb-src https://mirrors.tuna.tsinghua.edu.cn/ubuntu/ focal-security main restricted universe multiverse multiverse
sudo apt-get update && sudo apt-get upgrade

2.安装搜狗输入法

官网:https://pinyin.sogou.com/linux/help.php

sudo apt-get install fcitx

英文安装时对应的是英文
设置—》区域与语言—》管理已安装语言—》键盘与输入法系统设置为fictx—》点关闭回到区域与语言—》语言选简体中文–》sudo dpkg -i sogoupinyin_版本号_amd64.deb–》sudo apt -f install–》sudo dpkg -i sogoupinyin_版本号_amd64.deb–》关机然后重启

3.安装typora

# sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys BA300B7755AFCFAE
wget -qO - https://typora.io/linux/public-key.asc | sudo apt-key add -
# add Typora's repository
sudo add-apt-repository 'deb https://typora.io/linux ./'
sudo apt-get update
# install typora
sudo apt-get install typora

4.安装同步软件坚果云

不要安装官方的deb包,ubuntu20.04缺少python2,直接按照官网方法编译安装,还有就是网上说的编译时需要python2是错误的,直接按照官网方法安装依赖就可以编译成功。
官网:https://www.jianguoyun.com/s/downloads/linux
编译安装:

sudo apt-get install libglib2.0-dev libgtk2.0-dev libnautilus-extension-dev gvfs-bin python3-gi gir1.2-appindicator3-0.1

wget https://www.jianguoyun.com/static/exe/installer/nutstore_linux_src_installer.tar.gz

tar zxf nutstore_linux_src_installer.tar.gz

cd nutstore_linux_src_installer && ./configure && make

sudo make install

nautilus -q

./runtime_bootstrap

5.安装nodejs 16.x

他会同时安装npm

# Using Ubuntu
curl -fsSL https://deb.nodesource.com/setup_16.x | sudo -E bash -
sudo apt-get install -y nodejs

6.安装docker

安装依赖:

sudo apt install apt-transport-https ca-certificates curl gnupg-agent software-properties-common

添加key(任选一个,key和源要对应)
阿里的key:

curl -fsSL https://mirrors.aliyun.com/docker-ce/linux/ubuntu/gpg | sudo apt-key add -

官方的key:

curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -

阿里的源:

sudo add-apt-repository \
    "deb [arch=amd64] https://mirrors.aliyun.com/docker-ce/linux/ubuntu \
    $(lsb_release -cs) \
    stable"

sudo apt update
sudo apt install docker-ce

官方的源:

sudo add-apt-repository \
   "deb [arch=amd64] https://download.docker.com/linux/ubuntu \
  $(lsb_release -cs) \
  stable"
  
sudo apt update
sudo apt install docker-ce

以非 Root 用户身份执行 Docker(重启生效):

sudo usermod -aG docker $USER

docker加速:
阿里云docker镜像加速地址:https://cr.console.aliyun.com/cn-hangzhou/instances/mirrors
这里用的时我账号下的加速,你一可以进入上面阿里云官网用你的。

sudo mkdir -p /etc/docker
sudo tee /etc/docker/daemon.json <<-'EOF'
{
  "registry-mirrors": ["https://wvolz47b.mirror.aliyuncs.com"]
}
EOF
sudo systemctl daemon-reload
sudo systemctl restart docker

本机安装portainer:

docker run -d -p 9000:9000 -v /var/run/docker.sock:/var/run/docker.sock --restart=always --name prtainer portainer/portainer

注远程安装:

docker run -d -p 9000:9000 --restart=always --name prtainer portainer/portainer

本机访问就127.0.0.1:9000

卸载docker:

docker container stop $(docker container ls -aq)
docker system prune -a --volumes
sudo apt purge docker-ce
sudo apt autoremove

7.安装jdk1.8

官网:https://www.oracle.com/java/technologies/javase/javase-jdk8-downloads.html

sudo vim /etc/profile

export JAVA_HOME=/usr/local/java/jdk1.8.0_281  # bin目录所在的目录
export JRE_HOME=${JAVA_HOME}/jre
export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib
export PATH=${JAVA_HOME}/bin:$PATH

注意,高版本不设jre,具体自己百度

8.安装vscode

sudo apt update
sudo apt install software-properties-common apt-transport-https wget

wget -q https://packages.microsoft.com/keys/microsoft.asc -O- | sudo apt-key add -

sudo add-apt-repository "deb [arch=amd64] https://packages.microsoft.com/repos/vscode stable main"

sudo apt install code

9.安装adb

sudo apt install android-tools-adb
sudo apt install android-tools-fastboot

10.安装charles

转自https://blog.csdn.net/huuinn/article/details/82762952

wget -q -O - https://www.charlesproxy.com/packages/apt/PublicKey | sudo apt-key add -

sudo sh -c 'echo deb https://www.charlesproxy.com/packages/apt/ charles-proxy main > /etc/apt/sources.list.d/charles.list'

sudo apt-get update

sudo apt-get install charles-proxy

激活:

Registered Name: https://zhile.io
License Key: 48891cf209c6d32bf4

11.状态栏显示系统信息

sudo add-apt-repository ppa:fossfreedom/indicator-sysmonitor -y
sudo apt-get update
sudo apt-get install indicator-sysmonitor
indicator-sysmonitor &

参考https://blog.csdn.net/kan2016/article/details/105763448/

12.安装pip3

sudo apt install python3-pip

13.安装pycharm

历史版本:https://www.jetbrains.com/zh-cn/pycharm/download/other.html

2021.1.3是最后一个自带试用30天的版本

下载解压到你想放的目录后(一般为opt),cd到pycharm的bin目录执行./pycharm.sh进行安装。

创建pycharm快捷启动:
pycharm菜单栏点tools,然后点create desktop

pycharm配置js运行环境:

菜单栏点files–》setings–》plugins–》搜nodejs安装nodejs插件然后点击已安装的nodejs然后点击apply(现在自动识别系统配置的nodejs和npm,不用你再去配置了)

pycharm重置30天试用:

还是在plugins中,点installed后面的设置图标–》点manage plugins–》点加号–》输入

https://plugins.zhile.io

点ok–》搜IDE Eval Reset安装–》同上点apply–》回到菜单栏点help–》点Eval Reset–》选中右下角auto reset–》点Reset

14.安装微信,qq,钉钉等

项目地址:
https://github.com/zq1997/deepin-wine

wget -O- https://deepin-wine.i-m.dev/setup.sh | sh

#安装微信
sudo apt-get install com.qq.weixin.deepin

#安装qq

sudo apt-get install com.qq.im.deepin

#安装钉钉
sudo apt-get install com.dingtalk.deepin

安装完重启才能看到图标
解决微信中文乱码:

sudo vim /opt/deepinwine/tools/run.sh

#正文第六行WINE_CMD 那一行修改为 
WINE_CMD="LC_ALL=zh_CN.UTF-8 deepin-wine"

还是不行的话参考
https://zhuanlan.zhihu.com/p/339286211

微信托盘异常解决:

sudo apt-get install gnome-shell-extension-top-icons-plus gnome-tweaks

上面的我没成功,下面这个我成功把托盘放到顶部了

sudo apt install gnome-shell-extension-top-icons-plus

安装完后点程序菜单,点优化,点拓展启用topicon pius

解决鼠标拖影问题:
这个问题有的机子有,有的没有
点优化–》点外观–》把主题中的所有选项调成默认值,实在不行把里面所有的调整选项的zoom都调整为none,一般来说这个问题是因为优化中的主题中的选项被调整为了非yaru选项,一般重新设置为yaru就行

15.压缩与解压缩

sudo apt install unzip unrar p7zip-full p7zip-rar

16.其他deb或者AppImage安装使用

deb包:

sudo dpkg -i 软件名

AppImage包:

#加权

chmod +x 软件名

#运行
./软件名

AppImage管理软件件:AppImageLauncher
项目地址:https://github.com/TheAssassin/AppImageLauncher
使用方法:下载最新deb包安装即可,不用配置, 默认位置是 $ HOME /应用程序,你也可以选择配置AppImage软件被移动到哪里执行,然后我们下载的AppImage软件你直接双击他就行,他会问你要不要移动到默认路径(改了就是你改的路径)执行,还会问你就执行一次还是一直可以执行,然后你就可以在显示应用程序找到他了,点击图标以后就能直接运行,和windows运行是一样的。

常用软件:

chrome:

https://www.google.com/intl/en_uk/chrome/

edge:

https://www.microsoftedgeinsider.com/zh-cn/

注意,安装完之后要把edge的源删掉,他会造成别的源添加不进来

cd /etc/apt/sources.list.d

然后删除对应的两个源文件即可

xdm:

https://xtremedownloadmanager.com/#downloads

wps:

https://www.wps.cn/product/wpslinux/

telegram:

https://telegram.org/

Motrix:

https://motrix.app/

写盘工具balena:
https://www.balena.io/etcher/

百度云:

https://pan.baidu.com/download

阿里云盘小白羊版:

项目地址:https://github.com/liupan1890/aliyunpan
下载:https://www.aliyundrive.com/s/R1mpvFnSVJE


版权声明:本文为zhangjingzheng原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明。