February 2023 – 一江春水向东流

webmin安装及模块proftpd

在arm kylin服务器上安装webmin 1 官网下载最新的webmin-2.013.tar.gz，并解压到/usr/local/webmin/ 2 运行/usr/local/webmin/setup.sh 安装proftpd：下载和编译安装proftpd:

wget ftp://ftp.proftpd.org/distrib/source/proftpd-1.3.8.tar.gz
tar -zxvf proftpd-1.3.8.tar.gz
cd proftpd-1.3.8
./configure --prefix=/usr/local/proftpd --sysconfdir=/usr/local/proftpd
make  && make install

wget ftp://ftp.proftpd.org/distrib/source/proftpd-1.3.8.tar.gz

tar -zxvf proftpd-1.3.8.tar.gz

cd proftpd-1.3.8

./configure --prefix=/usr/local/proftpd --sysconfdir=/usr/local/proftpd

make && make install

编写service启动文件：

[root@installer55 proftpd-1.3.8]# cat /usr/lib/systemd/system/proftpd.service 
[Unit]
Description = ProFTPD FTP Server
After = network.target nss-lookup.target local-fs.target remote-fs.target

[Service]
Type = forking
PIDFile = /usr/local/proftpd/var/proftpd.pid
Environment = PROFTPD_OPTIONS=
EnvironmentFile = -/etc/sysconfig/proftpd
ExecStart = /usr/sbin/proftpd $PROFTPD_OPTIONS
ExecReload = /bin/kill -HUP $MAINPID

[Install]
WantedBy = multi-user.target

[root@installer55 proftpd-1.3.8]# cat /usr/lib/systemd/system/proftpd.service

[Unit]

Description = ProFTPD FTP Server

After = network.target nss-lookup.target local-fs.target remote-fs.target

[Service]

Type = forking

PIDFile = /usr/local/proftpd/var/proftpd.pid

Environment = PROFTPD_OPTIONS=

EnvironmentFile = -/etc/sysconfig/proftpd

ExecStart = /usr/sbin/proftpd $PROFTPD_OPTIONS

ExecReload = /bin/kill -HUP $MAINPID

[Install]

WantedBy = multi-user.target

启动和错误处理

1、启动
  systemctl start proftpd
2、启动会报错
  这里报错：- Fatal: Group: Unknown group &#39;nogroup&#39;.
3、处理修改配置文件
   vi /usr/local/proftpd/proftpd.conf
   --修改前
   # Set the user and group under which the server will run.
  User                             nobody
  Group                            nogroup
  --修改后
  # Set the user and group under which the server will run.
  User                             nobody
  Group                            nobody
4、再次启动即可

1、启动

systemctl start proftpd

2、启动会报错

这里报错：- Fatal: Group: Unknown group 'nogroup'.

3、处理修改配置文件

vi /usr/local/proftpd/proftpd.conf

--修改前

# Set the user and group under which the server will run.

User nobody

Group nogroup

--修改后

# Set the user and group under which the server will run.

User nobody

Group nobody

4、再次启动即可

配置用户及目录

1、建目录和用户
  建立目录 mkdir -p /data/
  建立用户 useradd -d /data/ftp -s /sbin/nologin ftp_user
  配置密码 echo ftp_user|passwd --stdin ftp_user
 修改权限 chown -R ftp_user:ftp_user /data/ftp
2、添加配置文件，在配置文件末尾添加如下代码
 vi /usr/local/proftpd/proftpd.conf
  <Directory /data/ftp>
     HideNoAccess off
      <Limit STOR MKD>
       Order deny,allow
       allowUser  ftp_user
      </Limit>
  </Directory>

3、重启服务 

4、登录ftp查看
可以在windows文件管理器里打开ftp://x.x.x.x/
可以用wget命令下载：
wget -nH -m -r --ftp-user=ftp_user --ftp-password='ftp_user'  ftp://x.x.x.x/aarch64-kylin/20230224/a.txt

1、建目录和用户

建立目录 mkdir -p /data/

建立用户 useradd -d /data/ftp -s /sbin/nologin ftp_user

配置密码 echo ftp_user|passwd --stdin ftp_user

修改权限 chown -R ftp_user:ftp_user /data/ftp

2、添加配置文件，在配置文件末尾添加如下代码

vi /usr/local/proftpd/proftpd.conf

HideNoAccess off

Order deny,allow

allowUser ftp_user

</Limit>

</Directory>

3、重启服务

4、登录ftp查看

可以在windows文件管理器里打开ftp://x.x.x.x/

可以用wget命令下载：

wget -nH -m -r --ftp-user=ftp_user --ftp-password='ftp_user' ftp://x.x.x.x/aarch64-kylin/20230224/a.txt

登录报错： Invalid shell: ‘/usr/sbin/nologin’ 解决： vim /etc/shells 结尾添加： /usr/sbin/nologin /sbin/nologin 下载安装proftpd webmin模块： 2 wget https://download.webmin.com/download/modules/proftpd.wbm.gz 2 打开webmin页面上的模块管理，从页面上选择服务器路径进行模块安装

By sean, 2 years02/24/2023 ago

OS

WSL报：The attempted operation is not supported for the type of object referenced

在windows上打开wsl ubuntu的时候，报错： The attempted operation is not supported for the type of object referenced. 解决方式：需要在注册表添加一个key 创建一个名为wsl2.reg（或任何其他带有 .reg 后缀的文件名）的文件在中打开此文件notepad.exe，将下面的文本粘贴到其中。保存存档。双击这个文件，给它Administrator权限打开wsl.exe wsl2.reg 代码，我从这个问题复制

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\WinSock2\Parameters\AppId_Catalog\0408F7A3]
"AppFullPath"="C:\\\\windows\\\\system32\\\\wsl.exe"
"PermittedLspCategories"=dword:80000000

Windows Registry Editor Version 5.00

[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\WinSock2\Parameters\AppId_Catalog\0408F7A3]

"AppFullPath"="C:\\\\windows\\\\system32\\\\wsl.exe"

"PermittedLspCategories"=dword:80000000

或者你可以wsl2.reg直接下载我的： https://baijifeilong.github.io/wsl2.reg 参考： https://jon.sprig.gs/blog/post/2140 https://github.com/microsoft/WSL/issues/4177

By sean, 2 years02/23/2023 ago

OS

vim使用动图

By sean, 2 years ago

MIDDLEWARE

Jenkinsfile配置submodule

最近在搞Jenkinsfile进行项目自动构建，有一个项目配置了远程子模块依赖，遇到了很多问题，如下是尝试的步骤： 1, 利用checkbox

    stages {
        stage('拉取代码'){
            steps {
                  checkout([
                    $class: 'GitSCM', 
                    branches: [[name: "${params.xxx_branch}"]], 
                    doGenerateSubmoduleConfigurations: false, 
                    extensions: [[
                      $class: 'SubmoduleOption',
                      disableSubmodules: false,
                      parentCredentials: true,
                      recursiveSubmodules: true,
                      reference: '',
                      trackingSubmodules: false
                  ]],
                    submoduleCfg: [], 
                    userRemoteConfigs: [[credentialsId: "${git_auth}", url: "${xxx_git_address}"]]
                  ])
            }
        }

stages {

stage('拉取代码'){

steps {

checkout([

$class: 'GitSCM',

branches: [[name: "${params.xxx_branch}"]],

doGenerateSubmoduleConfigurations: false,

extensions: [[

$class: 'SubmoduleOption',

disableSubmodules: false,

parentCredentials: true,

recursiveSubmodules: true,

reference: '',

trackingSubmodules: false

]],

submoduleCfg: [],

userRemoteConfigs: [[credentialsId: "${git_auth}", url: "${xxx_git_address}"]]

])

}

报错：

Caused: java.io.IOException: Could not perform submodule update

1	Caused: java.io.IOException: Could not perform submodule update

2. 尝试配置公钥认证

stage('构建'){
  steps {
      container (JOB_NAME) {
        withCredentials([
          sshUserPrivateKey(credentialsId: 'jenkins_server_pri_key', keyFileVariable: 'SSH_KEY')
          ]) {
          sh 'GIT_SSH_COMMAND="ssh -i $SSH_KEY" git submodule update --init --recursive'

stage('构建'){

steps {

container (JOB_NAME) {

withCredentials([

sshUserPrivateKey(credentialsId: 'jenkins_server_pri_key', keyFileVariable: 'SSH_KEY')

]) {

sh 'GIT_SSH_COMMAND="ssh -i $SSH_KEY" git submodule update --init --recursive'

报错：

+ GIT_SSH_COMMAND=ssh -i **** git submodule update --init --recursive
fatal: detected dubious ownership in repository at '/home/jenkins/agent/workspace/xxx-nginx-downloads'
To add an exception for this directory, call:

	git config --global --add safe.directory /home/jenkins/agent/workspace/xxx-nginx-downloads

+ GIT_SSH_COMMAND=ssh -i **** git submodule update --init --recursive

fatal: detected dubious ownership in repository at '/home/jenkins/agent/workspace/xxx-nginx-downloads'

To add an exception for this directory, call:

git config --global --add safe.directory /home/jenkins/agent/workspace/xxx-nginx-downloads

需要增加 git config –global –add safe.directory ${WORKSPACE} 报错：

+ GIT_SSH_COMMAND='ssh -i ****'
+ git config --global --add safe.directory /home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads
+ git submodule update --init --recursive
Submodule 'xx-plugin' (http://git.xxx.com/xxx/xxx-plugin) registered for path 'xxx-plugin'
Submodule 'xxx-downloader' (http://git.xxx.com/xxx/xxx-downloader.git) registered for path 'xxx-downloader'
Cloning into '/home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads/xxx-plugin'...
fatal: could not read Username for 'http://git.xxx.com': No such device or address
fatal: clone of 'http://git.xxx.com/iUAP_gPaaS/xxx-plugin' into submodule path '/home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads/xxx-plugin' failed
Failed to clone 'xxx-plugin'. Retry scheduled

+ GIT_SSH_COMMAND='ssh -i ****'

+ git config --global --add safe.directory /home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads

+ git submodule update --init --recursive

Submodule 'xx-plugin' (http://git.xxx.com/xxx/xxx-plugin) registered for path 'xxx-plugin'

Submodule 'xxx-downloader' (http://git.xxx.com/xxx/xxx-downloader.git) registered for path 'xxx-downloader'

Cloning into '/home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads/xxx-plugin'...

fatal: could not read Username for 'http://git.xxx.com': No such device or address

fatal: clone of 'http://git.xxx.com/iUAP_gPaaS/xxx-plugin' into submodule path '/home/jenkins/agent/workspace/plugin-xxx-cluster-nginx-downloads/xxx-plugin' failed

Failed to clone 'xxx-plugin'. Retry scheduled

3. 重新添加覆盖 .gitmodules

stage('构建'){
  steps {
      container (JOB_NAME) {
        withCredentials([
          usernamePassword(credentialsId: "${git_auth}", passwordVariable: 'git_password', usernameVariable: 'git_username'),
          ]) {
          sh '''#!/bin/bash
            set -ex
            git config --global --add safe.directory ${WORKSPACE}
            git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/xxx-plugin xxx-plugin || true
            git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/api-station.git api-station || true
            git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/xxx-downloader.git xxx-downloader || true
            cat .gitmodules
            git submodule update --init --recursive

stage('构建'){

steps {

container (JOB_NAME) {

withCredentials([

usernamePassword(credentialsId: "${git_auth}", passwordVariable: 'git_password', usernameVariable: 'git_username'),

]) {

sh '''#!/bin/bash

set -ex

git config --global --add safe.directory ${WORKSPACE}

git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/xxx-plugin xxx-plugin || true

git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/api-station.git api-station || true

git submodule add -f http://$git_username:$git_password@git.xxx.com/xxx/xxx-downloader.git xxx-downloader || true

cat .gitmodules

git submodule update --init --recursive

报错： fatal: could not read Username for ‘http://git.xxx.com‘: No such device or address 4. 修改.gitmodules 下面是原来的

$ cat .gitmodules
[submodule "xxx-plugin"]
        path = xxx-plugin
        url = http://git.xxx.com/xxx/xxx-plugin
[submodule "api-station"]
        path = api-station
        url = http://git.xxx.com/xxx/api-station.git
[submodule "xxx-downloader"]
        path = xxx-downloader
        url = http://git.xxx.com/xxx/xxx-downloader.git

$ cat .gitmodules

[submodule "xxx-plugin"]

path = xxx-plugin

url = http://git.xxx.com/xxx/xxx-plugin

[submodule "api-station"]

path = api-station

url = http://git.xxx.com/xxx/api-station.git

[submodule "xxx-downloader"]

path = xxx-downloader

url = http://git.xxx.com/xxx/xxx-downloader.git

通过sed进行修改

stage('构建'){
      steps {
          container (JOB_NAME) {
            withCredentials([
              usernamePassword(credentialsId: "${git_auth}", passwordVariable: 'git_password', usernameVariable: 'git_username'),
              usernamePassword(credentialsId: "${webmin_auth}", passwordVariable: 'webmin_password', usernameVariable: 'webmin_username')
              ]) {
              sh '''#!/bin/bash
                set -ex
                git config --global --add safe.directory ${WORKSPACE}
                git config --global --add safe.directory ${WORKSPACE}/xxx-plugin
                git config --global --add safe.directory ${WORKSPACE}/api-station
                git config --global --add safe.directory ${WORKSPACE}/xxx-downloader
                sed -i -E "s/(^\\s*.url = http:\\/\\/)(.*)$/\\1$git_username:$git_password@\\2/g" .gitmodules
                cat .gitmodules
                git submodule update --init --recursive

stage('构建'){

steps {

container (JOB_NAME) {

withCredentials([

usernamePassword(credentialsId: "${git_auth}", passwordVariable: 'git_password', usernameVariable: 'git_username'),

usernamePassword(credentialsId: "${webmin_auth}", passwordVariable: 'webmin_password', usernameVariable: 'webmin_username')

]) {

sh '''#!/bin/bash

set -ex

git config --global --add safe.directory ${WORKSPACE}

git config --global --add safe.directory ${WORKSPACE}/xxx-plugin

git config --global --add safe.directory ${WORKSPACE}/api-station

git config --global --add safe.directory ${WORKSPACE}/xxx-downloader

sed -i -E "s/(^\\s*.url = http:\\/\\/)(.*)$/\\1$git_username:$git_password@\\2/g" .gitmodules

cat .gitmodules

git submodule update --init --recursive

最后拉取成功。有时间再细细研究原因

By sean, 2 years02/21/2023 ago

HANDBOOK

调用webmin上传下载文件

需求：构建的包需要上传到文件服务器上，需要从文件服务器上进行下载可以搭建一个webmin服务，既有UI界面，又可以通过模拟调用接口进行上传下载操作一安装通过yum安装：

# 安装依赖
yum install perl-Crypt-Blowfish perl-Crypt-CBC perl-Crypt-Rijndael perl-Digest-SHA perl-Expect perl-Gtk2 perl-IO-Stty perl-Net-ARP perl-YAML perl-Cairo perl-Glib perl-IO-Tty perl-Pango uuid-perl
curl -o setup-repos.sh https://raw.githubusercontent.com/webmin/webmin/master/setup-repos.sh
bash setup-repos.sh
yum install webmin

# 安装依赖

yum install perl-Crypt-Blowfish perl-Crypt-CBC perl-Crypt-Rijndael perl-Digest-SHA perl-Expect perl-Gtk2 perl-IO-Stty perl-Net-ARP perl-YAML perl-Cairo perl-Glib perl-IO-Tty perl-Pango uuid-perl

curl -o setup-repos.sh https://raw.githubusercontent.com/webmin/webmin/master/setup-repos.sh

bash setup-repos.sh

yum install webmin

也可以通过下载安装包安装，适用于国产操作系统，因为官方安装脚本不支持kylin等系统

wget https://jaist.dl.sourceforge.net/project/webadmin/webmin/2.013/webmin-2.013.tar.gz
tar -zxPf webmin-2.013.tar.gz -C /usr/local/webmin --strip-components 1
/usr/local/webmin/setup.sh

wget https://jaist.dl.sourceforge.net/project/webadmin/webmin/2.013/webmin-2.013.tar.gz

tar -zxPf webmin-2.013.tar.gz -C /usr/local/webmin --strip-components 1

/usr/local/webmin/setup.sh

配置：

/etc/webmin/config：
referers_none=0  # 可以不需要传referers而访问
gotomodule=filemin # 默认进filemin模块
gotoone=1 # 当用户默认只有一个模块时，直接进入

/etc/webmin/config：

referers_none=0 # 可以不需要传referers而访问

gotomodule=filemin # 默认进filemin模块

gotoone=1 # 当用户默认只有一个模块时，直接进入

上传下载：

server=http://x.x.x.x:10000
user='xxx'
pass='xxx'
file=/data/test.tar.gz
# 生成cookie，用来登录
curl -c 'cookie.txt' -k $server/session_login.cgi -d user=$user -d pass=$pass -H 'Cookie: testing=1'
#下载方式1：
curl -O -b 'cookie.txt' --progress-bar "$server/updown/fetch.cgi$file"
# 下载方式2：
curl -b 'cookie.txt' --progress-bar "$server/filemin/download.cgi?file=/z-md5.txt&path=/aarch64-kylin/20220430/" -o z-md5.txt
# 可以加下载失败重试：
export ec=18; while [ $ec -eq 18 ]; do curl -b 'cookie.txt' --progress-bar "$server/filemin/download.cgi?file=/z-md5.txt&path=/aarch64-kylin/20220430/" -o z-md5.txt; export ec=$?; done

# 上传
curl -X POST -b 'cookie.txt' --progress-bar -F 'filename=@/tmp/sean.txt'  "$server/filemin/upload.cgi?path=/"

server=http://x.x.x.x:10000

user='xxx'

pass='xxx'

file=/data/test.tar.gz

# 生成cookie，用来登录

curl -c 'cookie.txt' -k $server/session_login.cgi -d user=$user -d pass=$pass -H 'Cookie: testing=1'

#下载方式1：

curl -O -b 'cookie.txt' --progress-bar "$server/updown/fetch.cgi$file"

# 下载方式2：

curl -b 'cookie.txt' --progress-bar "$server/filemin/download.cgi?file=/z-md5.txt&path=/aarch64-kylin/20220430/" -o z-md5.txt

# 可以加下载失败重试：

export ec=18; while [ $ec -eq 18 ]; do curl -b 'cookie.txt' --progress-bar "$server/filemin/download.cgi?file=/z-md5.txt&path=/aarch64-kylin/20220430/" -o z-md5.txt; export ec=$?; done

# 上传

curl -X POST -b 'cookie.txt' --progress-bar -F 'filename=@/tmp/sean.txt' "$server/filemin/upload.cgi?path=/"

By sean, 2 years02/13/2023 ago

KUBERNETES

使用 GitHub Actions 编译 kubernetes 组件

在使用 kubernetes 过程中由于某些需求往往要修改一下 k8s 官方的源码，然后重新编译才行。本文就以修改 kubeadm 生成证书为默认 10 年为例，来讲解如何使用 GitHub Actions 来编译和发布生成的二进制文件。构建 clone repo 将 kubernetes 官方源码 fork 到自己的 repo 中

$ git clone https://github.com/rainingwalk/kubernetes.git 
$ cd kubernetes 
$ git remote add upstream https://github.com/kubernetes/kubernetes.git 
$ git fetch --all 
$ git checkout upstream/release-1.21 
$ git checkout -B kubeadm-1.21

$ git clone https://github.com/rainingwalk/kubernetes.git

$ cd kubernetes

$ git remote add upstream https://github.com/kubernetes/kubernetes.git

$ git fetch --all

$ git checkout upstream/release-1.21

$ git checkout -B kubeadm-1.21

workflow .github/workflows/kubeadm.yaml

---
name: Build kubeadm binary

on:
  push:
    tag:
      - 'v*'
jobs:
  build:
    runs-on: ubuntu-20.04
    # 使此git action在release时有写权限，不然会报GitHub release failed with status: 403 undefined
    permissions:
      contents: write
    # 这里我们选择以 tag 的方式触发 job 的运行
    if: startsWith(github.ref, 'refs/tags/')
    steps:
      - name: Checkout
        uses: actions/checkout@v2

      # 运行 build/run.sh 构建脚本来编译相应平台上的二进制文件
      - name: Build kubeadm binary
        shell: bash
        run: |
          bash -x build/run.sh make kubeadm KUBE_BUILD_PLATFORMS=linux/amd64
          bash -x build/run.sh make kubeadm KUBE_BUILD_PLATFORMS=linux/arm64

      # 构建好的二进制文件存放在 _output/dockerized/bin/ 中
      # 我们根据二进制目标文件的系统名称+CPU体系架构名称进行命名
      - name: Prepare for upload
        shell: bash
        run: |
          mv _output/dockerized/bin/linux/amd64/kubeadm kubeadm-linux-amd64
          mv _output/dockerized/bin/linux/arm64/kubeadm kubeadm-linux-arm64
          sha256sum kubeadm-linux-{amd64,arm64} > sha256sum.txt
          
      # 使用 softprops/action-gh-release 来将构建产物上传到 GitHub release 当中
      - name: Release and upload packages
        uses: softprops/action-gh-release@v1
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
        with:
          files: |
            sha256sum.txt
            kubeadm-linux-amd64
            kubeadm-linux-arm64

---

name: Build kubeadm binary

on:

push:

tag:

- 'v*'

jobs:

build:

runs-on: ubuntu-20.04

# 使此git action在release时有写权限，不然会报GitHub release failed with status: 403 undefined

permissions:

contents: write

# 这里我们选择以 tag 的方式触发 job 的运行

if: startsWith(github.ref, 'refs/tags/')

steps:

- name: Checkout

uses: actions/checkout@v2

# 运行 build/run.sh 构建脚本来编译相应平台上的二进制文件

- name: Build kubeadm binary

shell: bash

run: |

bash -x build/run.sh make kubeadm KUBE_BUILD_PLATFORMS=linux/amd64

bash -x build/run.sh make kubeadm KUBE_BUILD_PLATFORMS=linux/arm64

# 构建好的二进制文件存放在 _output/dockerized/bin/ 中

# 我们根据二进制目标文件的系统名称+CPU体系架构名称进行命名

- name: Prepare for upload

shell: bash

run: |

mv _output/dockerized/bin/linux/amd64/kubeadm kubeadm-linux-amd64

mv _output/dockerized/bin/linux/arm64/kubeadm kubeadm-linux-arm64

sha256sum kubeadm-linux-{amd64,arm64} > sha256sum.txt

# 使用 softprops/action-gh-release 来将构建产物上传到 GitHub release 当中

- name: Release and upload packages

uses: softprops/action-gh-release@v1

env:

GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

with:

files: |

sha256sum.txt

kubeadm-linux-amd64

kubeadm-linux-arm64

build/run.sh : Run a command in a build docker container. Common invocations: build/run.sh make: Build just linux binaries in the container. Pass options and Read more…

By sean, 2 years02/06/2023 ago