LNMP环境下,利用Nginx反代Wikipedia

前记

之前一直使用ShadowsocksR代理网络，但是这需要安装软件，还是很麻烦的。

考虑到访问外网的主要需求为维基百科，所以就着手于制作一个维基镜像站。

了解到一共有两种方法，分别为通过Kiwix访问本地存储的ZIM文件和通过Nginx反代wikipedia.org。

前者不仅时效性差还需要占用大量空间，对于我寒酸的服务器来说是个大问题，因此采用了第二个方案。

特别感谢Johnson的指点、网上大佬们的教程，才有了如今这个维基镜像站。

准备

  1. 一台港澳台或国外的VPS
  2. Linux系统（笔者使用的是Ubuntu 18.04 LTS）
  3. LNMP环境（笔者使用的是LNMP 1.6，安装详见LNMP官网）

教程

1. 为已安装的LNMP编译ngx_http_substitutions_filter_module模块

下载ngx_http_substitutions_filter_module模块

cd /root
git clone "https://github.com/yaoweibin/ngx_http_substitutions_filter_module.git"

编辑lnmp.conf文件

vim /root/lnmp1.6/lnmp.conf

在Nginx_Modules_Options一项后的单引号间添加 --add-module=/root/ngx_http_substitutions_filter_module

查看Nginx版本号

nginx -V

安装ngx_http_substitutions_filter_module模块

cd /root/lnmp1.6
./upgrade.sh

选择Update Nginx

在Current Nginx Version中输入你当前的Nginx版本号

不停回车即可

编译结束时，输入nginx -V检查编译

你将看到--add-module=/root/ngx_http_substitutions_filter_module

2.添加vhost

确保相关域名已添加至你的DNS解析服务商

以本站为例，分别为：

wiki.lazybirds.top

*.wiki.lazybirds.top

实际使用的为：

wiki.lazybirds.top

lang.wiki.lazybirds.top

lang.m.wiki.lazybirds.top

up.wiki.lazybirds.top

注意：

将lazybirds.top替换成你自己的域名

将lang替换为你希望添加的维基语言，如en、zh分别对应英文中文维基，下同

新建配置文件

lnmp vhost add

依次添加

wiki.lazybirds.top
www.wiki.lazybirds.top
lang.wiki.lazybirds.top
lang.m.wiki.lazybirds.top
up.wiki.lazybirds.top

路径默认即可

选n直到出现Add SSL Certificate (y/n) 一项，选y

1: Use your Own SSL Certificate and Key 
2: Use Let's Encrypt to create SSL Certificate and Key 
Enter 1 or 2:

然后填2

完成配置即可

3.编辑配置文件

配置wiki.lazybirds.top.conf

vim /usr/local/nginx/conf/vhost/wiki.lazybirds.top.conf

用以下代码覆盖原文件

注意：

将lazybirds.top替换成你自己的域名

server {
    server_name up.wiki.lazybirds.top;
    listen 80;
    listen 443 ssl http2;
    resolver 8.8.8.8;
#    resolver 127.0.0.1 valid=30s;

    ssl_certificate /usr/local/nginx/conf/ssl/wiki.lazybirds.top/fullchain.cer;
    ssl_certificate_key /usr/local/nginx/conf/ssl/wiki.lazybirds.top/wiki.lazybirds.top.key;
    ssl_session_timeout 5m;
    ssl_protocols TLSv1 TLSv1.1 TLSv1.2 TLSv1.3;
    ssl_prefer_server_ciphers on;
    ssl_ciphers "TLS13-AES-256-GCM-SHA384:TLS13-CHACHA20-POLY1305-SHA256:TLS13-AES-128-GCM-SHA256:TLS13-AES-128-CCM-8-SHA256:TLS13-AES-128-CCM-SHA256:EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5";
    ssl_session_cache builtin:1000 shared:SSL:10m;
    # openssl dhparam -out /usr/local/nginx/conf/ssl/dhparam.pem 2048
    ssl_dhparam /usr/local/nginx/conf/ssl/dhparam.pem;
    
    if ($http_x_forwarded_proto = 'http')
    {
        return 301 $server_name$request_uri;
    }

    location / {
        proxy_pass https://upload.wikimedia.org;
        proxy_cookie_domain upload.wikimedia.org up.wiki.lazybirds.top;
        proxy_buffering off;
        proxy_set_header X-Real_IP $remote_addr;
        proxy_set_header User-Agent $http_user_agent;
        proxy_set_header referer "https://upload.wikimedia.org$request_uri";
    }
}

server {
    server_name  wiki.lazybirds.top;
    listen 80;
    listen 443 ssl http2;
    resolver 8.8.8.8;

    ssl_certificate /usr/local/nginx/conf/ssl/wiki.lazybirds.top/fullchain.cer;
    ssl_certificate_key /usr/local/nginx/conf/ssl/wiki.lazybirds.top/wiki.lazybirds.top.key;
    ssl_session_timeout 5m;
    ssl_protocols TLSv1 TLSv1.1 TLSv1.2 TLSv1.3;
    ssl_prefer_server_ciphers on;
    ssl_ciphers "TLS13-AES-256-GCM-SHA384:TLS13-CHACHA20-POLY1305-SHA256:TLS13-AES-128-GCM-SHA256:TLS13-AES-128-CCM-8-SHA256:TLS13-AES-128-CCM-SHA256:EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5";
    ssl_session_cache builtin:1000 shared:SSL:10m;
    # openssl dhparam -out /usr/local/nginx/conf/ssl/dhparam.pem 2048
    ssl_dhparam /usr/local/nginx/conf/ssl/dhparam.pem;
    
    if ($http_x_forwarded_proto = 'http')
    {
        return 301 $server_name$request_uri;
    }

    location / {
        proxy_pass https://www.wikipedia.org;
        proxy_buffering off;

        proxy_redirect https://www.wikipedia.org/ http://wiki.lazybirds.top/;
        proxy_cookie_domain www.wikipedia.org wiki.lazybirds.top;
        proxy_redirect ~^https://([\w\.]+).wikipedia.org/(.*?)$ http://$1.wiki.lazybirds.top/$2;

        proxy_set_header X-Real_IP $remote_addr;
        proxy_set_header User-Agent $http_user_agent;
        proxy_set_header Accept-Encoding '';
        proxy_set_header referer "https://$proxy_host$request_uri";

        subs_filter_types text/css text/xml text/javascript application/javascript application/json;
        subs_filter .wikipedia.org .wiki.lazybirds.top;
        subs_filter //wikipedia.org //wiki.lazybirds.top;
        subs_filter upload.wikimedia.org up.wiki.lazybirds.top;
    }
}

server {
    server_name  ~^(?<subdomain>[^.]+)\.wiki\.ericdrive\.ml$;
    listen 80;
    listen 443 ssl http2;
    resolver 8.8.8.8;

    ssl_certificate /usr/local/nginx/conf/ssl/wiki.lazybirds.top/fullchain.cer;
    ssl_certificate_key /usr/local/nginx/conf/ssl/wiki.lazybirds.top/wiki.lazybirds.top.key;
    ssl_session_timeout 5m;
    ssl_protocols TLSv1 TLSv1.1 TLSv1.2 TLSv1.3;
    ssl_prefer_server_ciphers on;
    ssl_ciphers "TLS13-AES-256-GCM-SHA384:TLS13-CHACHA20-POLY1305-SHA256:TLS13-AES-128-GCM-SHA256:TLS13-AES-128-CCM-8-SHA256:TLS13-AES-128-CCM-SHA256:EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5";
    ssl_session_cache builtin:1000 shared:SSL:10m;
    # openssl dhparam -out /usr/local/nginx/conf/ssl/dhparam.pem 2048
    ssl_dhparam /usr/local/nginx/conf/ssl/dhparam.pem;
    
    if ($http_x_forwarded_proto = 'http')
    {
        return 301 $subdomain.wiki.lazybirds.top$request_uri;
    }

    location / {
        proxy_pass https://$subdomain.wikipedia.org;
        proxy_buffering off;

        proxy_redirect https://$subdomain.wikipedia.org/ http://$subdomain.wiki.lazybirds.top/;
        proxy_redirect https://$subdomain.m.wikipedia.org/ http://$subdomain.m.wiki.lazybirds.top/;
        proxy_cookie_domain $subdomain.wikipedia.org $subdomain.wiki.lazybirds.top;
        proxy_redirect ~^https://([\w\.]+).wikipedia.org/(.*?)$ http://$1.wiki.lazybirds.top/$2;

        proxy_set_header X-Real_IP $remote_addr;
        proxy_set_header User-Agent $http_user_agent;
        proxy_set_header Accept-Encoding ''; 
        proxy_set_header referer "https://$proxy_host$request_uri";

        subs_filter_types text/css text/xml text/javascript application/javascript application/json;
        subs_filter .wikipedia.org .wiki.lazybirds.top;
        subs_filter //wikipedia.org //wiki.lazybirds.top;
        subs_filter 'https://([^.]+).wiki' 'http://$1.wiki' igr; 
        subs_filter upload.wikimedia.org up.wiki.lazybirds.top;
    }
}

server {
    server_name ~^(?<subdomain>[^.]+)\.m\.wiki\.ericdrive\.ml$;
    listen 80;
    listen 443 ssl http2;
    resolver 8.8.8.8;

    ssl_certificate /usr/local/nginx/conf/ssl/wiki.lazybirds.top/fullchain.cer;
    ssl_certificate_key /usr/local/nginx/conf/ssl/wiki.lazybirds.top/wiki.lazybirds.top.key;
    ssl_session_timeout 5m;
    ssl_protocols TLSv1 TLSv1.1 TLSv1.2 TLSv1.3;
    ssl_prefer_server_ciphers on;
    ssl_ciphers "TLS13-AES-256-GCM-SHA384:TLS13-CHACHA20-POLY1305-SHA256:TLS13-AES-128-GCM-SHA256:TLS13-AES-128-CCM-8-SHA256:TLS13-AES-128-CCM-SHA256:EECDH+CHACHA20:EECDH+CHACHA20-draft:EECDH+AES128:RSA+AES128:EECDH+AES256:RSA+AES256:EECDH+3DES:RSA+3DES:!MD5";
    ssl_session_cache builtin:1000 shared:SSL:10m;
    # openssl dhparam -out /usr/local/nginx/conf/ssl/dhparam.pem 2048
    ssl_dhparam /usr/local/nginx/conf/ssl/dhparam.pem;
    
    if ($http_x_forwarded_proto = 'http')
    {
        return 301 $subdomain.m.wiki.lazybirds.top$request_uri;
    }

    location / {
        proxy_pass https://$subdomain.m.wikipedia.org;
        proxy_buffering off;

        proxy_redirect https://$subdomain.m.wikipedia.org/ http://$subdomain.m.wiki.lazybirds.top/;
        proxy_cookie_domain $subdomain.m.wikipedia.org $subdomain.m.wiki.lazybirds.top;

        proxy_set_header X-Real_IP $remote_addr;
        proxy_set_header User-Agent $http_user_agent;
        proxy_set_header Accept-Encoding ''; 
        proxy_set_header referer "https://$proxy_host$request_uri";

        subs_filter_types text/css text/xml text/javascript application/javascript application/json;
        subs_filter .wikipedia.org .wiki.lazybirds.top;
        subs_filter //wikipedia.org //wiki.lazybirds.top;
        subs_filter 'https://([^.]+).m.wiki' 'http://$1.m.wiki' igr; 
        subs_filter upload.wikimedia.org up.wiki.lazybirds.top;
    }
}

4.重启Nginx

lnmp nginx restart

发表评论

%d 博主赞过：