ubutu tornado python3.7.5 nginx supervisor 部署web api
程序员文章站
2022-03-07 16:03:19
环境： 1、Ubuntu 服务器 2、python3.7.5 安装 1、python3.7.5 安装的话还是比较简单，流程大致是./configure ->make && make install ->创建python软连接 pip软连接 安装起来倒是简单，安装完成运行才会遇到各种各样的问题，缺少插 ......
环境：
1、ubuntu 服务器
2、python3.7.5
安装
1、python3.7.5
安装的话还是比较简单，流程大致是
./configure ->make && make install ->创建python软连接 pip软连接
安装起来倒是简单，安装完成运行才会遇到各种各样的问题，缺少插件啥的。
1.1、下载包 python3.7.5
1.2、问题
a、no module named '_ctypes'
sudo apt-get install libffi-dev 需不需要重新安装看ok不
b、no module named _ssl
安装之前修改下安装包里面的modules里面的setup.dist文件的内容
ex: /usr/web/tornadotest/package/python-3.7.5/modules/setup.dist 我的安装目录
大约 206行左右，去掉注释即可
然后再重新安装，等pip这些可以用起来了在开始下一步。
2、安装所需的package
需要的包有mysqldb tornado torndb，看你用的是pymysql还是mysqldb
2.1 普通安装 pip install
2.2 mysqldb 安装
安装mysqldb 之前需要配置mysql_config
sudo apt-get install libmysqlclient-dev
sudo apt-get install python-dev
然后安装。
3、启动错误
3.1 torndb的错误
if mysqldb is not none:
# fix the access conversions to properly recognize unicode/binary
field_type = mysqldb.constants.field_type
flag = mysqldb.constants.flag
conversions = copy.copy(mysqldb.converters.conversions)
field_types = [field_type.blob, field_type.string, field_type.var_string]
if 'varchar' in vars(field_type):
field_types.append(field_type.varchar)
#for field_type in field_types:
# conversions[field_type] = [(flag.binary, str)] + conversions[field_type]
注释掉这个
3.2 然后启动成功查询数据时可能还会原道这种错误。
https://www.cnblogs.com/simplezhuo/p/9811369.html
4、nginx 配置
4.1、tornado服务可以运行
python server.py --port 8888
nohup python server.py 登出也不会停止。
4.2、配置
default.conf
##
# you should look at the following url's in order to grasp a solid understanding
# of nginx configuration files in order to fully unleash the power of nginx.
# http://wiki.nginx.org/pitfalls
# http://wiki.nginx.org/quickstart
# http://wiki.nginx.org/configuration
#
# generally, you will want to move this file somewhere, and start with a clean
# file but keep this around for reference. or just disable in sites-enabled.
#
# please see /usr/share/doc/nginx-doc/examples/ for more detailed examples.
##
# default server configuration
#
upstream tornados{
server 127.0.0.1:8888;
}
proxy_next_upstream error;
server {
listen 80 default_server;
listen [::]:80 default_server;
# ssl configuration
#
# listen 443 ssl default_server;
# listen [::]:443 ssl default_server;
#
# note: you should disable gzip for ssl traffic.
# see: https://bugs.debian.org/773332
#
# read up on ssl_ciphers to ensure a secure configuration.
# see: https://bugs.debian.org/765782
#
# self signed certs generated by the ssl-cert package
# don't use them in a production server!
#
# include snippets/snakeoil.conf;
# add index.php to the list if you are using php
index index.html index.htm index.nginx-debian.html;
server_name 111.231.201.164;
location /cnc/1/ {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/2/ {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/3 {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/4 {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/5 {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/6 {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /cnc/7 {
alias /usr/web/cnc/;
index index.html index.htm;
}
location /api/{
allow 111.231.201.164;
proxy_pass_header server;
proxy_set_header host $http_host;
proxy_redirect off;
proxy_set_header x-real-ip $remote_addr;
proxy_set_header x-forwarded-for $proxy_add_x_forwarded_for;
proxy_set_header x-scheme $scheme;
proxy_pass http://127.0.0.1:8888/;
}
# pass the php scripts to fastcgi server listening on 127.0.0.1:9000
#
#location ~ \.php$ {
# include snippets/fastcgi-php.conf;
#
# # with php7.0-cgi alone:
# fastcgi_pass 127.0.0.1:9000;
# # with php7.0-fpm:
# fastcgi_pass unix:/run/php/php7.0-fpm.sock;
#}
# deny access to .htaccess files, if apache's document root
# concurs with nginx's one
#
#location ~ /\.ht {
# deny all;
#}
}
# virtual host configuration for example.com
#
# you can move that to a different file under sites-available/ and symlink that
# to sites-enabled/ to enable it.
#
#server {
# listen 80;
# listen [::]:80;
#
# server_name example.com;
#
# root /var/www/example.com;
# index index.html;
#
# location / {
# try_files $uri $uri/ =404;
# }
#}
现在就是把tornado的服务127.0.0.1:8888 挂载在了80端口+api/上
原始访问：
现在：
5、supervisor 配置
5.1、安装supervisor
sudo apt-get install supervisor
创建配置文件
echo_supervisord_conf > /etc/supervisord.conf
; sample supervisor config file.
;
; for more information on the config file, please see:
; http://supervisord.org/configuration.html
;
; notes:
; - shell expansion ("~" or "$home") is not supported. environment
; variables can be expanded using this syntax: "%(env_home)s".
; - quotes around values are not supported, except in the case of
; the environment= options as shown below.
; - comments must have a leading space: "a=b ;comment" not "a=b;comment".
; - command will be truncated if it looks like a config file comment, e.g.
; "command=bash -c 'foo ; bar'" will truncate to "command=bash -c 'foo ".
;
; warning:
; paths throughout this example file use /tmp because it is available on most
; systems. you will likely need to change these to locations more appropriate
; for your system. some systems periodically delete older files in /tmp.
; notably, if the socket file defined in the [unix_http_server] section below
; is deleted, supervisorctl will be unable to connect to supervisord.
[unix_http_server]
file=/tmp/supervisor.sock ; the path to the socket file
;chmod=0700 ; socket file mode (default 0700)
;chown=nobody:nogroup ; socket file uid:gid owner
;username=user ; default is no username (open server)
;password=123 ; default is no password (open server)
; security warning:
; the inet http server is not enabled by default. the inet http server is
; enabled by uncommenting the [inet_http_server] section below. the inet
; http server is intended for use within a trusted environment only. it
; should only be bound to localhost or only accessible from within an
; isolated, trusted network. the inet http server does not support any
; form of encryption. the inet http server does not use authentication
; by default (see the username= and password= options to add authentication).
; never expose the inet http server to the public internet.
;[inet_http_server] ; inet (tcp) server disabled by default
;port=127.0.0.1:9001 ; ip_address:port specifier, *:port for all iface
;username=user ; default is no username (open server)
;password=123 ; default is no password (open server)
[supervisord]
logfile=/tmp/supervisord.log ; main log file; default $cwd/supervisord.log
logfile_maxbytes=50mb ; max main logfile bytes b4 rotation; default 50mb
logfile_backups=10 ; # of main logfile backups; 0 means none, default 10
loglevel=info ; log level; default info; others: debug,warn,trace
pidfile=/tmp/supervisord.pid ; supervisord pidfile; default supervisord.pid
nodaemon=false ; start in foreground if true; default false
minfds=1024 ; min. avail startup file descriptors; default 1024
minprocs=200 ; min. avail process descriptors;default 200
;umask=022 ; process file creation umask; default 022
;user=supervisord ; setuid to this unix account at startup; recommended if root
;identifier=supervisor ; supervisord identifier, default is 'supervisor'
;directory=/tmp ; default is not to cd during start
;nocleanup=true ; don't clean up tempfiles at start; default false
;childlogdir=/tmp ; 'auto' child log dir, default $temp
;environment=key="value" ; key value pairs to add to environment
;strip_ansi=false ; strip ansi escape codes in logs; def. false
; the rpcinterface:supervisor section must remain in the config file for
; rpc (supervisorctl/web interface) to work. additional interfaces may be
; added by defining them in separate [rpcinterface:x] sections.
[rpcinterface:supervisor]
supervisor.rpcinterface_factory = supervisor.rpcinterface:make_main_rpcinterface
; the supervisorctl section configures how supervisorctl will connect to
; supervisord. configure it match the settings in either the unix_http_server
; or inet_http_server section.
[supervisorctl]
serverurl=unix:///tmp/supervisor.sock ; use a unix:// url for a unix socket
;serverurl=http://127.0.0.1:9001 ; use an http:// url to specify an inet socket
;username=chris ; should be same as in [*_http_server] if set
;password=123 ; should be same as in [*_http_server] if set
;prompt=mysupervisor ; cmd line prompt (default "supervisor")
;history_file=~/.sc_history ; use readline history if available
; the sample program section below shows all possible program subsection values.
; create one or more 'real' program: sections to be able to control them under
; supervisor.
;[program:theprogramname]
;command=/bin/cat ; the program (relative uses path, can take args)
;process_name=%(program_name)s ; process_name expr (default %(program_name)s)
;numprocs=1 ; number of processes copies to start (def 1)
;directory=/tmp ; directory to cwd to before exec (def no cwd)
;umask=022 ; umask for process (default none)
;priority=999 ; the relative start priority (default 999)
;autostart=true ; start at supervisord start (default: true)
;startsecs=1 ; # of secs prog must stay up to be running (def. 1)
;startretries=3 ; max # of serial start failures when starting (default 3)
;autorestart=unexpected ; when to restart if exited after running (def: unexpected)
;exitcodes=0 ; 'expected' exit codes used with autorestart (default 0)
;stopsignal=quit ; signal used to kill process (default term)
;stopwaitsecs=10 ; max num secs to wait b4 sigkill (default 10)
;stopasgroup=false ; send stop signal to the unix process group (default false)
;killasgroup=false ; sigkill the unix process group (def false)
;user=chrism ; setuid to this unix account to run the program
;redirect_stderr=true ; redirect proc stderr to stdout (default false)
;stdout_logfile=/a/path ; stdout log path, none for none; default auto
;stdout_logfile_maxbytes=1mb ; max # logfile bytes b4 rotation (default 50mb)
;stdout_logfile_backups=10 ; # of stdout logfile backups (0 means none, default 10)
;stdout_capture_maxbytes=1mb ; number of bytes in 'capturemode' (default 0)
;stdout_events_enabled=false ; emit events on stdout writes (default false)
;stdout_syslog=false ; send stdout to syslog with process name (default false)
;stderr_logfile=/a/path ; stderr log path, none for none; default auto
;stderr_logfile_maxbytes=1mb ; max # logfile bytes b4 rotation (default 50mb)
;stderr_logfile_backups=10 ; # of stderr logfile backups (0 means none, default 10)
;stderr_capture_maxbytes=1mb ; number of bytes in 'capturemode' (default 0)
;stderr_events_enabled=false ; emit events on stderr writes (default false)
;stderr_syslog=false ; send stderr to syslog with process name (default false)
;environment=a="1",b="2" ; process environment additions (def no adds)
;serverurl=auto ; override serverurl computation (childutils)
; the sample eventlistener section below shows all possible eventlistener
; subsection values. create one or more 'real' eventlistener: sections to be
; able to handle event notifications sent by supervisord.
;[eventlistener:theeventlistenername]
;command=/bin/eventlistener ; the program (relative uses path, can take args)
;process_name=%(program_name)s ; process_name expr (default %(program_name)s)
;numprocs=1 ; number of processes copies to start (def 1)
;events=event ; event notif. types to subscribe to (req'd)
;buffer_size=10 ; event buffer queue size (default 10)
;directory=/tmp ; directory to cwd to before exec (def no cwd)
;umask=022 ; umask for process (default none)
;priority=-1 ; the relative start priority (default -1)
;autostart=true ; start at supervisord start (default: true)
;startsecs=1 ; # of secs prog must stay up to be running (def. 1)
;startretries=3 ; max # of serial start failures when starting (default 3)
;autorestart=unexpected ; autorestart if exited after running (def: unexpected)
;exitcodes=0 ; 'expected' exit codes used with autorestart (default 0)
;stopsignal=quit ; signal used to kill process (default term)
;stopwaitsecs=10 ; max num secs to wait b4 sigkill (default 10)
;stopasgroup=false ; send stop signal to the unix process group (default false)
;killasgroup=false ; sigkill the unix process group (def false)
;user=chrism ; setuid to this unix account to run the program
;redirect_stderr=false ; redirect_stderr=true is not allowed for eventlisteners
;stdout_logfile=/a/path ; stdout log path, none for none; default auto
;stdout_logfile_maxbytes=1mb ; max # logfile bytes b4 rotation (default 50mb)
;stdout_logfile_backups=10 ; # of stdout logfile backups (0 means none, default 10)
;stdout_events_enabled=false ; emit events on stdout writes (default false)
;stdout_syslog=false ; send stdout to syslog with process name (default false)
;stderr_logfile=/a/path ; stderr log path, none for none; default auto
;stderr_logfile_maxbytes=1mb ; max # logfile bytes b4 rotation (default 50mb)
;stderr_logfile_backups=10 ; # of stderr logfile backups (0 means none, default 10)
;stderr_events_enabled=false ; emit events on stderr writes (default false)
;stderr_syslog=false ; send stderr to syslog with process name (default false)
;environment=a="1",b="2" ; process environment additions
;serverurl=auto ; override serverurl computation (childutils)
; the sample group section below shows all possible group values. create one
; or more 'real' group: sections to create "heterogeneous" process groups.
;[group:thegroupname]
;programs=progname1,progname2 ; each refers to 'x' in [program:x] definitions
;priority=999 ; the relative start priority (default 999)
; the [include] section can just contain the "files" setting. this
; setting can list multiple files (separated by whitespace or
; newlines). it can also contain wildcards. the filenames are
; interpreted as relative to this file. included files *cannot*
; include files themselves.
[include]
files = /etc/supervisor/*.conf
再建一个配置文件
tornado.conf
[group:tornadoes] programs=tornado-8888 [program:tornado-8888] command=/usr/bin/python /usr/web/tornadotest/server.py --port=8888 ##python tornado启动py directory=/usr/web/tornadotest user=root autorestart=true redirect_stderr=true stdout_logfile=/usr/web/tornadotest/logs loglevel=info
5.2 启动
启动 supervisord -c /etc/supervisord.conf 指定配置文件
supervisorctl shutdown 关闭supervisor
至此。
附上api的代码
server.py
#!/usr/bin/env python
# -*- coding:utf-8 -*-
import tornado.ioloop
from src.urls import * # 引入urls
import torndb
import conf.db as dbsettings
import os
class application(tornado.web.application):
def __init__(self):
handlers = [
# (r"/", mainhandler),
# (r"/story/(sishen[0-9]+)", storyhandler), # 正则url映射,方便get
(r"/houses/([0-9]+)", househandler),
(r"/houses", househandler),
]
settings = dict(
template_path=os.path.join(os.path.dirname(__file__), "templates"),
static_path=os.path.join(os.path.dirname(__file__), "statics"),
debug=true,
)
super(application, self).__init__(handlers, **settings)
# 获取数据库配置信息
dbinfo = dbsettings.default
# 创建一个全局mysql连接实例供handler使用
self.db = torndb.connection(host=dbinfo['host'], user=dbinfo['user'],
password=dbinfo['password'], database=dbinfo['dbname'], charset='utf8')
if __name__ == "__main__":
application = application()
application.listen(8888)
tornado.ioloop.ioloop.instance().start()
urls.py
import tornado.web
import json
from conf.log import decoratore # 引入日志装饰器
from conf.fun import *
class basehandler(tornado.web.requesthandler):
# blog.csdn.net/moshowgame 解决跨域问题
def set_default_headers(self):
self.set_header("access-control-allow-origin", "*") # 这个地方可以写域名
self.set_header("access-control-allow-headers", "x-requested-with, authorization")
self.set_header('access-control-allow-methods', 'post, get, options')
self.set_header('access-control-allow-credentials', 'true')
# def write(self, chunk):
# self.set_header('access-control-allow-origin', 'http://localhost:4200')
# self.set_header('access-control-allow-headers', 'origin, x-requested-with, content-type, accept, x-token, x-file-upload')
# self.set_header('access-control-allow-methods', 'post, get, put, options, delete')
# self.set_header('access-control-allow-credentials', 'true')
# super(basehandler, self).write(chunk)
class mainhandler(basehandler):
@decoratore
def get(self):
self.write("hello, world")
# 访问: http://localhost:8888/story/sishen232
# 显示:u get story id is sishen232
class househandler(basehandler):
'''house class'''
def __init__(self, application, request):
'''必填参数'''
super().__init__(application, request)
# 预处理
self.data = bytedata(self.request.arguments)
self.params = ['title', 'position', 'size', 'address']
@decoratore
def post(self):
'''提交house接口'''
# # 判断提交参数是否有误
# if(('title' not in raw_data) or ('position' not in raw_data)):
# self.write(json.dumps(
# {"false": {"msg": '参数错误'}}, ensure_ascii=false))
# return
code = paramscheck(self.data, self.params)
if code == 1:
raw_data = self.data
if('year' not in raw_data):
raw_data['year'] = ''
print(raw_data)
data = self.application.db.execute(
"insert into house(title, position, size, address, year) values('{}', '{}', {}, '{}', '{}')".format(raw_data['title'], raw_data['position'], float(raw_data['size']), raw_data['address'], raw_data['year']))
# self.write(json.dumps({"sum": s}))
self.write(json.dumps(
{"success": {"msg": '添加成功'}}, ensure_ascii=false))
else:
self.write(json.dumps(
{"false": {"msg": '参数错误'}}, ensure_ascii=false))
def get(self, house_id=''):
'''
# 获取house接口
# house_id 存在则获取该条数据，不存在获取所有数据
'''
sql = 'select * from house' if house_id == '' else 'select * from house where id = {id}'.format(
id=house_id)
data = self.application.db.query(sql)
# self.write(json.dumps({"sum": s}))
self.write(json.dumps(
{"success": {"msg": '获取成功', "data": data}}, ensure_ascii=false))
日志装饰器和一些通用函数去掉即可。