XCloud | Official Code for Paper XCloud : Design | Machine Learning library

As suggested in Django doc, DO NOT USE THIS SERVER IN A PRODUCTION SETTING, it may bring you potential security risk and performance problems. Henceforth, you'd better upgrade Django built-in server to a stronger one, such as Nginx. Note: this tutorial gives more details about Nginx and Django. Note: suppose you start 4 deep learning services with ports from 8001 to 8004, on CUDA_VISIBLE_DEVICES from 0 to 3, respectively. The above configuration indicates that all concurrent requests will be proxied to YOUR_MACHINE_IP:8008/cv/. So it's easy to solve concurrent requests from clients. In the near future, I will explore more methods in Machine Leanring in Production fields, and share related articles on ML_IN_PRODUCTION.md or my blog.
install Gunicorn: pip3 install gunicorn
run your server (with multi threads support): gunicorn XCloud.wsgi -b YOUR_MACHINE_IP:8001 --threads THREADS_NUM --timeout=200
open your browser and visit welcome page: http://YOUR_MACHINE_IP:8001/index
install uWSGI: pip3 install uwsgi. Try conda install -c conda-forge uwsgi if you prefer Anaconda
start your uWSGI server: uwsgi --http :8001 --chdir /data/lucasxu/Projects/XCloud -w XCloud.wsgi
you can specify more configuration in uwsgi.ini, and start uWSGI by: uwsgi --ini uwsgi.ini
open your browser and visit welcome page: http://YOUR_MACHINE_IP:8001/index
install Nginx: sudo apt-get install nginx
install uwsgi: sudo pip3 install uwsgi
start Nginx: sudo /etc/init.d/nginx start. Type ps -ef |grep -i nginx to see whether Nginx has started successfully
open your browser and visit YOUR_IP_ADDRESS:80, if you see nginx welcome page, then you have installed Nginx successfully
restart Nginx: sudo /etc/init.d/nginx restart
config your Nginx: sudo vim /etc/nginx/nginx.conf as follows: user nginx; worker_processes 1; error_log /var/log/nginx/error.log warn; pid /var/run/nginx.pid; events { use epoll; worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; log_format main '$remote_addr - $remote_user [$time_local] "$request" ' '$status $body_bytes_sent "$http_referer" ' '"$http_user_agent" "$http_x_forwarded_for"'; access_log /var/log/nginx/access.log main; sendfile on; #tcp_nopush on; keepalive_timeout 65; gzip on; include /etc/nginx/conf.d/*.conf; upstream backend { server YOUR_MACHINE_IP:8001; server YOUR_MACHINE_IP:8002; server YOUR_MACHINE_IP:8003; server YOUR_MACHINE_IP:8004; } server { listen 8008; server_name YOUR_MACHINE_IP; access_log /var/log/nginx/access.log main; charset utf-8; gzip on; gzip_types text/plain application/x-javascript text/css text/javascript application/x-httpd-php application/json text/json image/jpeg image/gif image/png application/octet-stream; # set project uwsgi path location /cv/ { include uwsgi_params; # import an Nginx module to communicate with uWSGI uwsgi_connect_timeout 30; uwsgi_pass unix:/opt/project_teacher/script/uwsgi.sock; # set uwsgi's sock file, so all dynamical requests will be sent to uwsgi_pass proxy_connect_timeout 300; proxy_buffering off; proxy_pass http://backend; } location /static/ { alias /data/lucasxu/Projects/XCloud/cv/static/; index index.html index.htm; } } }
restart Nginx: sudo /etc/init.d/nginx restart, then enjoy it!