celery+django+mq 异步任务与定时任务

安装

1、windows安装地址:  https://github.com/MicrosoftArchive/redis/releases

2、redis windows 版本的安装与使用：https://www.cnblogs.com/qiantao/p/12701199.html

3、redis启动出错Creating Server TCP listening socket *:6379: bind: No error

参见：https://blog.csdn.net/shendixiaoxuan/article/details/78016203

4、window 需要pip install eventlet       https://blog.csdn.net/qq_24077201/article/details/112847331

参考

celery
pip install celery==4.1.1
https://www.cnblogs.com/wdliu/p/9530219.html
https://www.jianshu.com/p/6f8576a37a3e

定时：
https://blog.csdn.net/Leo062701/article/details/90613651
https://blog.csdn.net/sicofield/article/details/50937338

配置

dj_01/dj_01/__init__.py

import pymysql
from .celery import app as celery_app

pymysql.install_as_MySQLdb()
__all__ = ['celery_app']

dj_01/dj_01/celery.py

from __future__ import absolute_import, unicode_literals
import os
from celery import Celery
from django.conf import settings
# set the default Django settings module for the 'celery' program.
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'dj_01.settings')

app = Celery('dj_01',backend='amqp', broker='amqp://guest:guest@localhost:5672//')
app.config_from_object('django.conf:settings')
app.autodiscover_tasks(lambda: settings.INSTALLED_APPS)

dj_01/dj_01/setting.py

INSTALLED_APPS = (
    'django.contrib.admin',
    'django.contrib.auth',
    'django.contrib.contenttypes',
    'django.contrib.sessions',
    'django.contrib.messages',
    'django.contrib.staticfiles',
    'mytest',

)

# Celery 设置
# CELERY_BROKER_URL = 'redis://localhost:6379/0'
BROKER_URL = 'amqp://guest:guest@127.0.0.1:5672//'
CELERY_ACCEPT_CONTENT = ['json']
CELERY_TASK_SERIALIZER = 'json'
CELERY_RESULT_SERIALIZER = 'json'
# CELERY_RESULT_BACKEND = 'django-db'
CELERY_TIMEZONE = 'Asia/Shanghai'

from datetime import timedelta

# 定时任务
CELERYBEAT_SCHEDULE = {
    'add-every-30-seconds': {
        'task': 'mytest.tasks.add',  # 任务名
        'schedule': timedelta(seconds=2),  # 每2s执行一次该任务
        'args': (2, 3)
    }
}

 

异步任务

服务：celery -A dj_01 worker -l info

app/tasks.py

from time import sleep
from celery import shared_task

@shared_task  #celery -A dj_01 worker -l info
def celeryTest(*ags,**kwargs):
    print('耗时操作任务start...')
    print(ags)
    print(kwargs)
    sleep(10)
    print('耗时操作任务end...')

app/view.py

from .tasks import celeryTest

1 def testt(req):
    d = {
        "result":'123123',
    }

    res = celeryTest.delay(json.dumps(d))
    print("res:%s"%res) #b9020fb2-61c1-494d-8e66-a86776943c76

    return render(req, 'acc_login.html')

 

定时任务

服务：celery -A dj_01 beat -l info

https://blog.csdn.net/Leo062701/article/details/90613651
https://blog.csdn.net/sicofield/article/details/50937338