08.存储Cinder→5.场景学习→02.Create Volume→2.cinder-scheduler调度工作

返回总目录

描述详细

查看cinder-scheduler日志

cinder-scheduler 执行调度算法，通过 Filter 和 Weigher 挑选最优的存储节点。cinder-scheduler 通过 Flow volume_create_scheduler 执行调度工作。

Jun 11 16:51:14 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Flow 'volume_create_scheduler' (22955515-20d0-4af4-8890-df981d8bbe8d) 
transitioned into state 'RUNNING' from state 'PENDING' 
{{(pid=29282) _flow_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:145

该 Flow 依次执行 ExtractSchedulerSpecTask 和 ScheduleCreateVolumeTask，它们在源码中就是两个类，在源码/opt/stack/cinder/cinder/scheduler/flows/create_volume.py上。ExtractSchedulerSpecTask作用是Extracts a spec object from a partial and/or incomplete request spec 从部分和/或不完整的请求spec中提取spec对象(spec：说明、规范)

Jun 11 16:51:14 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' 
(2639d26d-a289-4fa6-8e47-096b35b77015) transitioned into state 'RUNNING' from state 'PENDING' 
{{(pid=29282) _task_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:194

Jun 11 16:51:14 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' 
(2639d26d-a289-4fa6-8e47-096b35b77015) transitioned into state 'SUCCESS' from state 'RUNNING' ...
 {{(pid=29282) _task_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:183

主要的 filter 和 weighting 工作由 ScheduleCreateVolumeTask Activates a scheduler driver and handles any subsequent failures 完成
经过 AvailabilityZoneFilter, CapacityFilter, CapabilitiesFilter 和 CapacityWeigher 的层层筛选，最终选择了存储节点 devstack-controller@lvmdriver-1#lvmdriver-1。
过滤器源码位置：\opt\stack\cinder\cinder\scheduler\filters

Jun 11 16:51:14 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' 
(f7f99d55-3903-4f0d-bf47-b269e1204775) transitioned into state 'RUNNING' from state 'PENDING' 
{{(pid=29282) _task_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:194

1
2
3

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.base_filter [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Starting with 1 host(s) {{(pid=29282) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:95

因为只有一个存储节点

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.base_filter [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Filter AvailabilityZoneFilter returned 1 host(s) 
{{(pid=29282) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.base_filter [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Filter CapacityFilter returned 1 host(s) 
{{(pid=29282) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.base_filter [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Filter CapabilitiesFilter returned 1 host(s) 
{{(pid=29282) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.filter_scheduler [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Filtered [host 'controller@lvmdriver-1#lvmdriver-1':free_capacity_gb: 22.8, total_capacity_gb:  
{{(pid=29282) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:339

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.filter_scheduler [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 
Choosing controller@lvmdriver-1#lvmdriver-1 
{{(pid=29282) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:560

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-a6c9fadb-0364-43da-bbf0-d333c549aa74 admin None] 
Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' 
(37386aa6-d742-46cb-9ff2-c842dbc7e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' 
{{(pid=29282) _task_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:183

Flow volume_create_scheduler 完成调度，状态变为 SUCCESS。

Jun 11 16:51:15 controller cinder-scheduler[29282]: 
DEBUG cinder.scheduler.manager [None req-a6c9fadb-0364-43da-bbf0-d333c549aa74 admin None] 
Flow 'volume_create_scheduler' ... transitioned into state 'SUCCESS' from state 'RUNNING' 
{{(pid=29282) _flow_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:145

cinder-scheduler 发送消息

cinder-scheduler 发送消息给 cinder-volume，让其创建 volume。源码 /opt/stack/cinder/cinder/scheduler/filter_scheduler.py，方法为 schedule_create_volume。

class FilterScheduler(driver.Scheduler):
    """Scheduler that can be used for filtering and weighing."""
    #...
    def schedule_create_volume(self, context, request_spec, filter_properties):
        backend = self._schedule(context, request_spec, filter_properties)
    <span style="color: rgb(0, 128, 0); font-weight: bold; ">if</span> <span style="color: rgb(170, 34, 255); font-weight: bold; ">not</span> backend:
        <span style="color: rgb(0, 128, 0); font-weight: bold; ">raise</span> exception<span style="color: rgb(102, 102, 102); ">.</span>NoValidBackend(reason<span style="color: rgb(102, 102, 102); ">=</span>_(<span style="color: rgb(186, 33, 33); ">"No weighed backends "</span>
                                                <span style="color: rgb(186, 33, 33); ">"available"</span>))

    backend <span style="color: rgb(102, 102, 102); ">=</span> backend<span style="color: rgb(102, 102, 102); ">.</span>obj
    volume_id <span style="color: rgb(102, 102, 102); ">=</span> request_spec[<span style="color: rgb(186, 33, 33); ">'volume_id'</span>]

    updated_volume <span style="color: rgb(102, 102, 102); ">=</span> driver<span style="color: rgb(102, 102, 102); ">.</span>volume_update_db(context, volume_id,
                                             backend<span style="color: rgb(102, 102, 102); ">.</span>host,
                                             backend<span style="color: rgb(102, 102, 102); ">.</span>cluster_name)
    <span style="color: rgb(0, 128, 0); ">self</span><span style="color: rgb(102, 102, 102); ">.</span>_post_select_populate_filter_properties(filter_properties,
                                                 backend)

    <span style="color: rgb(64, 128, 128); font-style: italic; "># context is not serializable</span>
    filter_properties<span style="color: rgb(102, 102, 102); ">.</span>pop(<span style="color: rgb(186, 33, 33); ">'context'</span>, <span style="color: rgb(0, 128, 0); ">None</span>)

    <span style="color: rgb(0, 128, 0); ">self</span><span style="color: rgb(102, 102, 102); ">.</span><font color="#0000ff"><b>volume_rpcapi.create_volume</b></font>(context, updated_volume, request_spec,
                                     filter_properties,
                                     allow_reschedule<span style="color: rgb(102, 102, 102); ">=</span><span style="color: rgb(0, 128, 0); ">True</span>)
    <span style="color: rgb(64, 128, 128); font-style: italic; ">#...</span></pre></div></td></tr></tbody></table><table class="highlighttable"><tbody><tr><td><div class="linenodiv" style="background-color: rgb(240, 240, 240); padding-right: 10px; "><pre style="line-height: 16px; ">1

2

3

4

5

Jun 11 16:51:14 controller cinder-scheduler[29282]: 

DEBUG cinder.scheduler.manager [None req-4111af2f-99a8-4166-8647-569b038786d9 admin None] 

Flow 'volume_create_scheduler' (22955515-20d0-4af4-8890-df981d8bbe8d) 

transitioned into state 'RUNNING' from state 'PENDING' 

{{(pid=29282) _flow_receiver /usr/local/lib/python2.7/dist-packages/taskflow/listeners/logging.py:145

posted @ 2019-07-13 19:54 LeisureZhao 阅读(176) 评论(0) 编辑收藏举报

刷新页面返回顶部