Ogre Compositor解析
Compositor脚本与类型
我们先看下面一张基本的Compositor的脚本图:
上面就是一个Composition资源.在解析时,主要是使用CompositionPass, CompositionTargetPass, CompositionTechnique, Compositor,而在渲染时,使用RenderSystemOperation, TargetOperation, CompositorInstance, CompositionChain.管理Composition用CompositionManage.
Compositor主要类型说明.
CompositionPass:
一次渲染环境设置,包含基本渲染设置,根据PassType不同,生成不同的RenderSystemOperation,主要有如下几种:RSClearOperation, RSStencilOperation, RSSetSchemeOperation, RSRestoreSchemeOperation, RSQuadOperation, RenderSystemOperation.下面以opengl的API举例．
当PassType为PT_CLEAR,对应RSClearOperation,用到的属性为mClearBuffers, mClearColour, mClearDepth, mClearStencil.在opengl中,对应操作FFP的API是glClear(color|depth,stencil).
enum PassType { PT_CLEAR, /// Clear target to one colour PT_STENCIL, /// Set stencil operation PT_RENDERSCENE, /// Render the scene or part of it PT_RENDERQUAD, /// Render a full screen quad PT_RENDERCUSTOM /// Render a custom sequence };
当PassType为PT_RENDERSCENE时,用到属性mFirstRenderQueue,mLastRenderQueue
当PassType为PT_STENCIL,用到mStencilCheck, mStencilFunc, mStencilRefValue, mStencilMask, mStencilFailOp, mStencilDepthFailOp, mStencilPassOp, mStencilTwoSidedOperation, mStencilReadBackAsTexture,属性虽然多,但是对应Opengl里FFP的API就是void glStencilFunc (GLenum func, GLint ref, GLuint mask);void glStencilOp (GLenum fail, GLenum zfail, GLenum zpass),glStencilMask,前面二个函数还有一个区别正反面的版本,上面的属性就是对这几个函数的封装.
上面的几种一般不用,下面这种是很常用的.
当PassType为PT_RENDERQUAD时,用到属性mMaterial, mInputs, mQuadLeft, Top, Right, Bottom.不同于上面一般对应的是FFP(固定管线功能),这个操作主要是取出mMaterial里的VP,FP,根据自己编写的VP与FP来渲染,其中mInput是VP与FP要用到的纹理.输出到CompositionTargetPass对应的mOutputName.
CompositionTargetPass:
对应上面的图,一个CompositionTargetPass包含一些基本设置与一个或多个CompositionPass,对应生成CompositorInstance::TargetOperation.如果说CompositionPass是渲染的环境参数设置,而CompositionTargetPass就是在一个或多个CompositionPass渲染前的特定渲染环境参数设置.
CompositionTargetPass与CompositionPass在资源文件里,都有一个input,但是他们之间的含义是不同的,在CompositionPass里的input是对应的纹理里的着色器代码要用到的纹理编号,而在CompositionTargetPass里input表示一个CompositionTargetPass::InputMode枚举.
InputMode枚举只有二个值,一个是IM_NONE,一个是IM_PREVIOUS,对应上图第一个target就是IM_PREVIOUS,后面的都是IM_NONE.其中IM_PREVIOUS表示当前窗口内容,而IM_NONE表示清空当前窗口.
enum InputMode { IM_NONE, /// No input IM_PREVIOUS /// Output of previous Composition in chain };
其中mOutputName对应CompositionTechnique里的mTextureDefinitions里的纹理,CompositionTargetPass包含的CompositionPass最后渲染的内容就保存在这个纹理中.CompositionTargetPass所对应的RenderTarget也是这个纹理.
CompositionTechnique:
对应上面的图,一个CompositionTechnique包含多个CompositionTargetPass,在CompositionTargetPass前,我们可以看到一些纹理说明与设置,这里的纹理与一般的不同纹理不同,我们后面可以看到,在这里CompositionTechnique::TextureDefinition生成的纹理都指定了TextureUsage为TU_RENDERTARGET,指定这个是说明这是一个每桢更新的纹理,同时会附带一个RenderTexture(RenderTarget的派生类)对象,就是说,每定义一个TextureDefinition,就生成一个RenderTarget,如果TextureDefinition对应有多个PixelFormat,那么对应的RenderTexture为MultiRenderTarget.
CompositionTechnique保存多个或一个CompositionTargetPass和一个mOutputTarget(也为CompositionTargetPass类型),也就是上图中最后一个CompositionTargetPass,针对这个处理后面会看到有些不同.
class TextureDefinition : public CompositorInstAlloc { public: String name; //Texture definition being a reference is determined by these two fields not being empty. String refCompName; //If a reference, the name of the compositor being referenced String refTexName; //If a reference, the name of the texture in the compositor being referenced size_t width; // 0 means adapt to target width size_t height; // 0 means adapt to target height float widthFactor; // multiple of target width to use (if width = 0) float heightFactor; // multiple of target height to use (if height = 0) PixelFormatList formatList; // more than one means MRT bool fsaa; // FSAA enabled; true = determine from main target (if render_scene), false = disable bool hwGammaWrite; // Do sRGB gamma correction on write (only 8-bit per channel formats) uint16 depthBufferId;//Depth Buffer's pool ID. (unrelated to "pool" variable below) bool pooled; // whether to use pooled textures for this one TextureScope scope; // Which scope has access to this texture TextureDefinition() :width(0), height(0), widthFactor(1.0f), heightFactor(1.0f), fsaa(true), hwGammaWrite(false), depthBufferId(1), pooled(false), scope(TS_LOCAL) {} };
Compositor:
CompositionTechnique列表.对应CompositorInstance,分别处理资源与渲染.
其中mGlobalTextures与mGlobalMRTs分别是CompositionTechnique里的TextureDefinition列表集合,TextureDefinition如果PixelFormat只有一个,加入mGlobalTextures中,如果有多个,加入mGlobalMRTs中.
CompositorInstance:
Compositor的操纵类,Compositor对应资源文件里相应结构.而CompositorInstance是对Compositor数据渲染化.CompositorInstance用对应Compositor最合适的CompositionTechnique进行处理.
TargetOperation定义在此类中,用于设置可视化mask,lod bias level, shadow enable, material scheme等.
class TargetOperation { public: TargetOperation() { } TargetOperation(RenderTarget *inTarget): target(inTarget), currentQueueGroupID(0), visibilityMask(0xFFFFFFFF), lodBias(1.0f), onlyInitial(false), hasBeenRendered(false), findVisibleObjects(false), materialScheme(MaterialManager::DEFAULT_SCHEME_NAME), shadowsEnabled(true) { } /// Target RenderTarget *target; /// Current group ID int currentQueueGroupID; /// RenderSystem operations to queue into the scene manager, by /// uint8 RenderSystemOpPairs renderSystemOperations; /// Scene visibility mask /// If this is 0, the scene is not rendered at all uint32 visibilityMask; /// LOD offset. This is multiplied with the camera LOD offset /// 1.0 is default, lower means lower detail, higher means higher detail float lodBias; /** A set of render queues to either include or exclude certain render queues. */ typedef std::bitset<RENDER_QUEUE_COUNT> RenderQueueBitSet; /// Which renderqueues to render from scene RenderQueueBitSet renderQueues; /** @see CompositionTargetPass::mOnlyInitial */ bool onlyInitial; /** "Has been rendered" flag; used in combination with onlyInitial to determine whether to skip this target operation. */ bool hasBeenRendered; /** Whether this op needs to find visible scene objects or not */ bool findVisibleObjects; /** Which material scheme this op will use */ String materialScheme; /** Whether shadows will be enabled */ bool shadowsEnabled; };
RenderSystemOperation类也定义在这个类中,不同RenderSystemOperation的子类对应不同的渲染API或参数设置,如glClear, glStencilFunc这些.
class _OgreExport RenderSystemOperation : public CompositorInstAlloc { public: virtual ~RenderSystemOperation(); /// Set state to SceneManager and RenderSystem virtual void execute(SceneManager *sm, RenderSystem *rs) = 0; };
CompositorInstance负责Composition操作,主要包含把CompositionTargetPass转化成TargetOperation,把CompositionPass转化成RenderSystemOperation.
CompositorChain:
CompositorChain实现接口RenderTargetListener,Viewport::Listener,这样就可以监听Viewport与RenderTarget,在CompositionChain初始化时,CompositorChain会增加对应Viewport与对应Viewport的RenderTarget的监视.
这样,在Root更新RenderTarget(一般和主视图关联)时,RenderTarget更新前会先通知CompositorChain, CompositorChain生成的RenderTarget最终替换前RenderTarget(一般和主视图关联).
CompositorChain对应一个Viewport对应,通过addCompositor注册compositor到viewport对应的CompositorChain,在第一个compositor注册到Viewport时,生成CompositorChain,注册CompositorChain到对应Viewport与Viewport的RenderTarget.
CompositorChain负责渲染.其中定义了RQListener,注册当前CompositionChain到当前场景.截获场景更新.
class _OgreExport RQListener: public RenderQueueListener { public: RQListener() : mOperation(0), mSceneManager(0), mRenderSystem(0), mViewport(0) {} /** @copydoc RenderQueueListener::renderQueueStarted */ virtual void renderQueueStarted(uint8 queueGroupId, const String& invocation, bool& skipThisInvocation); /** @copydoc RenderQueueListener::renderQueueEnded */ virtual void renderQueueEnded(uint8 queueGroupId, const String& invocation, bool& repeatThisInvocation); /** Set current operation and target. */ void setOperation(CompositorInstance::TargetOperation *op,SceneManager *sm,RenderSystem *rs); /** Notify current destination viewport. */ void notifyViewport(Viewport* vp) { mViewport = vp; } /** Flush remaining render system operations. */ void flushUpTo(uint8 id); private: CompositorInstance::TargetOperation *mOperation; SceneManager *mSceneManager; RenderSystem *mRenderSystem; Viewport* mViewport; CompositorInstance::RenderSystemOpPairs::iterator currentOp, lastOp; };
注意每个CompositionTechnique一般第一个是InputMode为IM_PREVIOUS的CompositionTargetPass,在CompositionChain中,就是上一个CompositionTechnique最后一个为mOutputTarget(上图最后一个为target_out)的CompositionTargetPass.这样通过CompositionChain就可以把每个CompositionTechnique的渲染组合起来.
Compositor渲染流程
上面是各个Compositor类的说明,我们从下面来看下,Ogre如何组织这些类进行渲染.
1.资源文件解析.当ResourceGroupManager::initialiseResourceGroup后,对文件解析,解析成多个结点,对Compositor节点解析.具体参照CompositorTranslator, CompositionTechniqueTranslator, CompositionTargetPassTranslator, CompositionPassTranslator.解析完后Compositor内部数据Technique,TargetPass,Pass已经生成.
class _OgreExport CompositorTranslator : public ScriptTranslator { protected: Compositor *mCompositor; public: CompositorTranslator(); void translate(ScriptCompiler *compiler, const AbstractNodePtr &node); }; class _OgreExport CompositionTechniqueTranslator : public ScriptTranslator { protected: CompositionTechnique *mTechnique; public: CompositionTechniqueTranslator(); void translate(ScriptCompiler *compiler, const AbstractNodePtr &node); }; class _OgreExport CompositionTargetPassTranslator : public ScriptTranslator { protected: CompositionTargetPass *mTarget; public: CompositionTargetPassTranslator(); void translate(ScriptCompiler *compiler, const AbstractNodePtr &node); }; class _OgreExport CompositionPassTranslator : public ScriptTranslator { protected: CompositionPass *mPass; public: CompositionPassTranslator(); void translate(ScriptCompiler *compiler, const AbstractNodePtr &node); };
2.在用户创建场景时,调用CompositorManage注册Compositor到对应Viewport中,首先得到与一个与Viewport对应的CompositorChain对象(有则返回,无则新增),并且添加对Viewport与此对应Viewport的RenderTarget的监听.并对CompositorChain对象进行相关初始化,以及根据传入的Compositor生成一一对应的CompositorInstance对象.
CompositorChain::CompositorChain(Viewport *vp): mViewport(vp), mOriginalScene(0), mDirty(true), mAnyCompositorsEnabled(false) { assert(vp); mOldClearEveryFrameBuffers = vp->getClearBuffers(); vp->addListener(this); createOriginalScene(); vp->getTarget()->addListener(this); }
3.当我们通过CompositorManage设置某个Compositor启用后,对应的OgreCompositorInstance调用createResources,根据Compositor里的Technique得到mTextureDefinitions,也就是第一张图上面的三个Texture定义,填充对应mLocalTextures与mLocalMRTs数据,这些Textur创建如前面指出过,都是TU_RENDERTARGET用途,附加一个对应RenderTexture.
在这里,大家可以参看一下RTT相关,在OpenGL中,相关实现方法有很多,PBuffer,FBO,Copy.在这里,根据大家选择RTT模式,在后台生成RenderTexture不同子类如GLPBRenderTexture,GLFBORenderTexture,GLCopyingRenderTexture.如果硬件允许,尽量选择FBO.其中FBO具体用法可以参看WebGL 利用FBO完成立方体贴图。 初试PyOpenGL三 (Python+OpenGL)GPGPU基本运算与乒乓技术.
假定使用opengl,FBO渲染,可以看下GLFBORenderTexture相关接口.大家可以看下opengl API如glFramebufferTexture,glBindFramebufferEXT的使用.
class _OgreGLExport GLFBORenderTexture: public GLRenderTexture { public: GLFBORenderTexture(GLFBOManager *manager, const String &name, const GLSurfaceDesc &target, bool writeGamma, uint fsaa); virtual void getCustomAttribute(const String& name, void* pData); /// Override needed to deal with multisample buffers virtual void swapBuffers(); /// Override so we can attach the depth buffer to the FBO virtual bool attachDepthBuffer( DepthBuffer *depthBuffer ); virtual void detachDepthBuffer(); virtual void _detachDepthBuffer(); protected: GLFrameBufferObject mFB; };
4.Root更新RenderTarget时,对应RenderTarget在更新前,查找监听本RenderTarget的CompositorChain对象,第一次重构CompositorChain时会首先调用_complie完成对之上所有CompositorInstance对象按顺序链接成链表,并把对应链表从前按后调用CompositorInstance::_compileTargetOperations填充到CompositorChain里的TargetOperation列表对象mCompiledState中.其中最后一个CompositorInstance中的OutputTargetPass(特殊的CompositionTargetPass)没放入上面,而是单独保存在mOutputOperation.
其中CompositorInstance里Technique每个CompositionTargetPass生成一个对应的TargetOperation对象,根据CompositionTargetPass的outputName传入TargetOperation的RenderTarget,还需要注意你生成第一个CompositionTargetPass(上图第一个CompositionTargetPass,InputMode为IM_PREVIOUS),会引发链接上一个CompositorInstance调用_compileOutputOperation到TargetOperation中.
这个过程比较容易理解,一个CompositorInstance,一般一个Pass要求是当前桢缓冲内容,后面是Pass合成,最后是输出Pass,那么在CompositorInstance链接表,后一个Pass要求的输出就是前一个Pass的最后输出.
TargetOperation对应一个CompositionTargetPass,包含方案,是否生成阴影等,其中CompositionTargetPass下的CompositionPass包含当前渲染环境设置,包含清空缓冲区,设置模板缓冲,或者对应上面最常用的PT_RENDERQUAD里针对着色器设置正确的纹理,所以在TargetOperation生成后,还需要针对CompositionTargetPass里的CompositionPass生成对应的RenderSystemOperation,如同CompositionPass类的说明,相应过程参照CompositorInstance::collectPasses.
void CompositorInstance::_compileTargetOperations(CompiledState &compiledState) { /// Collect targets of previous state if(mPreviousInstance) mPreviousInstance->_compileTargetOperations(compiledState); /// Texture targets CompositionTechnique::TargetPassIterator it = mTechnique->getTargetPassIterator(); while(it.hasMoreElements()) { CompositionTargetPass *target = it.getNext(); TargetOperation ts(getTargetForTex(target->getOutputName())); /// Set "only initial" flag, visibilityMask and lodBias according to CompositionTargetPass. ts.onlyInitial = target->getOnlyInitial(); ts.visibilityMask = target->getVisibilityMask(); ts.lodBias = target->getLodBias(); ts.shadowsEnabled = target->getShadowsEnabled(); ts.materialScheme = target->getMaterialScheme(); /// Check for input mode previous if(target->getInputMode() == CompositionTargetPass::IM_PREVIOUS) { /// Collect target state for previous compositor /// The TargetOperation for the final target is collected separately as it is merged /// with later operations mPreviousInstance->_compileOutputOperation(ts); } /// Collect passes of our own target collectPasses(ts, target); compiledState.push_back(ts); } }
5.在主视图中的RenderTarget开始调用preRenderTargetUpdate,检测到CompositorChain,针对mCompiledState里的所有TargetOperation中的RenderTarget更新开始,
在这过程中,注意CompositorChain::RQListener这个对象,在TargetOperation中的RenderTarget更新之前,会把当前场景与TargetOperation中的RenderSystemOperation都关联到CompositorChain::RQListener中,并把CompositorChain::RQListener注册到当前场景(SceneManager::addRenderQueueListener).记住这步,后面会转到这个地方.
void CompositorChain::preTargetOperation(CompositorInstance::TargetOperation &op, Viewport *vp, Camera *cam) { if (cam) { SceneManager *sm = cam->getSceneManager(); /// Set up render target listener mOurListener.setOperation(&op, sm, sm->getDestinationRenderSystem()); mOurListener.notifyViewport(vp); /// Register it sm->addRenderQueueListener(&mOurListener); /// Set whether we find visibles mOldFindVisibleObjects = sm->getFindVisibleObjects(); sm->setFindVisibleObjects(op.findVisibleObjects); /// Set LOD bias level mOldLodBias = cam->getLodBias(); cam->setLodBias(cam->getLodBias() * op.lodBias); } // Set the visibility mask mOldVisibilityMask = vp->getVisibilityMask(); vp->setVisibilityMask(op.visibilityMask); /// Set material scheme mOldMaterialScheme = vp->getMaterialScheme(); vp->setMaterialScheme(op.materialScheme); /// Set shadows enabled mOldShadowsEnabled = vp->getShadowsEnabled(); vp->setShadowsEnabled(op.shadowsEnabled); /// XXX TODO //vp->setClearEveryFrame( true ); //vp->setOverlaysEnabled( false ); //vp->setBackgroundColour( op.clearColour ); }
6.在第五步中,针对mCompiledState的每个TargetOperation中的RenderTarget渲染都会对SceneManager注册通道监听事件,那么在每次RenderTarget更新中的通道事件中,到第五步的RQListener开始调用renderQueueStarted方法,在这方法里,调用flushUpTo,这个方法里,根据TargetOperation里的RenderSystemOperation列表,针对当前场景与RenderSystem(gl,dx,gles)进行渲染设置.具体设置可以看RenderSystemOperation子类的execute方法.在这里,我们假设使用opengl,FBO渲染,那么TargetOperation里的RenderTarget.Update最终会指向glBindFramebufferEXT(前面初始化RenderTarget时会调用glFramebufferTexture).是不是很熟悉了.
感觉有必要单独说下CompositorChain::RQListener::flushUpTo,参数id表示当前的RenderQueueGroupID,ogre从小到大渲染,意思在渲染所有通道组时,每次进通道组,也就是进flushUpTo中,id是从小到大的,在方法里,我们检查RenderSystemOperation 的最小渲染通道是否小于或等于当前的RenderQueueGroupID,如果是才执行.其中pass render_scene这种如果没有设置material_scheme,则只会改变当前TargetOperation 的currentQueueGroupID为pass->getLastRenderQueue() + 1与renderQueues (当前TargetOperation影响的RenderQueueGroupID),否则不仅改变currentQueueGroupID与renderQueues,还会添加一个RSSetSchemeOperation,一个RSRestoreSchemeOperation. 注意pass render_custom与pass render_scene一样,currentQueueGroupID受本身pass影响,而pass clear,render_quad,stencil不会改变currentQueueGroupID.
void CompositorChain::RQListener::flushUpTo(uint8 id) { /// Process all RenderSystemOperations up to and including render queue id. /// Including, because the operations for RenderQueueGroup x should be executed /// at the beginning of the RenderQueueGroup render for x. while(currentOp != lastOp && currentOp->first <= id) { currentOp->second->execute(mSceneManager, mRenderSystem); ++currentOp; } }
7.当mCompiledState中的TargetOperation渲染完成后,然后到了主视图的RenderTarget中的preViewportUpdate更新mOutputOperation,前面说过,这也是一个TargetOperation,但是不会在RenderTarget中的preRenderTargetUpdate那里调用更新,mOutputOperation本身的RenderTarget为空,而和主视图RenderTarget共用一个viewport.这个效果就是mOutputOperation的更新就是主视图的RenderTarget更新(设置viewport,会把viewport中的RenderTarget 放入渲染中,详见RenderSystem::_setRenderTarget ).
如上CompositorChain最后的渲染效果会放入到主视图的RenderTarget,我们看到的就是经过CompositorChain后的效果.
如果上面流程不清楚,请看Ogre 监听类与渲染流程.
