简介:Inthispaper,wediscussMDPwithdiscretetimeparameter-thefirstpassagemodelwithdenumerablestatespace.UnderassumptionAinthispaper,weprovethatanε(>0)-optimalstationarypolicyexists.Tofindanε-optimalstationarypolicy,analgorithmofpolicyimprovementiterationandamethodofsuccessiveapproximationsaregiven.
简介:TheConchy’sformulaofentirefunctionsf:Ck→CisusedtoestablishMarkov-Bernsteintypeinequalitiesofmuhivariatepolynomialswithpositivecoefficientsonthek-dimensionalsimplexTkRkandonthecube[0,1]k.ThemainresultsgeneralizeandimprovethoseofG.G.Lorentz,etc.Someapplicationsofthesemequaltiesarealsoconsideredinpolynomialconstrainedapproximation.
简介:Theadaptivecriticheuristichasbeenapopularalgorithminreinforcementlearning(RL)andapproximatedynamicprogramming(ADP)alike.ItisoneofthefirstRLandADPalgorithms.RLandADPalgorithmsareparticularlyusefulforsolvingMarkovdecisionprocesses(MDPs)thatsufferfromthecursesofdimensionalityandmodeling.Manyreal-worldproblems,however,tendtobesemi-Markovdecisionprocesses(SMDPs)inwhichthetimespentineachtransitionoftheunderlyingMarkovchainsisitselfarandomvariab...
简介:Recently,anewsoft-insoft-outdetectionalgorithmbasedontheMarkovChainMonteCarlo(MCMC)simulationtechniqueforMultiple-InputMultiple-Output(MIMO)systemsisproposed,whichisshowntoperformsignificantlybetterthantheirspheredecodingcounterpartswithrelativelylowcomplexity.However,theMCMCsimulatorislikelytogettrappedinafixedstatewhenthechannelSNRishigh,thuslotsofrepetitivesamplesareobservedandtheaccuracyofAPosterioriProbability(APP)estimationdeteriorates.Tosolvethisproblem,animprovedversionofMCMCsimulator,namedforced-dispersedMCMCalgorithmisproposed.Basedontheaposteriorivarianceofeachbit,theGibbssamplerismonitored.Oncethetrappedstateisdetected,thesampleisdispersedintentionallyaccordingtotheaposteriorivariance.Extensivesimulationshowsthat,comparedwiththeexistingsolution,theproposedalgorithmenablesthemarkovchaintotravelmorestates,whichensuresanear-optimalperformance.
简介:地质灾害发生频数的有效预测有着重要价值。基于灰色理论,将GM(1,1)或修正GM(1,1)模型与灰色状态Markov链模型结合起来。建立地质灾害发生频数预测模型。用2005-2009年我国季度和年发生地质灾害频数进行实例分析,并进行了预测。结果表明:预测结果具有一定参考价值,模型预测是有效的,特别是短期预测效果较好.该方法为地质灾害预测提供了一种方法。
简介:隐藏的Markov建模的侧面(HMMs)广泛地基于古典HMMs被申请了蛋白质顺序鉴定。在侧面HMMs的前面、向后的变量的明确的表达在概率理论的统计独立假设下面被做。我们建议模糊侧面唔定序克服那个假设的限制并且为蛋白质完成改进排列属于一个给定的家庭。建议模型fuzzifies由合并Sugeno的前面、向后的变量模糊措施和Choquet积分,进一步因此延长概括唔。把前面、向后的变量基于fuzzified,我们为侧面建议一个模糊Baum-Welch参数评价算法。强壮的关联和涉及结构使这模糊体系结构基于的蛋白质的顺序偏爱作为造一个给定的家庭的侧面的一个合适的候选人当模特儿,自从模糊集合能比古典方法更好处理无常。
简介:本文主要在原有的G/G/1排队系统的模型中,引入“成批”到达的概念,引入一次到达人数的随机变量ξ,讨论忙期闲期有关的情况.并通过对模型的讨论解决了带有选择的排队过程的分布情况.
简介:ByusingLamperti’sbijectionbetweenself-similarMarkovprocessesandLevyprocesses,weprovefinitenessofmomentsandasymptoticbehaviorofpassagetimesforincreasingself-similarMarkovprocessesvaluedin(0,∞).Wealsoinvestigatethebehavioroftheprocesswhenitcrossesalevel.Alimittheoremconcerningthedistributionoftheprocessimmediatelybeforeitcrossessomelevelisproved.Someusefulexamplesaregiven.
简介:质地分析经常在处理领域的图象被讨论,但是大多数方法在灰色级的图象或颜色图象以内是有限的,并且质地的现在的概念主要基于单身的乐队的灰色级的图象被定义。遥感图象的必要字符之一多维或甚至高度维,并且传统的质地概念不能为这些包含足够的信息。因此,一个合适的质地定义基于遥感想象,对追求必要,它是在这份报纸的第一讨论。这份报纸描述印射的模型光谱在用Markov随机的地(MRF)的二维的图象空格的向量,基于MRF,和分析建立multiband遥感图象的一个质地模型吉布斯的计算势能和吉布斯参数。进一步,这份报纸也分析传统的吉布斯模型的限制,比较喜欢避免参数的评价的一个新吉布斯模型,并且以后介绍为hyperspectral遥感图象的一个新质地分割算法。
简介:Inthispaper,elitistreconstructiongeneticalgorithm(ERGA)basedonMarkovrandomfield(MRF)isintroducedforimagesegmentation.Inthisalgorithm,apopulationofpossiblesolutionsismaintainedateverygeneration,andforeachsolutionafitnessvalueiscalculatedaccordingtoafitnessfunction,whichisconstructedbasedontheMRFpotentialfunctionaccordingtoMetropolisfunctionandBayesianframework.Aftertheimprovedselection,crossoverandmutation,anelitistindividualisrestructuredbasedonthestrategyofrestructuringelitist.ThisprocedureisprocessedtoselectthelocationthatdenotesthelargestMRFpotentialfunctionvalueinthesamelocationofallindividuals.Thealgorithmisstoppedwhenthechangeoffitnessfunctionsbetweentwosequentgenerationsislessthanaspecifiedvalue.Experimentsshowthattheperformanceofthehybridalgorithmisbetterthanthatofsometraditionalalgorithms.
简介:基于随机微分博弈Markov跳变线性系统,利用微分博弈理论讨论其H∞鲁棒控制问题.将随机Markov跳变线性系统的H∞鲁棒控制问题转化为相应的零和博弈模型,在此基础上,利用鞍点均衡理论,得到了其鲁棒控制存在的充分条件等价于相应的差分Rcati方程存在解,并给出了最优控制策略.
简介:AbstractBackground:Multidrug-resistant tuberculosis (MDR-TB) is on the rise in China. This study used a dynamic Markov model to predict the longitudinal trends of MDR-TB in China by 2050 and to assess the effects of alternative control measures.Methods:Eight states of tuberculosis transmission were set up in the Markov model using a hypothetical cohort of 100 000 people. The prevalence of MDR-TB and bacteriologically confirmed drug-susceptible tuberculosis (DS-TB+) were simulated and MDR-TB was stratified into whether the disease was treated with the recommended regimen or not.Results:Without any intervention changes to current conditions, the prevalence of DS-TB+ was projected to decline 67.7% by 2050, decreasing to 20 per 100 000 people, whereas that of MDR-TB was expected to triple to 58/100 000. Furthermore, 86.2% of the MDR-TB cases would be left untreated by the year of 2050. In the case where MDR-TB detection rate reaches 50% or 70% at 5% per year, the decline in prevalence of MDR-TB would be 25.9 and 36.2% respectively. In the case where treatment coverage was improved to 70% or 100% at 5% per year, MDR-TB prevalence in 2050 would decrease by 13.8 and 24.1%, respectively. If both detection rate and treatment coverage reach 70%, the prevalence of MDR-TB by 2050 would be reduced to 28/100 000 by a 51.7% reduction.Conclusions:MDR-TB, especially untreated MDR-TB, would rise rapidly under China’s current MDR-TB control strategies. Interventions designed to promote effective detection and treatment of MDR-TB are imperative in the fights against MDR-TB epidemics.
简介:针对系统动态可靠性中的不确定性问题,将动态故障树分析方法与模糊理论相结合,提出了基于模糊Markov过程的复杂系统动态可靠性仿真评估方法。首先,结合模糊理论与故障树方法,对基于模糊故障树的复杂系统可靠性模型进行了描述;其次,对动态故障树模型与的Markov过程模型的转换方法进行了研究,构建了复杂系统模糊动态可靠性评估模型,给出了系统模糊可靠度MonteCarlo仿真方法,并针对模糊隶属度难以求解的问题,结合目标规划模型,设计了动态隶属度确定算法;最后,以某型内燃机为例,对方法的科学性和有效性进行了验证。