Dynamic vs. static maintenance rate policies for multi-state queueing systems
RAIRO. Operations Research, Tome 55 (2021), pp. S1339-S1354

This paper considers a single-server queueing system with server breakdowns. When the server fails, it is sent to repair immediately and its maintenance rate is allowed to be adjustable. The goal is to find the optimal maintenance rates that minimize the long-run average cost of the system. We address the static and dynamic maintenance control problems respectively. For the static control model, we derive the stationary system performances and the explicit solution of the optimal maintenance rate. Then regarding the dynamic maintenance problem, we formulate it as a Markov decision process (MDP) and the optimal dynamic policy is proved to be a threshold policy. Based on the structure of optimal dynamic policy, we construct a performance evaluation for computing efficiently the optimal threshold and average cost. Finally, a comparative study of the dynamic and static policies is presented by numerical experiment which shows the impact of system parameters on the optimal maintenance policies.

DOI : 10.1051/ro/2020034
Classification : 90B22, 60K25
Keywords: Queueing system, maintenance rate, MDP, performance evaluation
@article{RO_2021__55_S1_S1339_0,
     author = {Chen, Gang and Liu, Zaiming and Chu, Yuqing},
     title = {Dynamic vs. static maintenance rate policies for multi-state queueing systems},
     journal = {RAIRO. Operations Research},
     pages = {S1339--S1354},
     year = {2021},
     publisher = {EDP-Sciences},
     volume = {55},
     doi = {10.1051/ro/2020034},
     mrnumber = {4223153},
     zbl = {1469.90055},
     language = {en},
     url = {https://www.numdam.org/articles/10.1051/ro/2020034/}
}
TY  - JOUR
AU  - Chen, Gang
AU  - Liu, Zaiming
AU  - Chu, Yuqing
TI  - Dynamic vs. static maintenance rate policies for multi-state queueing systems
JO  - RAIRO. Operations Research
PY  - 2021
SP  - S1339
EP  - S1354
VL  - 55
PB  - EDP-Sciences
UR  - https://www.numdam.org/articles/10.1051/ro/2020034/
DO  - 10.1051/ro/2020034
LA  - en
ID  - RO_2021__55_S1_S1339_0
ER  - 
%0 Journal Article
%A Chen, Gang
%A Liu, Zaiming
%A Chu, Yuqing
%T Dynamic vs. static maintenance rate policies for multi-state queueing systems
%J RAIRO. Operations Research
%D 2021
%P S1339-S1354
%V 55
%I EDP-Sciences
%U https://www.numdam.org/articles/10.1051/ro/2020034/
%R 10.1051/ro/2020034
%G en
%F RO_2021__55_S1_S1339_0
Chen, Gang; Liu, Zaiming; Chu, Yuqing. Dynamic vs. static maintenance rate policies for multi-state queueing systems. RAIRO. Operations Research, Tome 55 (2021), pp. S1339-S1354. doi: 10.1051/ro/2020034

[1] S. K. Abeygunawardane, P. Jirutitijaroen and H. Xu, Adaptive maintenance policies for aging devices using a Markov decision process. IEEE Trans. Power Syst. 28 (2013) 3194–3203. | DOI

[2] J. S. Borrero and R. Akhavan-Tabatabaei, Time and inventory dependent optimal maintenance policies for single machine workstations: an MDP approach. Eur. J. Oper. Res. 228 (2013) 545–555. | MR | Zbl | DOI

[3] S.-P. Chen, Time value of delays in unreliable production systems with mixed uncertainties of fuzziness and randomness. Eur. J. Oper. Res. 255 (2016) 834–844. | MR | Zbl | DOI

[4] D. Chen and K. S. Trivedi, Optimization for condition-based maintenance with semi-Markov decision process. Reliab. Eng. Sys. Saf. 90 (2005) 25–29. | DOI

[5] S. Creemers and M. Lambrecht, Queueing models for appointment-driven systems. Ann. Oper. Res. 178 (2010) 155–172. | MR | Zbl | DOI

[6] S. Gao, J. Wang and T. Van Do, Analysis of a discrete-time repairable queue with disasters and working breakdowns. RAIRO:OR 53 (2019) 1197–1216. | MR | Zbl | Numdam | DOI

[7] J. Kenne and L. Nkeungoue, Simultaneous control of production, preventive and corrective maintenance rates of a failure-prone manufacturing system. Appl. Numer. Math. 58 (2008) 180–194. | MR | Zbl | DOI

[8] J. P. Kenné, E. Boukas and A. Gharbi, Control of production and corrective maintenance rates in a multiple-machine, multiple-product manufacturing system. Math. Comput. Model. 38 (2003) 351–365. | MR | Zbl | DOI

[9] S. Khalili, H. Hosseini Nasab and F. Moobed, Optimal assignment of human resources for maintenance departments using fuzzy queuing systems. Int. J. Prod. Res. 53 (2015) 4583–4593. | DOI

[10] M. J. Kim and V. Makis, Optimal maintenance policy for a multi-state deteriorating system with two types of failures under general repair. Comput. Ind. Eng. 57 (2009) 298–303. | DOI

[11] G. Koole, Monotonicity in Markov Reward and Decision Chains: Theory and Applications. Foundations and Trends[circleR] in Stochastic Systems 1 (1) (2007) 1–76. | Zbl

[12] M. A. Lariviere and J. A. Van Mieghem, Strategically seeking service: how competition can generate Poisson arrivals. Manuf. Serv. Oper. Manage. 6 (2004) 23–40. | DOI

[13] G. Latouche and V. Ramaswami, Introduction to Matrix Analytic Methods in Stochastic Modeling. SIAM 5 (1999). | MR | Zbl

[14] A. N. Njike, R. Pellerin and J. P. Kenne, Simultaneous control of maintenance and production rates of a manufacturing system with defective products. J. Intell. Manuf. 23 (2012) 323–332. | DOI

[15] M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons Inc., New York, NY (2014). | Zbl

[16] N. Salari and V. Makis, Optimal preventive and opportunistic maintenance policy for a two-unit system. Int. J. Adv. Manuf. Technol. 89 (2017) 665–673. | DOI

[17] S. Taleb and A. Aissani, Preventive maintenance in an unreliable M / G / 1 retrial queue with persistent and impatient customers. Ann. Oper. Res. 247 (2016) 291–317. | MR | Zbl | DOI

[18] H. C. Tijms, Stochastic Models: An Algorithmic Approach. In Vol. 303 of Probability and Statistics - Applied Probability and Statistics Section. John Wiley & Sons Inc., New York, NY (1994). | Zbl | MR

[19] K.-H. Wang, W.-L. Chen and D.-Y. Yang, Optimal management of the machine repair problem with working vacation: Newton’s method. J. Comput. Appl. Math. 233 (2009) 449–458. | MR | Zbl | DOI

[20] C.-H. Wu, W.-C. Lee, J.-C. Ke and T.-H. Liu, Optimization analysis of an unreliable multi-server queue with a controllable repair policy. Comput. Oper. Res. 49 (2014) 83–96. | MR | Zbl | DOI

[21] R. H. Yeh, K.-C. Kao and W. L. Chang, Optimal preventive maintenance policy for leased equipment using failure rate reduction. Comput. Ind. Eng. 57 (2009) 304–309. | DOI

[22] G. Yingkui and L. Jing, Multi-state system reliability: a new and systematic review. Proc. Eng. 29 (2012) 531–536. | DOI

[23] Z. Zheng, W. Zhou, Y. Zheng and Y. Wu, Optimal maintenance policy for a system with preventive repair and two types of failures. Comput. Ind. Eng. 98 (2016) 102–112. | DOI

Cité par Sources :