An application of Bayesian network for predicting object-oriented software maintainability

Preprint submitted to Elsevier ScienceAs the number of object-oriented software systems increases, it becomes more important for organizations to maintain those systems effectively. However, currently only a small number of maintainability prediction models are available for object-oriented systems. This paper presents a Bayesian network maintainability prediction model for an object-oriented software system. The model is constructed using object-oriented metric data in Li and Henry’s datasets, which were collected from two different object-oriented systems. Prediction accuracy of the model is evaluated and compared with commonly used regression-based models. The results suggest that the Bayesian network model can predict maintainability more accurately than the regression-based models for one system, and almost as accurately as the best regression-based model for the other system.UnpublishedA.J. Albrecht and J.E. Gaffney. Software function, source lines of code, and development effort prediction: a software science validation. IEEE Transactions on Software Engineering, SE–9(6):639–648, 1983. J. Baik, B. Boehm, and B.M. Steece. Disaggregating and calibrating the CASE tool variable in COCOMO II. IEEE Transactions on Software Engineering, 28(11):1009–1022, 2002. B.W. Boehm. Software Engineering Economics. Prentice–Hall, 1981. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone. Classification and Regression Trees. Chapman&Hall, 1993. L.C. Briand, K.E. Emam, D. Surmann, I. Wieczorek, and K.D. Maxwell. An assessment and comparison of common software cost estimation modelling techniques. In Proceedings of the 21st International Conference on Software Engineering (ICSE’99), pages 313–322, 1999. L.C. Briand, T. Langley, and I. Wieczorek. A replicated assessment and comparison of common software cost estimation modelling techniques. In Proceedings of the 22nd International Conference on Software Engineering (ICSE’00), pages 377–386, 2000. L.C. Briand and J. Wüst. The impact of design properties on development cost in object-oriented systems. In Proceedings of the 7th International Software Metrics Symposium (METRICS’01), pages 260–271, 2001. L.C. Briand and J. Wüst. Modeling development effort in object-oriented systems using design properties. IEEE Transactions on Software Engineering, 27(11):963–986, 2001. W. Buntine. A guide to the literature on learning probabilistic networks from data. IEEE Transactions on Knowledge and Data Engineering, 8(2):195–210, 1996. S.R. Chidamber and C.F. Kemerer. A metrics suite for object-oriented design. IEEE Transactions on Software Engineering, 20(6):476–493, 1994. S. Chulani, B. Boehm, and B.M. Steece. Bayesian analysis of empirical software engineering cost models. IEEE Transactions on Software Engineering, 25(4):513–583, 1999. P. Congdon. Bayesian Statistical Modelling. John Wiley & Sons., 2001. S.D. Conte, H.E. Dunsmore, and V.Y. Shen. Software Engineering Metrics and Models. Benjamin/Cummings Publishing Company, 1986. R.G. Cowell, A.P. Dawid, S.L. Lauritzen, and D.J. Spiegelhalter. Probabilistic Networks and Expert Systems. Springer–Verlag New York, 1999. N. Fenton and M. Neil. A critique of software defect prediction models. IEEE Transactions on Software Engineering, 25(5):675–689, 1999. N.E. Fenton and S.L. Pfleeger. Software Metrics:A Rigorous & Practical Approach. PWS Publishing Company, second edition, 1997. F. Fioravanti and P. Nesi. Estimation and prediction metrics for adaptive maintenance effort of object-oriented systems. IEEE Transactions on Software Engineering, 27(12):1062–1084, 2001. T. Foss, E. Stensrud, B. Kitchenham, and I. Myrtveit. A simulation study of the model evaluation criterion mmre. IEEE Transactions on Software Engineering, 29(11):985–995, 2003. A.R. Gray. A simulation-based comparison of empirical modelling techniques for software metrics models of development effort. In Proceedings of the 6th International Conference on Neural Information processing (ICONIP’99), volume II, pages 526–531, 1999. D. Heckerman and M.P. Wellman. Bayesian networks. Communications of the ACM, 38(3):27–30, 1995. R. Jeffery, M. Ruhe, and I. Wieczorek. Using public domain metrics to estimate software development effort. In Proceedings of the 7th International Software Metrics Symposium (METRICS’01), pages 16–27, 2001. F.V. Jensen. Bayesian Networks and Decision Graphs. Springer–Verlag New York, 2001. J. Kaczmarek and M. Kucharski. Size and effort estimation for applications written in java. Information and Software Technology, 46:589–601, 2004. B.A. Kitchenham, L.M. Pickard, S.G. MacDonell, and M.J. Shepperd. What accuracy statistics really measure. IEE Proceedings–Software, 148(3):81–85, 2001. W. Li and S. Henry. Object-oriented metrics that predict maintainability. Journal of Systems and Software, 23:111–122, 1993. A. De Lucia, E. Pompella, and S. Stefanucci. Assessing effort estimation models for corrective maintenance through empirical studies. Information and Software Technology, 47:3–15, 2005. S.G. MacDonell. Establishing relationships between specification size and software process effort in case environment. Information and Software Technology, 39:35–45, 1997. M. Neil, N. Fenton, and L. Nielsen. Building large-scale bayesian networks. The Knowledge Engineering Review, 15(3):257–284, 2000. L. Pickard, B. Kitchenham, and S. Linkman. An investigation of analysis techniques for software datasets. In Proceedings of the 6th International Software Metrics Symposium (METRICS’99), pages 130–142, 1999. K. Srinivasan and D. Fisher. Machine learning approaches to estimating software development effort. IEEE Transactions on Software Engineering, 21(2):126–137, 1995. I. Stamelos, L. Angelis, P. Dimou, and E. Sakellaris. On the use of Bayesian belief networks for the prediction of software productivity. Information and Software Technology, 45:51–60, 2003. E. Stensrud. Alternative approaches to effort prediction of erp projects. Information and Software Technology, 43:413–423, 2001. E. Stensrud, T. Foss, B.A. Kitchenham, and I. Myrtveit. An empirical validation of the relationship between the magnitude of relative error and project size. In Proceedings of the 8th IEEE Symposium on Software Metrics (METRICS’02), pages 3–12, 2002. B. Stewart. Predicting project delivery rates using the Naive–Bayes classifier. Journal of Software Maintenance and Evolution: Research and Practice, 14:161–179, 2002