Gradient Boosting Machine, Random Forest dan Light GBM untuk Klasifikasi Kacang Kering

Bean seed classification is critical in determining the quality of beans. Previously, the same dataset was tested using the MLP, SVM, KNN, and DT algorithms, with SVM producing the best results. The purpose of this study is to determine the most effective model through the use of the BoxCox transformation selection feature and the random forest (RF) algorithm, as well as the gradient boosting machine (GBM), light GBM, and repeated k-folds evaluation model. The bean dataset is available on the UCI Repository website. The BoxCox transformation and repeated k-folds improved the classification prediction's accuracy. The model is used in the optimal training phase for a random forest with decision tree parameters 50 and depth 10, a gradient boosting machine model with a learning rate of 1, and a light gradient boosting machine model with a learning rate of 0.5 and estimator of 500. The best training accuracy results are obtained with light GBM. which is 99 percent accurate, but only 91 percent accurate in terms of validation. According research, the Barbunya, Bombay, Cali, Dermason, Horoz, Seker, and Sira beans classes provided accuracy values of 91 percent, 100 percent, 92 percent, 92 percent, 95 percent, 94 percent, and 84 percent, respectively.  Klasifikasi biji kacang sangat penting dalam penentuan mutu kacang. Dataset yang sama sebelumnya telah diuji menggunakan algoritma MLP, SVM, KNN dan DT, dimana SVM memberikan hasil yang paling baik. Penelitian ini bertujuan untuk melihat model yang paling efektif dengan menggunakan fitur seleksi transformasi BoxCox dan algoritma random forest (RF), gradient boosting machine (GBM), light GBM serta model evaluasi repeated k-folds. Dataset kacang berasal dari website UCI Repository. Didapatkan  bahwa transformasi BoxCox dan repeated k-folds meningkatkan akurasi dari prediksi klasifikasi. Penggunaan pada model pada fase training terbaik untuk random forest dengan paramater pohon keputusan 50 dan depth 10, model gradient boosting machine pada learning rate 1, dan model light gradient boosting pada learning rate 0,5 dan estimator 500. Light GBM memberikan hasil akurasi training terbaik yakni 99 persen namun akurasi validasi hanya 91 persen. Dari prediksi tersebut, didapatkan hasil bahwa Kelas kacang Barbunya, Bombay, Cali, Dermason, Horoz, Seker dan Sira memberikan nilai akurasi berturut-turut yakni 91%, 100%, 92%, 92%, 95%, 94% dan 84%