The research presents a novel under-sampling technique that leverages Principal Component Analysis (PCA) to address imbalanced datasets by minimizing the sum of Euclidean distances in representative subsets of majority class data. The proposed method was evaluated against eight established under-sampling approaches across three classification models, demonstrating superior performance in predictive metrics such as sensitivity and the Matthews correlation coefficient on 35 datasets. This method effectively balances class representation, mitigating the issues typically encountered in machine learning with imbalanced data scenarios.