Time-series and machine-learning methods are being strongly exploited to improve the accuracy of short-term load forecasting (STLF) results. In developing countries, power consumption behaviors could be suddenly changed by different customers, e.g. industrial customers, residential customers, so the load-demand dataset is often unstable. Therefore, reliability assessment of the load-demand dataset is obviously necessary for STLF models. Hence, this paper proposes a novel and unified statistical data-filtering method with the best confidence interval to eliminate unexpected noises/outliers of the input dataset before performing various short-term load forecasting models. This proposed novel data-filtering method, so-called the data pre-processing method, is also compared to other existing data-filtering methods (e.g. Kalman filter, Density-Based Spatial Clustering of Applications with Noise, Wavelet transform, and Singular Spectrum Analysis). By using an SCADA system-based database of a typical 22kV distribution network in Vietnam, NYISO database, and PJM-RTO database, case studies of short-term load forecasting have been conducted with a conventional ARIMA model, an ANN forecasting model, an LSTM-RNN model, an LSTM-CNN combined model, a deep auto-encoder (DAE) network, a Wavenet-based model, a Wavenet and LSTM hybrid model, and a Wavelet Neural Network (WNN) model, which are to validate the novel and unified statistical data-filtering method proposed. The achieved numerical results demonstrate which the accuracy of the aforementioned STLF models can be significantly improved due to the proposed statistical data-filtering method with the best confidence interval of the input load dataset. The proposed statistical data-filtering method can considerably outperform the existing data-filtering methods.