Due to the huge number of financial transactions, it is almost impossible for humans to manually detect fraudulent transactions. In previous work, the datasets are not balanced and the models suffer from overfitting problems. In this paper, we tried to overcome the problems by tuning hyperparameters and balancing the dataset with a hybrid approach using under-sampling and oversampling techniques. In this study, we have observed that these modifications are effective in getting better performance in comparison to the existing models. The MCC score is considered an important parameter in binary classification since it ensures the correct prediction of the majority of positive data instances and negative data instances. So, we emphasize on MCC score and our method achieved an MCC score of 97.09%, which is far more (16 % approx.) than other state-of-the-art methods. In terms of other performance metrics, the result of our proposed model has also improved significantly.