Phishing detectors built on engineered website features attain near-perfect accuracy under i.i.d. evaluation, yet deployment security depends on robustness to post-deployment feature manipulation. We study this gap through a cost-aware evasion framework that models discrete, monotone feature edits under explicit attacker budgets. Three diagnostics are introduced: minimal evasion cost (MEC), the evasion survival rate
, and the robustness concentration index (RCI). On the UCI Phishing Websites benchmark (11,055 instances, 30 ternary features), Logistic Regression, Random Forests, Gradient Boosted Trees, and XGBoost all achieve
under static evaluation. Under budgeted sanitization-style evasion, robustness converges across architectures: the median MEC equals 2 with full features, and over 80% of successful minimal-cost evasions concentrate on three low-cost surface features. Feature restriction improves robustness only when it removes all dominant low-cost transitions. Under strict cost schedules, infrastructure-leaning feature sets exhibit 17% - 19% infeasible mass for ensemble models, while the median MEC among evadable instances remains unchanged. We formalize this convergence: if a positive fraction of correctly detected phishing instances admit evasion through a single feature transition of minimal cost
, no classifier can raise the corresponding MEC quantile above
without modifying the feature representation or cost model. Adversarial robustness in phishing detection is governed by feature economics rather than model complexity.
References
[1]
Basit, A., Zafar, M., Liu, X., Javed, A.R., Jalil, Z. and Kifayat, K. (2020) A Comprehensive Survey of AI-Enabled Phishing Attacks Detection Techniques. Telecommunication Systems, 76, 139-154. https://doi.org/10.1007/s11235-020-00733-2
[2]
Mohammad, R.M., Thabtah, F. and McCluskey, L. (2014) Predicting Phishing Websites Based on Self-Structuring Neural Network. Neural Computing and Applications, 25, 443-458. https://doi.org/10.1007/s00521-013-1490-z
[3]
Sahingoz, O.K., Buber, E., Demir, O. and Diri, B. (2019) Machine Learning Based Phishing Detection from URLs. Expert Systems with Applications, 117, 345-357. https://doi.org/10.1016/j.eswa.2018.09.029
[4]
Do, N.Q., Selamat, A., Krejcar, O., Herrera-Viedma, E. and Fujita, H. (2022) Deep Learning for Phishing Detection: Taxonomy, Current Challenges and Future Directions. IEEE Access, 10, 36429-36463. https://doi.org/10.1109/access.2022.3151903
[5]
Biggio, B. and Roli, F. (2018) Wild Patterns: Ten Years after the Rise of Adversarial Machine Learning. Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security, Toronto, 15-19 October 2018, 2154-2156. https://doi.org/10.1145/3243734.3264418
[6]
Apruzzese, G., Anderson, H.S., Dambra, S., Freeman, D., Pierazzi, F. and Roundy, K. (2023) “Real Attackers Don’t Compute Gradients”: Bridging the Gap between Adversarial ML Research and Practice. 2023 IEEE Conference on Secure and Trustworthy Machine Learning (SaTML), Raleigh, 8-10 February 2023, 339-364. https://doi.org/10.1109/satml54575.2023.00031
[7]
Biggio, B., Corona, I., Maiorca, D., Nelson, B., Šrndić, N., Laskov, P., et al. (2013) Evasion Attacks against Machine Learning at Test Time. In: Lecture Notes in Computer Science, Springer, 387-402. https://doi.org/10.1007/978-3-642-40994-3_25
[8]
Khonji, M., Iraqi, Y. and Jones, A. (2013) Phishing Detection: A Literature Survey. IEEE Communications Surveys & Tutorials, 15, 2091-2121. https://doi.org/10.1109/surv.2013.032213.00009
[9]
Lin, Y., Liu, R., Divakaran, D.M., Ng, J.Y., et al. (2021) Phishpedia: A Hybrid Deep Learning Based Approach to Visually Identify Phishing Webpages. Proceedings of the 30th USENIX Security Symposium, Vancouver, 11-13 August 2021, 3793-3810.
[10]
Oest, A., Safaei, Y., Doupé, A., Ahn, G.J., et al. (2020) Sunrise to Sunset: Analyzing the End-to-End Life Cycle and Effectiveness of Phishing Attacks at Scale. 2020 29th USENIX Security Symposium, Boston, 12-14 August 2020, 361-377.
[11]
Bijmans, P.H., Booij, T.M. and van Eeten, M. (2021) Catching Phishers by Their Bait: Investigating the Dutch Phishing Landscape through Phishing Kit Analysis. Proceedings of the 30th USENIX Security Symposium, Vancouver, 11-13 August 2021, 3757-3774.
[12]
Ruan, W.J., Yi, X.P. and Huang, X.W. (2021) Adversarial Robustness of Deep Learning: Theory, Algorithms, and Applications. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Queensland, 1-5 November 2021, 4866-4869.
[13]
Pierazzi, F., Pendlebury, F., Cortellazzi, J. and Cavallaro, L. (2020). Intriguing Properties of Adversarial ML Attacks in the Problem Space. 2020 IEEE Symposium on Security and Privacy (SP), San Francisco, 18-21 May 2020, 1332-1349. https://doi.org/10.1109/sp40000.2020.00073
[14]
Carlini, N. and Wagner, D. (2017) Towards Evaluating the Robustness of Neural Networks. 2017 IEEE Symposium on Security and Privacy (SP), San Jose, 22-26 May 2017, 39-57. https://doi.org/10.1109/sp.2017.49
[15]
Goodfellow, I.J., Shlens, J., and Szegedy, C. (2015) Explaining and Harnessing Adversarial Examples. 2015 3rd International Conference on Learning Representations, San Diego, 7-9 May 2015, 11 p.
[16]
Corona, I., Biggio, B., Contini, M., Piras, L., Corda, R., Mereu, M., et al. (2017) DeltaPhish: Detecting Phishing Webpages in Compromised Websites. In: Lecture Notes in Computer Science, Springer, 370-388. https://doi.org/10.1007/978-3-319-66402-6_22
[17]
Xu, W., Qi, Y. and Evans, D. (2016) Automatically Evading Classifiers: A Case Study on PDF Malware Classifiers. Proceedings 2016 Network and Distributed System Security Symposium, San Diego, 21-24 February 2016, 1-15. https://doi.org/10.14722/ndss.2016.23115
[18]
Das, A., Baki, S., El Aassal, A., Verma, R. and Dunbar, A. (2020) SoK: A Comprehensive Reexamination of Phishing Research from the Security Perspective. IEEE Communications Surveys & Tutorials, 22, 671-708. https://doi.org/10.1109/comst.2019.2957750
[19]
Mohammad, R.M., Thabtah, F. and McCluskey, L. (2015) Phishing Websites Data Set. UCI Machine Learning Repository. https://archive.ics.uci.edu/ml/datasets/phishing+websites
[20]
Rao, R.S., Vaishnavi, T. and Pais, A.R. (2020) CatchPhish: Detection of Phishing Websites by Inspecting URLs. JournalofAmbientIntelligenceandHumanizedComputing, 11, 813-825. https://doi.org/10.1007/s12652-019-01311-4