2023 |
Ceschin, Fabrício; Botacin, Marcus; Bifet, Albert; Pfahringer, Bernhard; Oliveira, Luiz S; Gomes, Heitor Murilo; Grégio, André Machine Learning (In) Security: A Stream of Problems Journal Article Digital Threats, 2023, ISSN: 2692-1626, (Just Accepted). Abstract | Links | BibTeX | Tags: cybersecurity, Data streams, Machine learning @article{10.1145/3617897, title = {Machine Learning (In) Security: A Stream of Problems}, author = {Fabrício Ceschin and Marcus Botacin and Albert Bifet and Bernhard Pfahringer and Luiz S Oliveira and Heitor Murilo Gomes and André Grégio}, url = {https://doi.org/10.1145/3617897 https://secret.inf.ufpr.br/papers/fabricio_mlinsec_dtrap.pdf}, doi = {10.1145/3617897}, issn = {2692-1626}, year = {2023}, date = {2023-09-01}, journal = {Digital Threats}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, abstract = {Machine Learning (ML) has been widely applied to cybersecurity and is considered state-of-the-art for solving many of the open issues in that field. However, it is very difficult to evaluate how good the produced solutions are, since the challenges faced in security may not appear in other areas. One of these challenges is the concept drift, which increases the existing arms race between attackers and defenders: malicious actors can always create novel threats to overcome the defense solutions, which may not consider them in some approaches. Due to this, it is essential to know how to properly build and evaluate an ML-based security solution. In this paper, we identify, detail, and discuss the main challenges in the correct application of ML techniques to cybersecurity data. We evaluate how concept drift, evolution, delayed labels, and adversarial ML impact the existing solutions. Moreover, we address how issues related to data collection affect the quality of the results presented in the security literature, showing that new strategies are needed to improve current solutions. Finally, we present how existing solutions may fail under certain circumstances, and propose mitigations to them, presenting a novel checklist to help the development of future ML solutions for cybersecurity.}, note = {Just Accepted}, keywords = {cybersecurity, Data streams, Machine learning}, pubstate = {published}, tppubtype = {article} } Machine Learning (ML) has been widely applied to cybersecurity and is considered state-of-the-art for solving many of the open issues in that field. However, it is very difficult to evaluate how good the produced solutions are, since the challenges faced in security may not appear in other areas. One of these challenges is the concept drift, which increases the existing arms race between attackers and defenders: malicious actors can always create novel threats to overcome the defense solutions, which may not consider them in some approaches. Due to this, it is essential to know how to properly build and evaluate an ML-based security solution. In this paper, we identify, detail, and discuss the main challenges in the correct application of ML techniques to cybersecurity data. We evaluate how concept drift, evolution, delayed labels, and adversarial ML impact the existing solutions. Moreover, we address how issues related to data collection affect the quality of the results presented in the security literature, showing that new strategies are needed to improve current solutions. Finally, we present how existing solutions may fail under certain circumstances, and propose mitigations to them, presenting a novel checklist to help the development of future ML solutions for cybersecurity. |
2023 |
Machine Learning (In) Security: A Stream of Problems Journal Article Digital Threats, 2023, ISSN: 2692-1626, (Just Accepted). |