Abstract:Automated monitoring of dark web (DW) platforms on a large scale is the first step toward developing proactive Cyber Threat Intelligence (CTI). While there are efficient methods for collecting data from the surface web, large-scale dark web data collection is often hindered by anti-crawling measures. In particular, text-based CAPTCHA serves as the most prevalent and prohibiting type of these measures in the dark web. Text-based CAPTCHA identifies and blocks automated crawlers by forcing the user to enter a combination of hard-to-recognize alphanumeric characters. In the dark web, CAPTCHA images are meticulously designed with additional background noise and variable character length to prevent automated CAPTCHA breaking. Existing automated CAPTCHA breaking methods have difficulties in overcoming these dark web challenges. As such, solving dark web text-based CAPTCHA has been relying heavily on human involvement, which is labor-intensive and time-consuming. In this study, we propose a novel framework for automated breaking of dark web CAPTCHA to facilitate dark web data collection. This framework encompasses a novel generative method to recognize dark web text-based CAPTCHA with noisy background and variable character length. To eliminate the need for human involvement, the proposed framework utilizes Generative Adversarial Network (GAN) to counteract dark web background noise and leverages an enhanced character segmentation algorithm to handle CAPTCHA images with variable character length. Our proposed framework, DW-GAN, was systematically evaluated on multiple dark web CAPTCHA testbeds. DW-GAN significantly outperformed the state-of-the-art benchmark methods on all datasets, achieving over 94.4% success rate on a carefully collected real-world dark web dataset. We further conducted a case study on an emergent Dark Net Marketplace (DNM) to demonstrate that DW-GAN eliminated human involvement by automatically solving CAPTCHA challenges with no more than three attempts. Our research enables the CTI community to develop advanced, large-scale dark web monitoring. We make DW-GAN code available to the community as an open-source tool in GitHub.

Using Generative Adversarial Networks to Break and Protect Text Captchas

Yet Another Text Captcha Solver

An End-to-End Attack on Text-based CAPTCHAs Based on Cycle-Consistent Generative Adversarial Network

Text Captcha is Dead? A Large Scale Deployment and Empirical Study.

Robust Text CAPTCHAs Using Adversarial Examples

TICS: Text–image-Based Semantic CAPTCHA Synthesis Via Multi-Condition Adversarial Learning

Counteracting Dark Web Text-Based CAPTCHA with Generative Adversarial Learning for Proactive Cyber Threat Intelligence

Applying Visual Cryptography to Enhance Text Captchas

Captcha Attack: Turning Captchas Against Humanity

Adversarial CAPTCHAs

An optimized system to solve text-based CAPTCHA

Robust CAPTCHAs Towards Malicious OCR

Repairing Adversarial Texts Through Perturbation

A machine learning attack against variable-length Chinese character CAPTCHAs

A Survey of Adversarial CAPTCHAs on its History, Classification and Generation

Breaking reCAPTCHAv2

The Robustness of a New 3D CAPTCHA

How Secure is Your Website? A Comprehensive Investigation on CAPTCHA Providers and Solving Services

Generating Natural Language Adversarial Examples on a Large Scale with Generative Models

Deep-CAPTCHA: a deep learning based CAPTCHA solver for vulnerability assessment

Towards Understanding the Security of Modern Image Captchas and Underground Captcha-Solving Services