Abstract:ABSTRACTThis paper is concerned with mining link spams (e.g., link farm and link exchange) from search engine optimization (SEO) forums. To provide quality services, it is critical for search engines to address web spam. Several techniques such as TrustRank, BadRank, and SpamRank have been proposed for this purpose. Most of these methods try to downgrade the effects of the spam websites by identifying specific link patterns of them. However, spam websites have appeared to be more and more similar to normal or even good websites in their link structures, by reforming their spam techniques. As a result, it is very challenging to automatically detect link spams from the Web graph. In this paper, we propose a different approach, which detects link spams by looking at how web spammers make link spam happen. We find that web spammers usually ally with each other, and SEO forum is one of the major means for them to form the alliance. We therefore propose mining suspicious link spams directly from the posts in the SEO forums. However, the task is non-trivial because there are also other information and even noises contained in these posts, in addition to useful clues of link spam. To tackle the challenges, we first extract all the URLs contained in the posts of the SEO forums. Second, we extract features for the URLs from their relationships with forum users (potential spammers) and from their link structure in the web graph. Third, we build a semi-supervised learning framework to calculate the spam scores for the URLs, which encodes several heuristics such as spam websites usually linking to each other, and good websites seldom linking to spam websites. We tested our approach on seven major SEO forums. A lot of spam websites were identified, a significant proportion of which cannot be detected by conventional anti-spam methods. It indicates that the proposed approach can be a good complement of existing anti-spam techniques.

Extracting URLs from JavaScript via program analysis.

An Analysis of URLs Generated from JavaScript Code

Automatic Extraction Of Commodity Attributes On Webpages Based On Hierarchical Structure

Automatically Crawling Dynamic Web Applications Via Proxy-Based JavaScript Injection and Runtime Analysis.

An Efficient Valid Page Crawling Approach for Websites with Dynamic Scripts

Malicious JavaScript Code Detection Based on Hybrid Analysis

Detection and analysis of malicious JavaScript code based on pre-filter

Looking for Criminal Intents in JavaScript Obfuscated Code

Statically Detecting JavaScript Obfuscation and Minification Techniques in the Wild

Detecting Malicious JavaScript Code Based on Semantic Analysis.

Unveiling Web Fingerprinting in the Wild Via Code Mining and Machine Learning

An analysis of the dynamic behavior of JavaScript programs

Let web spammers expose themselves.

JStill: mostly static detection of obfuscated malicious JavaScript code

A Review on JavaScript Engine Vulnerability Mining

Efficient and Precise Dynamic Slicing for Client-Side JavaScript Programs.

Detecting Malicious Websites in Depth through Analyzing Topics and Web-pages

JSRevealer: A Robust Malicious JavaScript Detector Against Obfuscation.

Detecting Malicious Behaviors in JavaScript Applications.

A new model for Web URL extraction

Extraction of Relevant Components Using Shallow Structure of HTML Documents.