PHP Scraper: Extract structured data from remote HTML pages

Recommend this page to a friend!

Download .zip

Info

Example

View files (2)

Download .zip

Reputation

Support forum (8)

Blog

Links

Ratings				Unique User Downloads		Download Rankings
52%				Total: 6,193		All time: 359 This week: 171

Version		License		PHP version		Categories
`phpscraper` 1.0.0		GNU General Publi...		3		HTML, Web services

Description

Author

Antonio Rodrigues

This class is meant to fetch remote HTML pages and parse them to extract structured information into arrays.

It can take a model of the definition of the structure of a given page and process it to clip the relevant fields of information.

Antonio Rodrigues

Name:	Antonio Rodrigues `<contact>`
Classes:	1 package by Antonio Rodrigues
Country:	Portugal
Age:	???
All time rank:	458	5 in Portugal
Week rank:	441	9 in Portugal

Recommendations

What is the best PHP web content crawler class?
Extracting content by passing the URL of a web site

Example


<?

require_once ("class_scraper.php");



// Get html --------

$o_sc = new scraper();

$s_url = 'http://finance.yahoo.com/q/hp?s=AMZN';

$s_user_agent = 'Mozilla/5.0 (X11; U; SunOS sun4u; en-US; rv:1.0.1) Gecko/20020921 Netscape/7.0';

$s_html = $o_sc->browse($s_url, $s_user_agent);



// Delimit start and end of patterns

$s_start_pattern = "Adj Close";

$s_end_pattern = "<small>";



// Pattern structure

$s_model = '<tr

<td

<field>

</td>

<td

<field>

</td>

<td

<field>

</td>

<td

<field>

</td>

<td

<field>

</td>

<td

<field>

</td>

<td

<field>

</td>

/tr>';



$a_result = $o_sc->extract($s_html, $s_start_pattern, $s_end_pattern, $s_model);

print_r ($a_result);



?>

Files

File	Role	Description
`class_scraper.php`	Class	Main class
`test_scraper.php`	Example	Example

	phpscraper-2004-07-17.zip 1KB
	phpscraper-2004-07-17.tar.gz 1KB
	Install with Composer

Version Control

Unique User Downloads

Download Rankings

Total:	6,193
This week:	0

All time:	359
This week:	171

User Ratings

User Comments (4)

	All time
Utility:	77%
Consistency:	77%
Documentation:	-
Examples:	64%
Tests:	-
Videos:	-
Overall:	52%
Rank:	2139

superb 7 years ago (muabshir)	70%
Thanks you have done good work helpful save my time almost 2 ... 12 years ago (Shoaib Jilani)	65%
Good class just comment out the "Clean html" lines to allow n... 14 years ago (Marios Kaintatzis)	67%
it's not flexible enough. 15 years ago (Tudor Pop)	17%