Príklad - výsledky z google
[Translate to Slovak:] Extrakcia webu zo stránky www.google.comhttp://www.google.com. Výstup sa obnovuje každých 15 minút.
Výstup:
Source URL;Link;Title;Description "http://www.google.com/search?hl=en&q=unit+miner";"http://www.qualityunit.com/unitminer/";"UnitMiner - Web data extraction";"UnitMiner - quality software and service for web data extraction." "http://www.google.com/search?hl=en&q=unit+miner";"http://unit-miner.findmysoft.com/";"» Download Unit Miner";"Download the latest version of Unit Miner free. Unit Miner is robust, flexible and easy to use web extraction system." "http://www.google.com/search?hl=en&q=unit+miner";"http://www.shareup.com/Unit_Miner-download-28358.html";"Unit Miner Download";"Unit Miner Download Page. Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from from web sites, ..." "http://www.google.com/search?hl=en&q=unit+miner";"http://www.rocketdownload.com/scripts/program/unit-miner---web-data-extractor-10844.html";"Unit Miner - Web Data Extractor 1.2.11 Free Scripts Download ...";"Jun 11, 2009 ... Download Unit Miner - Web Data Extractor. Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining ..." "http://www.google.com/search?hl=en&q=unit+miner";"http://script.wareseeker.com/download/unit-miner-1.4.0.rar/329661e318";"Download Unit Miner 1.4.0 Free";"Download Unit Miner 1.4.0 Free - Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from web sites, ..." "http://www.google.com/search?hl=en&q=unit+miner";"http://www.abc-directory.com/site/4536884";"Unit Miner - Web data extraction is simple task for Unit Miner.";"Unit Miner - Information Extraction System. Information Extraction." "http://www.google.com/search?hl=en&q=unit+miner";"http://fileshunt.com/rapidshare.php?file=unit+miner";"Unit miner - Rapidshare download";"File http://rapidshare.com/files/.../unit miner download. Fileshunt Rapidshare Search engine." "http://www.google.com/search?hl=en&q=unit+miner";"http://www.download3000.com/script-unit-miner--web-data-extractor-9759.html";"Download Unit Miner - Web Data Extractor";"Download Unit Miner - Web Data Extractor script from developer's website." "http://www.google.com/search?hl=en&q=unit+miner";"http://www.soft32.com/download_79992.html";"Download Unit Miner 1.1.7 Free Trial - Unit Miner is robust ...";"Download Unit Miner 1.1.7 Free Trial - Unit Miner is robust, flexible and easy to use web extraction system." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.sharewarecentral.com/search.html?q=unit+miner";"unit miner - Shareware Central Downloads";"Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from from web sites, documents, or any non-structured ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://wareseeker.com/Network-Internet/unit-miner-1.1.7.zip/345145";"Unit Miner 1.1.7";"Unit Miner 1.1.7 - Unit Miner is robust, flexible and easy to use web extraction system." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.vclcomponents.com/catalog/Data_Mining";"Data Mining: Advanced Data Mining Techniques, Unit Miner, Data ...";"Unit Miner 1.0.0 - PHP / Content Retrieval. A robust, flexible and easy to use system for monitoring, retrieving and mining content from other web sites, ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.filetransit.com/files.php?name=Mining_Map_World_Of_Warcraft-3-1";"Mining Map World Of Warcraft Software - Unit Miner, ht://Miner ...";"Mining Map World Of Warcraft Software Listing (Page3). Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.softpicks.net/list/index5_8_25i.htm";"Internet Utilities software downloads page 25 - Unit Miner, World ...";"This web resourse represents the most popular and the high awarded software titles. Internet Utilities downloads: Unit Miner, World Online TV, ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.abc-directory.com/category/303597";"Computers » Intranet » Information (index): Unit Miner, About.com ...";"Computers - Intranet - Information (index): Web data extraction is simple task for Unit Miner. Computers - Intranet - Information: Site contains original ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.convertunits.com/info/miner's+inch+%5BAZ,+CA,+OR%5D";"Measurement unit conversion: miner's inch [AZ, CA, OR]";"Miner's inch [AZ, CA, OR] is a measure of volume flow rate. Get more information and details on the 'miner's inch [AZ, CA, OR]' measurement unit, ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://rarbg.com/search/torrents/filmi/download/unit%20miner.html";"S , unit miner";"Torrents , filmi , download , muzika , igri , chalga , bezplatno, S , unit miner ." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://webscripts.softpedia.com/scriptScreenshots/Unit-Miner-Screenshots-864.html";"Unit Miner Screenshots, screen capture - Softpedia";"Unit Miner Screenshots, screen capture. ... Screenshot 1 of Unit Miner Unit Miner screenshot 1 ... Unit Miner screenshot 2. Screenshot 3 of Unit Miner ..." "http://www.google.com/search?hl=en&q=unit+miner&start=10&sa=N";"http://www.tk-mining.com/";"ThyssenKrupp Fördertechnik Essen";"ThyssenKrupp Fördertechnik, Business Unit Mining, is one of the leading designers and ... tailor made for every mine and application– from coal to ore." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://www.rand.org/pubs/monograph_reports/MR1324/MR1324.ch3.pdf";"CRITICAL TECHNOLOGIES FOR UNIT OPERATIONS";"PDF/Adobe Acrobat -" "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://findarticles.com/p/news-articles/charleston-gazette-the/mi_8022/is_20100227/thousands-breathing-units-recalled/ai_n50374467/";"Thousands of mine breathing units being recalled | Charleston ...";"Feb 27, 2010 ... Thousands of mine breathing units being recalled from Charleston Gazette, The provided by Find Articles at BNET." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://www.wvgazette.com/topStories13/201002260618";"Thousands of miner breathing units being recalled - Beyond Sago ...";"Feb 26, 2010 ... Once a miner starts breathing through the bag, the exhaled gases react with the unit's chemicals to generate more oxygen for the miner. ..." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://www.findmysoft.com/scripts/Unit-Miner--Web-Data-Extractor-download.html";"» Download Unit Miner - Web Data Extractor";"Nov 19, 2007 ... Download the latest version of Unit Miner - Web Data Extractor free. Unit Miner is robust, flexible and easy to use system for monitoring, ..." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://www.nowtorrents.com/torrents/unit-miner-rapidshare.html";"Unit miner rapidshare Torrent Downloads - NowTorrents";"Download unit miner rapidshare torrents. Download your favorite unit miner rapidshare torrents at NowTorrents." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://4megaupload.com/unit-miner.html";"Unit miner - Megaupload Search";"Download unit miner for free. Download your favorite unit miner files at megaupload etc. ... Gold Miner Special Edition by Ka..rar download ..." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://software.nasdaq.com/web-data-extraction-software/spotlight/102188/Unit%20Miner/QualityUnit?id=30063775";"Unit Miner by QualityUnit - Capterra Spotlight";"Year Founded: 2004. Location: Slovakia Number of Customers: >10000. Industries Served: Marketing Annual Revenue: $10-50 Million. Unit Miner by QualityUnit ..." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://forum.qualityunit.com/showthread.php?t=159";"did you have any problems with installation of Unit Miner ...";"We will help you with installation of Unit Miner on your server or local computer. vzeman is offline. vzeman. View Public Profile · Visit vzeman's homepage! ..." "http://www.google.com/search?hl=en&q=unit+miner&start=20&sa=N";"http://business.inquirer.net/money/topstories/view/20100309-257502/San-Miguel-unit-acquires-coal-miner";"Business - San Miguel unit acquires coal miner - INQUIRER.net";"Mar 9, 2010 ... San Miguel unit acquires coal miner. By Doris Dumlao Philippine Daily Inquirer First Posted 00:25:00 03/09/2010 ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.chinapost.com.tw/business/americas/2009/11/17/233124/Grupo-Mexico.htm";"Grupo Mexico wins back copper mining unit Asarco - The China Post";"Nov 17, 2009 ... A US judge has issued final approval of Grupo Mexico SAB's plan to regain control of copper miner Asarco LLC, ending a lengthy takeover ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.sas.com/success/hongkongeu.html";"Hong Kong Efficiency Unit succeeds with SAS Text Miner | SAS";"The Efficiency Unit chose to deploy SAS Text Miner, which can access and analyse various text formats, including e-mails received by the 1823 Call Centre. ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://php-forum.net/unit-miner-download-2608.html";"Unit Miner Download";"Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from web sites, documents, or any non-structured source ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.lisisoft.com/tools/unit.html";"unit softwares - Free download - FreeWares";"Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from from web sites, documents, or any non-structured ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.reuters.com/article/idUSPRG00386820100111";"Miner NWR sells energy unit to Dalkia for 122 mln eur | Reuters";"Jan 11, 2010 ... PRAGUE, Jan 11 (Reuters) - Miner New World Resources (NWR) has agreed to sell its NWR Energy subsidiary to the Czech unit of Dalkia for ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.worldoils.com/marketplace/equipdetails.php?id=254&Mining%20Container%20Camps%20For%20Sale%20-%20Miner";"Mining Container Camps For Sale - Miner's Accommodation Camps ...";"Search Words : Mining camps and work facilities - Modular Units Mining Remote Camps For Sale Miner's Remote Camps For Sale Miner's accommodation For Sale ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.convertunits.com/info/miner's+inch+%5BID,+WA,+NM%5D";"Measurement unit conversion: miner's inch [ID, WA, NM]";"Miner's inch [ID, WA, NM] is a measure of volume flow rate. Get more information and details on the 'miner's inch [ID, WA, NM]' measurement unit, ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.databasesdir.com/Software_Databases/Data_Warehousing_Databases/Data_Extraction_and_Transformation/197908-22710.html";"The Unit Miner Service Databases Miner Service convenient extract ...";"The Unit Miner Service Databases & Data Extraction and Transformation Softwares Resource Directory. Miner Service convenient extract internet wasting manual ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.rocketdownload.com/program/excel-unit-conversion-software-75471.html";"Excel Unit Conversion Software 7.0 Free Software Download ...";"Unit Miner is robust, flexible and easy to use system for monitoring, retrieving and mining content from from web sites, documents, or any non-structured ..." "http://www.google.com/search?hl=en&q=unit+miner&start=30&sa=N";"http://www.who.is/whois/unitminer.com/";"unitminer.com Whois - unit miner - Who.is";"unitminer.com is hosted at 72.52.198.161 on Apache/2.2.11 (Unix) mod_ssl/2.2.11 OpenSSL/0.9.7a mod_bwlimited/1.4 PHP/5.2.9."
Zdrojový kód skriptu:
# File: google_main.w
# Name: Google search engine
# Description: Script opens Google URL with searching term "unit miner"
# and extract first 4 pages of results.
# Input: URL
# Output format: CSV file
# Output fields: Source URL, Link, Title, Description
#<Logger File>
# Global
# FileName google_log.log
# Level debug
#</Logger>
<Section>
Name google_main
Define $output_file google_output.csv
# clean output file
<Action Print>
FileName {$output_file}
FileMode Write
</Action>
Define $url /search?hl=en&q=unit+miner
<Section While>
MaxIterations 4
# downloading the content of URL
<Action ContentURL>
URL http://www.google.com{$url}
RemoveNewLine
TagsToStrip em, br, b, span, img
StripTagsWhereClass f
</Action>
<Pattern>
RegExp <div id=res
</Pattern>
# extracting data from all records on page
<Section While>
EndAt </div><br clear="all"/>
<Pattern>
RegExp <h3 class=r><a href="{$link:re([^"]*)}" class=l{:re([^>]*)}>{$title:re([^<]*)}</a>\
</h3><div class="s">{$description:re([^<]*)}
Trim
Compact
HtmlSpecialChars
</Pattern>
# relative address -> absolute address
Define $source_url http://www.google.com{$url}
# saving data into CSV file
<Action SaveCSV>
FileName {$output_file}
Separator ;
Column $source_url, Source URL
Column $link, Link
Column $title, Title
Column $description, Description
</Action>
</Section>
# finding URL to next page
<Pattern>
RegExp <a href="{$url:re([^"]*)}">Next</a>
Trim
Compact
</Pattern>
</Section>
</Section>
Main google_main
- Slovensky