Parsing WhitePages Search Results HTML - Revision history

PeterHarding at 04:07, 1 August 2015

2015-08-01T04:07:22Z

← Older revision		Revision as of 14:07, 1 August 2015
Line 560:		Line 560:

	[[Category:Python]]		[[Category:Python]]
	[[Category:. httplib]]		[[Category:Python httplib]]
	[[Category:Internet]]		[[Category:Internet]]

PeterHarding at 02:28, 2 April 2009

2009-04-02T02:28:37Z

← Older revision		Revision as of 12:28, 2 April 2009
Line 557:		Line 557:
	=Results of Search=		=Results of Search=

	Are written to a file XML.		Are written to a file as XML.

	[[Category:Python]]		[[Category:Python]]
	[[Category:. httplib]]		[[Category:. httplib]]
	[[Category:Internet]]		[[Category:Internet]]

PeterHarding at 02:28, 2 April 2009

2009-04-02T02:28:06Z

← Older revision		Revision as of 12:28, 2 April 2009
Line 176:		Line 176:
	</pre>		</pre>

	This ~~scripts~~ writes the search results into files (page 1 => 'log/0002.bdy' and page 2 => 'log/0003.bdy'). Amend the above code handle more pages of search results being produced.		This script writes the search results into files (page 1 => 'log/0002.bdy' and page 2 => 'log/0003.bdy'). Amend the above code handle more pages of search results being produced.

	= Parsing the Search Results =		= Parsing the Search Results =
Line 184:		Line 184:
	<pre>		<pre>
	<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard ...</ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>		<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard ...</ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>
			</pre>

	=Results of Search=		=Results of Search=

PeterHarding at 02:27, 2 April 2009

2009-04-02T02:27:08Z

← Older revision		Revision as of 12:27, 2 April 2009
Line 183:		Line 183:

	<pre>		<pre>
	<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard On Tools</span></h4></li><li class='subMultiContainer' id='res10-ln1'><ul><li class='entryData address'>5 Scoresby Rd Bayswater 3153</li><li class='entryData phoneNumber'><span class='blackboldcaps'>(03) 9720 5199</span></li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs.do' method='post'><input type='hidden' name='streetNumber' value='5' /><input type='hidden' name='streetName' value='Scoresby' /><input type='hidden' name='streetType' value='Rd' /><input type='hidden' name='locality' value='Bayswater' /><input type='hidden' name='state' value='VIC' /><input type='hidden' name='placeName' value='Hard On Tools' /><input type='hidden' name='address' value='5 Scoresby Rd Bayswater 3153' /><input type='hidden' name='phoneNumber' value='(03) 9720 5199' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard On Tools' /><input name='mapSubmit' src='images/result-map.gif' alt='Map' type='image' /></form></li></ul></li><li class='subMultiContainer' id='res10-ln2'><ul><li class='entryData address'><h5><span class='black'>OR...</span></h5></li><li class='entryData phoneNumber'>(03) 9738 2882</li></ul></li><li class='subMultiContainer' id='res10-ln3'><ul><li class='entryData address indent2'><h5><span class='black'>Fax</span></h5></li><li class='entryData phoneNumber'>(03) 9720 0966</li></ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>~~=Results of Search=~~		<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard ...</ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>

	~~The following ZIP file contains a selection of company details extracted from Whitepages...~~

	~~[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults.zip]~~


	~~[[Category:Python]][[Category:Internet]]~~

	=Results of Search=		=Results of Search=

	~~The following ZIP~~ file ~~contains~~ a ~~selection~~ of ~~company details extracted from Whitepages...~~		Are wriiten to a file in a block of XML.

	~~[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults~~.~~zip]~~


	~~[[Category:Python]][[Category:Internet]]~~

	=A more Complex Script=		=A more Complex Script=
Line 569:		Line 557:

	Are written to a file XML.		Are written to a file XML.


	[[Category:Python]]		[[Category:Python]]
	[[Category:. httplib]]		[[Category:. httplib]]
	[[Category:Internet]]		[[Category:Internet]]

PeterHarding at 02:24, 2 April 2009

2009-04-02T02:24:58Z

← Older revision		Revision as of 12:24, 2 April 2009
Line 564:		Line 564:

	#-------------------------------------------------------------------------------------		#-------------------------------------------------------------------------------------

	~~"""~~
	<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard On Tools</span></h4></li><li class='subMultiContainer' id='res10-ln1'><ul><li class='entryData address'>5 Scoresby Rd Bayswater 3153</li><li class='entryData phoneNumber'><span class='blackboldcaps'>(03) 9720 5199</span></li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs.do' method='post'><input type='hidden' name='streetNumber' value='5' /><input type='hidden' name='streetName' value='Scoresby' /><input type='hidden' name='streetType' value='Rd' /><input type='hidden' name='locality' value='Bayswater' /><input type='hidden' name='state' value='VIC' /><input type='hidden' name='placeName' value='Hard On Tools' /><input type='hidden' name='address' value='5 Scoresby Rd Bayswater 3153' /><input type='hidden' name='phoneNumber' value='(03) 9720 5199' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard On Tools' /><input name='mapSubmit' src='images/result-map.gif' alt='Map' type='image' /></form></li></ul></li><li class='subMultiContainer' id='res10-ln2'><ul><li class='entryData address'><h5><span class='black'>OR...</span></h5></li><li class='entryData phoneNumber'>(03) 9738 2882</li></ul></li><li class='subMultiContainer' id='res10-ln3'><ul><li class='entryData address indent2'><h5><span class='black'>Fax</span></h5></li><li class='entryData phoneNumber'>(03) 9720 0966</li></ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li><h4><span class='black'>Hard Parts Australia Pty Ltd</span></h4></li>
	<li class='entryData address'>14 Yiannis Crt Springvale 3171</li><li class='entryData phoneNumber'>0418 756 340</li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs.do' method='post'><input type='hidden' name='streetNumber' value='14' /><input type='hidden' name='streetName' value='Yiannis' /><input type='hidden' name='streetType' value='Crt' /><input type='hidden' name='locality' value='Springvale' /><input type='hidden' name='state' value='VIC' /><input type='hidden' name='placeName' value='Hard Parts Australia Pty Ltd' /><input type='hidden' name='address' value='14 Yiannis Crt Springvale 3171' /><input type='hidden' name='phoneNumber' value='0418 756 340' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard Parts Australia Pty Ltd' /><input name='mapSubmit' src='images/result-map.gif' alt='Map' type='image' /></form></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-12"><ul><li><h4><span class='black'>Hard Parts Victoria</span></h4></li>
	~~"""~~
	</pre>		</pre>

	=Results of Search=		=Results of Search=

	~~The following ZIP~~ file ~~contains a selection of company details extracted from Whitepages...~~		Are written to a file XML.

	~~[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults~~.~~zip]~~

PeterHarding at 00:35, 30 September 2008

2008-09-30T00:35:59Z

← Older revision		Revision as of 10:35, 30 September 2008
Line 578:		Line 578:


	[[Category:Python]][[Category:httplib]][[Category:Internet]]		[[Category:Python]]
			[[Category:. httplib]]
			[[Category:Internet]]

PeterHarding at 02:59, 25 February 2008

2008-02-25T02:59:01Z

← Older revision		Revision as of 12:59, 25 February 2008
Line 578:		Line 578:


	[[Category:Python]][[Category:Internet]]		[[Category:Python]][[Category:httplib]][[Category:Internet]]

PeterHarding at 04:24, 15 February 2008

2008-02-15T04:24:04Z

← Older revision		Revision as of 14:24, 15 February 2008
Line 575:		Line 575:
	The following ZIP file contains a selection of company details extracted from Whitepages...		The following ZIP file contains a selection of company details extracted from Whitepages...

	[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip]		[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults.zip]


	[[Category:Python]][[Category:Internet]]		[[Category:Python]][[Category:Internet]]

PeterHarding: /* Results of Search */

2008-02-15T04:23:48Z

Results of Search

@@ Line 192: / Line 192: @@
 [[Category:Python]][[Category:Internet]]
-<h4><span class='black'>Hard Parts Victoria</span></h4></li>
+=Results of Search=
-This following script, which makes use of the BeautifulSoup package, is a first cut of at parsing out the useful data from the WhitePages results HTML (see [http://www.crummy.com/software/BeautifulSoup/ here] for BeautifulSoap home page);
+  [http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults.zip]
-</pre>
+[[Category:Python]][[Category:Internet]]
 =A more Complex Script=

PeterHarding: /* Results of Search */

2008-02-15T04:23:37Z

Results of Search

← Older revision		Revision as of 14:23, 15 February 2008
Line 183:		Line 183:

	<pre>		<pre>
	<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard On Tools</span></h4></li><li class='subMultiContainer' id='res10-ln1'><ul><li class='entryData address'>5 Scoresby Rd Bayswater 3153</li><li class='entryData phoneNumber'><span class='blackboldcaps'>(03) 9720 5199</span></li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs.do' method='post'><input type='hidden' name='streetNumber' value='5' /><input type='hidden' name='streetName' value='Scoresby' /><input type='hidden' name='streetType' value='Rd' /><input type='hidden' name='locality' value='Bayswater' /><input type='hidden' name='state' value='VIC' /><input type='hidden' name='placeName' value='Hard On Tools' /><input type='hidden' name='address' value='5 Scoresby Rd Bayswater 3153' /><input type='hidden' name='phoneNumber' value='(03) 9720 5199' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard On Tools' /><input name='mapSubmit' src='images/result-map.gif' alt='Map' type='image' /></form></li></ul></li><li class='subMultiContainer' id='res10-ln2'><ul><li class='entryData address'><h5><span class='black'>OR...</span></h5></li><li class='entryData phoneNumber'>(03) 9738 2882</li></ul></li><li class='subMultiContainer' id='res10-ln3'><ul><li class='entryData address indent2'><h5><span class='black'>Fax</span></h5></li><li class='entryData phoneNumber'>(03) 9720 0966</li></ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>~~<h4><span class~~=~~'black'>Hard Parts Australia Pty Ltd</span></h4></li>~~		<div class="encap_result" id="result-10"><ul><li id='res10-ln0'><h4><span class='blackboldcaps'>Hard On Tools</span></h4></li><li class='subMultiContainer' id='res10-ln1'><ul><li class='entryData address'>5 Scoresby Rd Bayswater 3153</li><li class='entryData phoneNumber'><span class='blackboldcaps'>(03) 9720 5199</span></li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs.do' method='post'><input type='hidden' name='streetNumber' value='5' /><input type='hidden' name='streetName' value='Scoresby' /><input type='hidden' name='streetType' value='Rd' /><input type='hidden' name='locality' value='Bayswater' /><input type='hidden' name='state' value='VIC' /><input type='hidden' name='placeName' value='Hard On Tools' /><input type='hidden' name='address' value='5 Scoresby Rd Bayswater 3153' /><input type='hidden' name='phoneNumber' value='(03) 9720 5199' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard On Tools' /><input name='mapSubmit' src='images/result-map.gif' alt='Map' type='image' /></form></li></ul></li><li class='subMultiContainer' id='res10-ln2'><ul><li class='entryData address'><h5><span class='black'>OR...</span></h5></li><li class='entryData phoneNumber'>(03) 9738 2882</li></ul></li><li class='subMultiContainer' id='res10-ln3'><ul><li class='entryData address indent2'><h5><span class='black'>Fax</span></h5></li><li class='entryData phoneNumber'>(03) 9720 0966</li></ul></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-11"><ul><li>=Results of Search=
	~~<li class='entryData address'>14 Yiannis Crt Springvale 3171<~~/~~li><li class='entryData phoneNumber'>0418 756 340<~~/~~li><li class='entryData whereIsMap'><form class='mapForm' action='whereIs~~.do' method='post'><input type='hidden' name='streetNumber' value='14' /><input type='hidden' name='streetName' value='Yiannis' /><input type='hidden' name='streetType' value='Crt' /><input type='hidden' name='locality' value='Springvale' /~~><input type='hidden' name='state' value='VIC'~~ /><input type='hidden' name='placeName' value='Hard Parts Australia Pty Ltd' /><input type='hidden' name='address' value='14 Yiannis Crt Springvale 3171' /><input type='hidden' name='phoneNumber' value='0418 756 340' /><input type='hidden' name='link' value='1197346075688' /><input type='hidden' name='hashCode' value='152335231501250' /><input type='hidden' name='brandId' value='5' /><input type='hidden' name='logData' value='' /><input type='hidden' name='subscriberName' value='Hard Parts Australia Pty Ltd' /><input name='mapSubmit' src='images/~~result-map~~.~~gif' alt='Map' type='image' /></form></li></ul><div class="clearMe"> </div></div><div class="encap_result" id="result-12"><ul><li>~~<h4><span class='black'>Hard Parts Victoria</span></h4></li>
			The following ZIP file contains a selection of company details extracted from Whitepages...

			[http://www.performiq.com.au/kb/images/WhitepageSearchResults.zip WhitepageSearchResults.zip]


			[[Category:Python]][[Category:Internet]]

			<h4><span class='black'>Hard Parts Victoria</span></h4></li>
	</pre>		</pre>