When I went to port my code that scrapes the BusinessWeek site for =
search
results to BaselineMag.com, I found that the HTML response of the search
results generated by the site do not contain the actual text that =
appears in
my browser.

For example, the source code of:

http://www.baselinemag.com/search_results/0%2C2426%2C%2C00.a sp?qry=3DBush=
&filt
erapp=3D&site=3D17

does not contain the links or text descriptions returned.

Any clue on where or how this information is hidden, or how I might get =
the
html that contains the search links and descriptions?

Regards,
Andrew

On Wed, Mar 23, 2005 at 01:17:34PM -0500, Andrew Johnson wrote:
> When I went to port my code that scrapes the BusinessWeek site for search
> results to BaselineMag.com, I found that the HTML response of the search
> results generated by the site do not contain the actual text that appears in
> my browser.
>
> For example, the source code of:
>
> http://www.baselinemag.com/search_results/0%2C2426%2C%2C00.a sp?qry=Bush&filt
> erapp=&site=17
>
> does not contain the links or text descriptions returned.
>
> Any clue on where or how this information is hidden, or how I might get the
> html that contains the search links and descriptions?

Look for a link to a JavaScript code.

\rho

PS: Lawyers, Child Molestors, Web Programmers: Which one does not fit to the
other two?