Get the page from a server that uses DotNet
Hi,
There is a page which is created using DotNet and there is a paginated table
in it.
I want to download the next pages from that table, but the links to those
pages use the DoPostBack JS function which is probably created automaticly
by DotNet.
That JS function creates a huge POST code that has more than 10 KB and many
form fields, but I don't know how to calculate them starting from the
parameters sent to it, and I've seen that the JS files attached to that page
are very big, so it would be probably very hard to find how are those
checksums or crypted fields created.
It is not absolutely needed to create an automatic parser. I can get the
source code of those pages manually with copy/paste, but I don't know how to
get that source code since it is taken with JS, so I can't find it in the
View/Source code menu of the browser.
Do you have any idea if it is possible to download those pages with a perl
program without knowing how those JS function calculates the values of the
POST fields?
Thank you for any idea.
IP
--
To unsubscribe, e-mail: beginners-unsubscribe [at] perl.org
For additional commands, e-mail: beginners-help [at] perl.org
http://learn.perl.org/
Re: Get the page from a server that uses DotNet
Hi Ion Pop!
On Saturday 20 Feb 2010 12:25:10 Ion Pop wrote:
> Hi,
>
> There is a page which is created using DotNet and there is a paginated
> table in it.
> I want to download the next pages from that table, but the links to those
> pages use the DoPostBack JS function which is probably created automaticly
> by DotNet.
>
> That JS function creates a huge POST code that has more than 10 KB and many
> form fields, but I don't know how to calculate them starting from the
> parameters sent to it, and I've seen that the JS files attached to that
> page are very big, so it would be probably very hard to find how are those
> checksums or crypted fields created.
>
> It is not absolutely needed to create an automatic parser. I can get the
> source code of those pages manually with copy/paste, but I don't know how
> to get that source code since it is taken with JS, so I can't find it in
> the View/Source code menu of the browser.
>
> Do you have any idea if it is possible to download those pages with a perl
> program without knowing how those JS function calculates the values of the
> POST fields?
You can try looking at Selenium:
1. http://search.cpan.org/dist/Test-WWW-Selenium/
2. http://seleniumhq.org/
It allows you to interact with a browser and control it, including the ability
to process and interact with JavaScript code.
Regards,
Shlomi Fish
--
------------------------------------------------------------ -----
Shlomi Fish http://www.shlomifish.org/
Interview with Ben Collins-Sussman - http://shlom.in/sussman
Deletionists delete Wikipedia articles that they consider lame.
Chuck Norris deletes deletionists whom he considers lame.
Please reply to list if it's a mailing list post - http://shlom.in/reply .
--
To unsubscribe, e-mail: beginners-unsubscribe [at] perl.org
For additional commands, e-mail: beginners-help [at] perl.org
http://learn.perl.org/
Re: Get the page from a server that uses DotNet
>>>>> "IP" == Ion Pop <ionpop123 [at] gmail.com> writes:
IP> There is a page which is created using DotNet and there is a
IP> paginated table in it. I want to download the next pages from
IP> that table, but the links to those pages use the DoPostBack JS
IP> function which is probably created automaticly by DotNet.
IP> That JS function creates a huge POST code that has more than 10 KB and
IP> many form fields, but I don't know how to calculate them starting from
IP> the parameters sent to it, and I've seen that the JS files attached to
IP> that page are very big, so it would be probably very hard to find how
IP> are those checksums or crypted fields created.
please don't post questions like this as it is not even close to a perl
beginner question. complex issues like js in web pages and driving them
with perl code is not basic perl.
there are many other forums that would help with this. we want to keep
this list to just beginner perl questions.
uri
--
Uri Guttman ------ uri [at] stemsystems.com -------- http://www.sysarch.com --
----- Perl Code Review , Architecture, Development, Training, Support ------
--------- Gourmet Hot Cocoa Mix ---- http://bestfriendscocoa.com ---------
--
To unsubscribe, e-mail: beginners-unsubscribe [at] perl.org
For additional commands, e-mail: beginners-help [at] perl.org
http://learn.perl.org/
Re: Get the page from a server that uses DotNet
--0016e649c4f21bcc8004805bf031
Content-Type: text/plain; charset=UTF-8
On Sat, Feb 20, 2010 at 6:24 PM, Uri Guttman <uri [at] stemsystems.com> wrote:
> >>>>> "IP" == Ion Pop <ionpop123 [at] gmail.com> writes:
>
> IP> There is a page which is created using DotNet and there is a
> IP> paginated table in it. I want to download the next pages from
> IP> that table, but the links to those pages use the DoPostBack JS
> IP> function which is probably created automaticly by DotNet.
>
> IP> That JS function creates a huge POST code that has more than 10 KB and
> IP> many form fields, but I don't know how to calculate them starting from
> IP> the parameters sent to it, and I've seen that the JS files attached to
> IP> that page are very big, so it would be probably very hard to find how
> IP> are those checksums or crypted fields created.
>
> please don't post questions like this as it is not even close to a perl
> beginner question. complex issues like js in web pages and driving them
> with perl code is not basic perl.
>
> there are many other forums that would help with this. we want to keep
> this list to just beginner perl questions.
>
> uri
>
FWIW, those "doPostBack" javascript calls actually just send a POST request
to the URL in question. There are several .NET constructs that need to be
picked apart before the request can be understood, such as "__EVENTTARGET"
and the like. You'd be better off asking on a .NET list than this perl list,
IMHO.
// Todd
--0016e649c4f21bcc8004805bf031--