INteracting with a website, with Perl

Hi

Is it possible to interact with a web site, with the Perl language?

That is, go to the URL, "enter" data in some fields (that would be a user
and password), "click" on a link (connect button) and then read the data
displayed on the page to extract data from it. Write this data to a flat
file for later processing.

If you could show me how to do that, or give me pointers to some
documentation specific to this kind of task, I'd be very happy!

What I need to do, is to get some data from a web page and make a report out
of that, later on (let`s say a monthly summary of the values found every day
on the web site).

BTW the site is a secured site (https)

Thanks !

--
Syltrem

OpenVMS 7.3-1 + Oracle 8.1.7.4
http://pages.infinit.net/syltrem (OpenVMS related web site, en français)
---zulu is not in my email address---
Syltrem [ Fr, 22 Oktober 2004 18:03 ] [ ID #444727 ]

Re: INteracting with a website, with Perl

In article <%9aed.73$dq4.3793 [at] tor-nn1.netcom.ca>, Syltrem
<syltremzulu [at] videotron.ca> wrote:

> Hi
>
> Is it possible to interact with a web site, with the Perl language?

Yes. Check out the LWP module on CPAN and the web scraping proxy at

http://www.research.att.com/~hpk/wsp/
Jim Gibson [ Fr, 22 Oktober 2004 20:51 ] [ ID #444728 ]

Re: INteracting with a website, with Perl

Jim Gibson <jgibson [at] mail.arc.nasa.gov> wrote:

> In article <%9aed.73$dq4.3793 [at] tor-nn1.netcom.ca>, Syltrem
><syltremzulu [at] videotron.ca> wrote:
>
>> Is it possible to interact with a web site, with the Perl language?

> Yes. Check out the LWP module on CPAN and the web scraping proxy at
>
> http://www.research.att.com/~hpk/wsp/

See also 'perldoc lwpcook' for some cookbook examples.
dwall [ Di, 26 Oktober 2004 17:34 ] [ ID #449038 ]

Re: INteracting with a website, with Perl

On Tue, 26 Oct 2004 15:34:49 -0000, "David K. Wall"
<dwall [at] fastmail.fm> wrote:

>Jim Gibson <jgibson [at] mail.arc.nasa.gov> wrote:
>
>> In article <%9aed.73$dq4.3793 [at] tor-nn1.netcom.ca>, Syltrem
>><syltremzulu [at] videotron.ca> wrote:
>>
>>> Is it possible to interact with a web site, with the Perl language?
>
>> Yes. Check out the LWP module on CPAN and the web scraping proxy at
>>
>> http://www.research.att.com/~hpk/wsp/
>
>See also 'perldoc lwpcook' for some cookbook examples.

And Check out WWW::Mechanize also at CPAN
Kent rockz [ Mo, 06 Dezember 2004 23:06 ] [ ID #522543 ]
Perl » alt.perl » INteracting with a website, with Perl

Vorheriges Thema: The Perl Review, with cheaper subscription options
Nächstes Thema: CGI and param() problem