This is the mail archive of the cygwin mailing list for the Cygwin project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

RE: Can't find how to fetch from the web





> Date: Fri, 15 Aug 2008 11:02:38 -0700
> From: garretlewis@gmail.com
> To: cygwin@cygwin.com
> Subject: RE: Can't find how to fetch from the web
>
>
> In my experience, I have never run into a URL that was too long. the only
> thing that I have had problems with in the past are, links timing out, or if
> it is ftp you sometimes must specify a username and password. You know now
> that I think about it some websites block the use of file retrievers, could
> that be the problem?


I'm not at my normal computer but IIRC this occurs when retrieving patents.
I have a bunch of scripts that need to extract stuff from html from document servers
that don't have an API. The patent script generates long URL's and bombs every few
hundred-to-thousand fetches IIRC. The few times I looked I thought the URL length was
suspect but I suppose it could be something related to my install ( previously noted to
have problems) or I'm not remembering it correctly. 

Since you were discussing it, I only brought it up to determine if there was a known problem
with any versions. I used to use lynx all the time then switched to wget if I don't need
parsing and now mostly use curl in new code.



>
>
> Mike Marchywka-2 wrote:
>>
>>
>> btw, is there a known problem with lynx that causes it to die when the url
>> is too long?
>> I don't have an example right now but I've noticed several times, and it
>> appears to be
>> with long urls, that lynx dies for no obvious reason. I use something like
>> lynx -dump -width 1200 url. I don't think this normally violates the
>> command line length constraint which I thought was
>> many k. Is there a server response that can provoke an abnormal
>> termination ( want to say
>> seg fault or access violation but can't remember)?
>>
>> Thanks.
>>
>>
>>
>>> Date: Fri, 15 Aug 2008 08:50:21 -0700
>>> From: garretlewis@gmail.com
>>> To: cygwin@cygwin.com
>>> Subject: Re: Can't find how to fetch from the web
>>>
>>>
>>> are you talking about using wget to download files or webpages?
>>>
>>> all you have to do is open the setup.exe and the new package you want is
>>> under WEB>>(select)wget
>>>
>>> then google wget to see how to use it... it pretty simple and a good way
>>> to
>>> get data or other things from the web.
>>>
>>> I hope this what you were going for.
>>>
>>> Garret
>>>
>>>
>>>
>>> defn noob wrote:
>>>>
>>>> Believe me I have googled and read the faqs but I can't find how to
>>>> download from the web.
>>>>
>>>> I have installed cygwin and it works but I think I need a package
>>>> although
>>>> web was default in my download.
>>>>
>>>> 1. how do I install packages once I already have installed cygwin?
>>>>
>>>> 2. what do I write do download from a specific internetadress.
>>>>
>>>> best regards cirfu
>>>>
>>>>
>>>>
>>>> __________________________________________________________
>>>> Ta semester! - sök efter resor hos Kelkoo.
>>>> Jämför pris på flygbiljetter och hotellrum här:
>>>> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052
>>>>
>>>>
>>>> --
>>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>>>> Problem reports: http://cygwin.com/problems.html
>>>> Documentation: http://cygwin.com/docs.html
>>>> FAQ: http://cygwin.com/faq/
>>>>
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html
>>> Sent from the Cygwin list mailing list archive at Nabble.com.
>>>
>>>
>>> --
>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>>> Problem reports: http://cygwin.com/problems.html
>>> Documentation: http://cygwin.com/docs.html
>>> FAQ: http://cygwin.com/faq/
>>>
>>
>> _________________________________________________________________
>> Get ideas on sharing photos from people like you. Find new ways to share.
>> http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008
>>
>> --
>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
>> Problem reports: http://cygwin.com/problems.html
>> Documentation: http://cygwin.com/docs.html
>> FAQ: http://cygwin.com/faq/
>>
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19003069.html
> Sent from the Cygwin list mailing list archive at Nabble.com.
>
>
> --
> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
> Problem reports: http://cygwin.com/problems.html
> Documentation: http://cygwin.com/docs.html
> FAQ: http://cygwin.com/faq/
>

_________________________________________________________________
Be the filmmaker you always wanted to be—learn how to burn a DVD with Windows®.
http://clk.atdmt.com/MRT/go/108588797/direct/01/

--
Unsubscribe info:      http://cygwin.com/ml/#unsubscribe-simple
Problem reports:       http://cygwin.com/problems.html
Documentation:         http://cygwin.com/docs.html
FAQ:                   http://cygwin.com/faq/


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]