OS X - Apps and Games Discussion of applications and games available for Mac OS X.

auto web page downloads


Post Reply New Thread Subscribe

 
Thread Tools
coolcatdaddy

 
Member Since: Jan 11, 2007
Posts: 1
coolcatdaddy is on a distinguished road

coolcatdaddy is offline
I'm looking for an application and have searched several sites, but haven't found one that does quite what I'm looking for - perhaps y'all would have some suggestions.

I'm wanting to schedule automatic download of some specific URL's. I only need single pages (in other words, it doesn't have to take sublinks off the pages), but there will be a long list of them. The downloads need to be scheduled periodically (once a day for some, once a week for others).

I'm doing a study of language used in headlines at various news sites, looking for changes over time and similarities in language among multiple sites. So, in a folder, I might open the pages downloaded on a particular day in Safari and examine each one, copying and pasting some of the language used into a document to make a summary for the day or week.

The "web grabbing" apps I've found seemed designed to grab a link and several sublinks only once to facilitate downloading of an entire site or section of the site; they also don't seem to allow me to keep a set of URL's in place that I can check on a schedule - they do it once and I have to enter them all over again.

Any suggestions?
QUOTE Thanks
eric

 
eric's Avatar
 
Member Since: Nov 04, 2006
Location: twin cities, mn, usa
Posts: 8,800
eric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond repute

eric is offline
oh, i'm sure automator can do this.

not on my mac now, but i guarantee it can pull this off. if no one else can help (or you can't figure it out yourself), i'll try it when i can.

automator is pretty easu to work with, but has some sticky bits. apple's automator page might be helpful in figuring this out too...

Please participate in our Member of the Month polls. Every vote counts! And remember to use the user reputation system!
["Dear Homer, I. O. U. one emergency donut. Signed, Homer." - Note by Homer Simpson]
QUOTE Thanks
eric

 
eric's Avatar
 
Member Since: Nov 04, 2006
Location: twin cities, mn, usa
Posts: 8,800
eric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond repute

eric is offline
ok, automator does have an action for this:

make a new action add:

from safari library > get specified urls
add the urls to download here and make sure they stay checked

then add from safari library > download urls
make sure this adds under the first action.
you can specify a folder here.

then save the action.

i'm pretty sure you can save this as a plug in in ical and make it run as an alarm action at your discretion. you may also be able to either attach a folder action to a folder the automator script sits in to have it run at a given time, but i know even less about that...

Please participate in our Member of the Month polls. Every vote counts! And remember to use the user reputation system!
["Dear Homer, I. O. U. one emergency donut. Signed, Homer." - Note by Homer Simpson]
QUOTE Thanks
MartinS

 
MartinS's Avatar
 
Member Since: Nov 02, 2006
Location: Bournville, UK
Posts: 662
MartinS is a jewel in the roughMartinS is a jewel in the rough

MartinS is offline
There's a workflow does this at www.automatorworld.com. As eric says, save it as an iCal plugin an shedule as required. If you want some pages downloaded weekly, save that as one plugin, save as another for daily downloads, etc.

www.martinsketchley.co.uk

2011 21.5-inch i5 iMac
Mid-2009 13-inch MacBook Pro
QUOTE Thanks
eric

 
eric's Avatar
 
Member Since: Nov 04, 2006
Location: twin cities, mn, usa
Posts: 8,800
eric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond reputeeric has a reputation beyond repute

eric is offline
i saw there was an option in ical to have the alarm either open or run the script, i'm guessing you want it to run rather than open.

Please participate in our Member of the Month polls. Every vote counts! And remember to use the user reputation system!
["Dear Homer, I. O. U. one emergency donut. Signed, Homer." - Note by Homer Simpson]
QUOTE Thanks

Post Reply New Thread Subscribe


« how do I know when/if email I send is being read? | The most annoying thing of all on MacOSX... »
Thread Tools

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off
Forum Jump

Similar Threads
Thread
Thread Starter
Forum
Replies
Last Post
Script errors on web page when viewed on Mac rharris07 Web Design and Hosting 0 09-20-2006 09:34 AM
need help viewing a web page Biturbo V12 AMG Web Design and Hosting 1 08-09-2005 03:11 AM
Web Page Size PBG4MAN Web Design and Hosting 8 08-04-2005 06:33 PM
Web page builder Ex_PC_Puke Web Design and Hosting 5 05-09-2005 07:53 AM
Using .mac (trial) how to get web page uploaded marchandc Web Design and Hosting 4 02-28-2004 10:17 PM

All times are GMT -4. The time now is 12:08 AM.

Powered by vBulletin
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
X

Welcome to Mac-Forums.com

Create your username to jump into the discussion!

New members like you have made this community the ultimate source for your Mac since 2003!


(4 digit year)

Already a member?