LANThrax
Username: Password:  
Sign In
Remember me
Sign Up Now
Forgot Password

Websites backup solution

Last seen 22-May-13 21:58:01
Level 24
Generale d'Armata+
LANThrax Extremist (90 straight daily logins)
970
Get 10/10 in Trivia 3 TimesGet 10/10 in Trivia 6 TimesGet 10/10 in Trivia 9 TimesLog in everyday for 30 consecutive daysLog in everyday for 60 consecutive days50 Boxart GuessesLog in everyday for 90 consecutive days100 Boxart Guesses150 Boxart GuessesSolve the code breakers puzzle 25 timesDonate at least €14 to the LANThrax causeSolve the code breakers puzzle 50 timesSolve the code breakers puzzle 75 timesComplete the sticker albumIncorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Vote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Vote against the trend 25 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Get suggested polls approved 25 times since 24-OCT-2011

I am looking for an efficient way to backup my websites onto a different server and I need this to be automated so that it is done once a day at night.

There are around 50,000 files in 10,000 folders (ca 2.5GB) and it is not practical to download everything everytime. There are multiple websites and many of them use CMS and allow the owner to upload and change files (kinda like LANThrax).

Is there any application that automatically detects which files have been modified/added/deleted and only downloads the changes? And this needs to be done with a schedule. Beyond Compare does the part of detecting the changes, but it lacks the scheduling part (or maybe I don't know how to use it).

Also, when detecting changes, the program needs to avoid downloading the files (even if temporarily) in order to check for changes, otherwise it would defy the whole idea of saving bandwidth.

1  2 3 Next
Last seen 22-May-13 20:17:28
Level 11
лейтена́нт
(Lieutenant)
LANThrax Extremist (90 straight daily logins)
269
Log in everyday for 30 consecutive daysLog in everyday for 60 consecutive daysVote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Incorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Log in everyday for 90 consecutive days10 confirmed bug findsComplete the sticker albumVote against the trend 25 times since 24-OCT-201120 confirmed bug finds

ill check, cause currently im at school.. do you have another server?

Osprey likes this post
Last seen 22-May-13 20:17:28
Level 11
лейтена́нт
(Lieutenant)
LANThrax Extremist (90 straight daily logins)
269
Log in everyday for 30 consecutive daysLog in everyday for 60 consecutive daysVote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Incorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Log in everyday for 90 consecutive days10 confirmed bug findsComplete the sticker albumVote against the trend 25 times since 24-OCT-201120 confirmed bug finds

u tbh, jek another server.. bilfors bil bandwith, sakem mux ijad bdirect link jew ekk jew?

Last seen 22-May-13 21:58:01
Level 24
Generale d'Armata+
LANThrax Extremist (90 straight daily logins)
970
Get 10/10 in Trivia 3 TimesGet 10/10 in Trivia 6 TimesGet 10/10 in Trivia 9 TimesLog in everyday for 30 consecutive daysLog in everyday for 60 consecutive days50 Boxart GuessesLog in everyday for 90 consecutive days100 Boxart Guesses150 Boxart GuessesSolve the code breakers puzzle 25 timesDonate at least €14 to the LANThrax causeSolve the code breakers puzzle 50 timesSolve the code breakers puzzle 75 timesComplete the sticker albumIncorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Vote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Vote against the trend 25 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Get suggested polls approved 25 times since 24-OCT-2011

Thanks for the interest.

I have server with the websites on it. It is in the UK and I have remote desktop access, that is, I can install programs on it. I also have an FTP server in the US on which I want to keep a mirror of the files in the server in the UK. I only have FTP access for the server in the US and therefore I cannot install software on it.

The software needs to be installed in the UK server and at a specific time early in the morning, the software needs to upload the files that have been changed/added in the UK server onto the backup in the US server. It also needs to delete any files that have been deleted in the UK server from the US server. All this to be done through FTP commands.

I have so much given up finding a program that does this apparently simple task that I have now started writing my own app in VB.NET. So far I have only arrived to the part where it detects changes made to any file inside a folder I want to monitor (even if it is in a sub folder). My plan is to have this program running on the UK server and have it monitor the root folder of the websites for changes. As soon as there is a change to a file, it adds a command to a list so that the file is uploaded with an FTP command onto the US server. I have not yet explored FTP commands with VB.Net but I am hoping to find how do it just like I found how to monitor a folder for changes.

Still, if you know of a program that can do what I am after, I would be very grateful because it would save me a lot of time.

Last seen 22-May-13 20:17:28
Level 11
лейтена́нт
(Lieutenant)
LANThrax Extremist (90 straight daily logins)
269
Log in everyday for 30 consecutive daysLog in everyday for 60 consecutive daysVote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Incorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Log in everyday for 90 consecutive days10 confirmed bug findsComplete the sticker albumVote against the trend 25 times since 24-OCT-201120 confirmed bug finds

Can i ask a simple, yet an effective question.

Have you asked the webhosting service if it offers a duplicate mirroring in any other location? as i know some webhosters which do this.

 

edit: and you could simply ditch the us server, and pay like (or almost) twice the yearly/monthly subscription

 

Edited: November 1, 2011 15:36:01
Last seen 22-May-13 21:58:01
Level 24
Generale d'Armata+
LANThrax Extremist (90 straight daily logins)
970
Get 10/10 in Trivia 3 TimesGet 10/10 in Trivia 6 TimesGet 10/10 in Trivia 9 TimesLog in everyday for 30 consecutive daysLog in everyday for 60 consecutive days50 Boxart GuessesLog in everyday for 90 consecutive days100 Boxart Guesses150 Boxart GuessesSolve the code breakers puzzle 25 timesDonate at least €14 to the LANThrax causeSolve the code breakers puzzle 50 timesSolve the code breakers puzzle 75 timesComplete the sticker albumIncorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Vote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Vote against the trend 25 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Get suggested polls approved 25 times since 24-OCT-2011

Actually no. But I already had a bad experience with their backups in the past, and that is why I handling my own backups. Once they had a server crash and restored a backup from 3 weeks earlier. I had a lot of complaints from clients who had done a lot of Content Management changes to their site during that time and they had to do it again. So now I don't trust them.

So I started making my own backups, but my current backups involve zipping all the sites and then downloading the zip files to my server in Malta. This consumes a lot of bandwidth and puts a strain on the hosting CPU when creating the zip files. Pages start to timeout when the zip files are being created. The problem is not that visible because the zipping is done early in the morning, but it is still a nuissance.

Last seen 02-Jan-13 07:40:55
Level 1
Gefreiter*
9

I presume you're using Windows... something like http://www.areca-backup.org/ might help.

Last seen 22-May-13 21:58:01
Level 24
Generale d'Armata+
LANThrax Extremist (90 straight daily logins)
970
Get 10/10 in Trivia 3 TimesGet 10/10 in Trivia 6 TimesGet 10/10 in Trivia 9 TimesLog in everyday for 30 consecutive daysLog in everyday for 60 consecutive days50 Boxart GuessesLog in everyday for 90 consecutive days100 Boxart Guesses150 Boxart GuessesSolve the code breakers puzzle 25 timesDonate at least €14 to the LANThrax causeSolve the code breakers puzzle 50 timesSolve the code breakers puzzle 75 timesComplete the sticker albumIncorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Vote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Vote against the trend 25 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Get suggested polls approved 25 times since 24-OCT-2011

I presume you're using Windows... something like http://www.areca-backup.org/ might help.

finku

Yes, sorry, forgot to mention. Will check it out tomorrow and get back to you.
 

Last seen 05-Feb-13 23:54:19
Level 1
Gefreiter*
LANThrax Extremist (90 straight daily logins)
129
Log in everyday for 30 consecutive daysLog in everyday for 60 consecutive daysLog in everyday for 90 consecutive days

I presume you're using Windows... something like http://www.areca-backup.org/ might help.

finku

Yes, sorry, forgot to mention. Will check it out tomorrow and get back to you.
 

Osprey



If you are using Windows, why don't you use the Windows task scheduler to automate the running of the application at a certain time?

Last seen 22-May-13 21:58:01
Level 24
Generale d'Armata+
LANThrax Extremist (90 straight daily logins)
970
Get 10/10 in Trivia 3 TimesGet 10/10 in Trivia 6 TimesGet 10/10 in Trivia 9 TimesLog in everyday for 30 consecutive daysLog in everyday for 60 consecutive days50 Boxart GuessesLog in everyday for 90 consecutive days100 Boxart Guesses150 Boxart GuessesSolve the code breakers puzzle 25 timesDonate at least €14 to the LANThrax causeSolve the code breakers puzzle 50 timesSolve the code breakers puzzle 75 timesComplete the sticker albumIncorrectly predict the outcome of the voting game 15 times since 24-OCT-2011Vote like the majority 25 times since 24-OCT-2011Vote 50 times since 24-OCT-2011Vote against the trend 25 times since 24-OCT-2011Correctly predict the outcome of the voting game 40 times since 24-OCT-2011Get suggested polls approved 25 times since 24-OCT-2011
If you are using Windows, why don't you use the Windows task scheduler to automate the running of the application at a certain time?
DriftKing

The Windows Task Scheduler wil only go as far as starting the application, but it will not start the syncing, unless the application can accept command line parameters.
 

Last seen 05-Feb-13 23:54:19
Level 1
Gefreiter*
LANThrax Extremist (90 straight daily logins)
129
Log in everyday for 30 consecutive daysLog in everyday for 60 consecutive daysLog in everyday for 90 consecutive days

if you have time for coding, you could try autoit. I've personally programmed with this and learning it only took about 6 hours of my life xD

http://www.autoitscript.com/site/autoit/

1  2 3 Next


You can only post questions and replies when you are logged in. You can enlist for free by clicking here.
Page generated in 3.479 seconds