Wednesday, October 29, 2008

Howto: Backup and restore your system!

1: Backing-up

To do this, become root with
Code:
sudo su
and go to the root of your filesystem (we use this in our example, but you can go anywhere you want your backup to end up, including remote or removable drives.)
Code:
cd /
Now, below is the full command I would use to make a backup of my system:

Code:

tar cvpzf backup.tgz --exclude=/proc 
--exclude=/lost+found --exclude=/backup.tgz
--exclude=/mnt --exclude=/sys /

Now, lets explain this a little bit.
The 'tar' part is, obviously, the program we're going to use.

'cvpfz' are the options we give to tar, like 'create archive' (obviously),
'preserve permissions'(to keep the same permissions on everything the same), and 'gzip' to keep the size down.

Next, the name the archive is going to get. backup.tgz in our example.

Next comes the root of the directory we want to backup. Since we want to backup everything; /

Now come the directories we want to exclude. We don't want to backup everything since some dirs aren't very useful to include. Also make sure you don't include the file itself, or else you'll get weird results.
You might also not want to include the /mnt folder if you have other partitions mounted there or you'll end up backing those up too. Also make sure you don't have anything mounted in /media (i.e. don't have any cd's or removable media mounted). Either that or exclude /media.

EDIT : kvidell suggests below we also exclude the /dev directory. I have other evidence that says it is very unwise to do so though.

Well, if the command agrees with you, hit enter (or return, whatever) and sit back&relax. This might take a while.

Afterwards you'll have a file called backup.tgz in the root of your filessytem, which is probably pretty large. Now you can burn it to DVD or move it to another machine, whatever you like!

EDIT2:
At the end of the process you might get a message along the lines of 'tar: Error exit delayed from previous errors' or something, but in most cases you can just ignore that.

Alternatively, you can use Bzip2 to compress your backup. This means higher compression but lower speed. If compression is important to you, just substitute
the 'z' in the command with 'j', and give the backup the right extension.
That would make the command look like this:

Code:
tar cvpjf backup.tar.bz2 --exclude=/proc --exclude=/lost+found --exclude=/backup.tar.bz2 --exclude=/mnt --exclude=/sys /
2: Restoring

Warning: Please, for goodness sake, be careful here. If you don't understand what you are doing here you might end up overwriting stuff that is important to you, so please take care!

Well, we'll just continue with our example from the previous chapter; the file backup.tgz in the root of the partition.

Once again, make sure you are root and that you and the backup file are in the root of the filesystem.

One of the beautiful things of Linux is that This'll work even on a running system; no need to screw around with boot-cd's or anything. Of course, if you've rendered your system unbootable you might have no choice but to use a live-cd, but the results are the same. You can even remove every single file of a Linux system while it is running with one command. I'm not giving you that command though!

Well, back on-topic.
This is the command that I would use:

Code:
 tar xvpfz backup.tgz -C /
Or if you used bz2;

Code:
 tar xvpfj backup.tar.bz2 -C /
WARNING: this will overwrite every single file on your partition with the one in the archive!

Just hit enter/return/your brother/whatever and watch the fireworks. Again, this might take a while. When it is done, you have a fully restored Ubuntu system! Just make sure that, before you do anything else, you re-create the directories you excluded:
Code:
mkdir proc
mkdir lost+found
mkdir mnt
mkdir sys
etc...
And when you reboot, everything should be the way it was when you made the backup!



2.1: GRUB restore
Now, if you want to move your system to a new harddisk or if you did something nasty to your GRUB (like, say, install Windows), You'll also need to reinstall GRUB.
There are several very good howto's on how to do that here on this forum, so i'm not going to reinvent the wheel. Instead, take a look here:

http://www.ubuntuforums.org/showthre...t=grub+restore

Personally I have used SuperGrubDisk numerous times http://www.supergrubdisk.org/

FAQ Scripting Languages

Languages:
* Perl
* PHP
* Python
* Ruby
* Tcl
* ECMAScript
* Shell
* C

Common to all:

There are two ways to run a script, one by invoking the interpreter on the command line, and the other is to run it as a normal executable.

To mark a file as executable, use this command:

Code:
chmod +x 
To let the system know which interpreter to use, use the shebang ( #! ). It must be the first line of the script. It should point to the interpreter with the correct options.

To run a script, run it like a normal program, if the script isn't in your $PATH variable, specify the path.

The packages to be install, an example program, and the running of it are given here.

Code:
./
Will run a script or program in your current working directory.

Perl:

You don't need to install anything.

PHP Code:
#!/usr/bin/perl
#Save as "hw.pl"
print "Hello world!";
Mark it executable, and run.

PHP Code:
chmod +x hw.pl
./hw.pl
PHP:

You will need to install the php-cli package.

Code:
sudo aptitude install php5-cli
Example program:

PHP Code:
#!/usr/bin/php
// Save as hw.php
echo "Hello world\n";
?>
Mark it as executable and run.

Python:

Python is already installed.

Example program:

PHP Code:
#!/usr/bin/python
#Save as "hw.py"
print "Hello world!"
Mark it as executable and run.

Ruby:

Install with:
Code:
sudo aptitude install ruby
Example program:

PHP Code:
#!/usr/bin/ruby
# Save as "hw.rb"
puts "Hello world!";
Mark as executable and run.

Tcl:

Tcl is installed.

Example program:

PHP Code:
#! /usr/bin/tclsh
# Save as "hw.tcl"
puts "Hello World!"
Mark it as executable and run.

ECMAScript

Note: ECMAScript isn't normally used this way.

You will need to install spidermonkey, which is the ECMAScript interpreter used by Firefox.

Code:
sudo aptitude install spidermonkey-bin
Example program:

PHP Code:
#!/usr/bin/smjs
//Save as "hw.js"
print("Hello world");
Mark as executable and run.

Shell Scripts

Obviously, you have a shell installed.

Example program:

Code:
#!/bin/sh
# Save as "hw.sh"
echo "Hello world"
Mark as executable and run.

C:

Surprise! C is normally compiled, see FAQ: Compiling your first C or C++ programs if you want to learn how to use C. There is a very good C interpreter which you can use. It is also a compiler, and may be better than gcc in some cases.

You will need to install Tiny C Compiler (tcc), use:

Code:
sudo aptitude install tcc
Example program:

PHP Code:
#!/usr/bin/tcc -run
#include

int main(int argv, char ** argv)
{
printf("Hello World\n");
return
0;
}
Mark it as executable and run it.



Read more:

http://ubuntuforums.org/showthread.php?t=692720

SSH - Modify Welcome Message

Modify the SSH Welcome Message

Very simple...

edit this file: /etc/motd

List Largest directories by Diskspace

List Largest directories by Diskspace


Directory Size Lister/Sorter

Have you ever wondered which directories and trees take up all the diskspace? Questions like this come during pruning/archiving, backup, and numerous other activities. Make the following oneliner script (I call it dirsizes) to find out:
Code:
du -sm $(find $1 -type d -maxdepth 1 -xdev) | sort -g

Create a Tar File of current Directory and Sub Directories


Create a tar file of current directory and all sub directories:


Just give the name of the directory to tar. For example, suppose you want to create a tar file for all the files (including all subdirectories) in the directory called myfiles. Give this command from the directory that contains myfiles:
Code:
tar cvf myfiles.tar myfiles

The find command is used to create a list of all the file names that end in .tex. The --files-from argument to tar is then used; this tells tar to only archive those files listed in /tmp/texfilenames.


To check the list of files in the tar file, you can use the t option. For example,

Code:
tar tf myfiles.tar | less 


Search for files and archive only select ones from a list in a file:


Code:
find myfiles -name "*.tex" > /tmp/texfilenames
tar cvf myfiles.tar --files-from /tmp/texfilenames

Sunday, October 12, 2008

Useful Ubuntu commands

Here are some of useful commands that I have come across:

List installed packages / Easy Restore



Create a list of installed packages:

Code:
dpkg --get-selections > installed-software
And if you wanted to use the list to reinstall this software on a fresh ubuntu setup,

Code:
dpkg --set-selections <> 
followed by

Code:
dselect