Zaira Hira
Shell scripting is an important part of process automation in Linux. Scripting helps you write a sequence of commands in a file and then execute them.
This saves you time because you don't have to write certain commands again and again. You can perform daily tasks efficiently and even schedule them for automatic execution.
You can also set certain scripts to execute on startup such as showing a particular message on launching a new session or setting certain environment variables.
The applications and uses of scripting are numerous, so let's dive in.
In this article, you will learn:
The best way to learn is by practicing. I highly encourage you to follow along using Replit. You can access a running Linux shell within minutes.
The Linux command line is provided by a program called the shell. Over the years, the shell program has evolved to cater to various options.
Different users can be configured to use different shells. But most users prefer to stick with the current default shell. The default shell for many Linux distros is the GNU Bourne-Again Shell (bash). Bash is succeeded by Bourne shell ( sh ).
When you first launch the shell, it uses a startup script located in the .bashrc or .bash_profile file which allows you to customize the behavior of the shell.
When a shell is used interactively, it displays a $ when it is waiting for a command from the user. This is called the shell prompt.
If shell is running as root, the prompt is changed to # . The superuser shell prompt looks like this:
Bash is very powerful as it can simplify certain operations that are hard to accomplish efficiently with a GUI. Remember that most servers do not have a GUI, and it is best to learn to use the powers of a command line interface (CLI).
A bash script is a series of commands written in a file. These are read and executed by the bash program. The program executes line by line.
For example, you can navigate to a certain path, create a folder and spawn a process inside it using the command line.
You can do the same sequence of steps by saving the commands in a bash script and running it. You can run the script any number of times.
By naming conventions, bash scripts end with a .sh . However, bash scripts can run perfectly fine without the sh extension.
Scripts are also identified with a shebang . Shebang is a combination of bash # and bang ! followed the the bash shell path. This is the first line of the script. Shebang tells the shell to execute it via bash shell. Shebang is simply an absolute path to the bash interpreter.
Below is an example of the shebang statement.
#! /bin/bash
The path of the bash program can vary. We will see later how to identify it.
Scripts have execution rights for the user executing them.
An execution right is represented by x . In the example below, my user has the rwx (read, write, execute) rights for the file test_script.sh
Executable scripts appear in a different colour from rest of the files and folders.
In my case, the scripts with execution rights appear as green.
Let's create a simple script in bash that outputs Hello World .
touch hello_world.sh
which bash
In my case, the path is /usr/bin/bash and I will include this in the shebang.
We will echo "hello world" to the console.
Our script will look something like this:
#! /usr/bin/bash echo "Hello World"
Edit the file hello_world.sh using a text editor of your choice and add the above lines in it.
Modify the file permissions and allow execution of the script by using the command below:
chmod u+x hello_world.sh
chmod modifies the existing rights of a file for a particular user. We are adding +x to user u .
You can run the script in the following ways:
Here's the output:
Two ways to run scripts
Just like any other programming language, bash scripting follows a set of rules to create programs understandable by the computer. In this section, we will study the syntax of bash scripting.
We can define a variable by using the syntax variable_name=value . To get the value of the variable, add $ before the variable.
#!/bin/bash # A simple variable example greeting=Hello name=Tux echo $greeting $name
Tux is also the name of the Linux mascot, the penguin.
Hi, I am Tux.
Below are the operators supported by bash for mathematical calculations:
Operator | Usage |
---|---|
+ | addition |
- | subtraction |
multiplication | |
/ | division |
* | exponentiation |
% | modulus |
Let's run a few examples.
Note the spaces, these are part of the syntax
Numerical expressions can also be calculated and stored in a variable using the syntax below:
Let's try an example.
#!/bin/bash var=$((3+9)) echo $var
Fractions are not correctly calculated using the above methods and truncated.
For decimal calculations, we can use bc command to get the output to a particular number of decimal places. bc (Bash Calculator) is a command line calculator that supports calculation up to a certain number of decimal points.
echo "scale=2;22/7" | bc
Where scale defines the number of decimal places required in the output.
Getting output to 2 decimal places
Sometimes you'll need to gather user input and perform relevant operations.
In bash, we can take user input using the read command.
read variable_name
To prompt the user with a custom message, use the -p flag.
read -p "Enter your age" variable_name
Example:
#!/bin/bash echo "Enter a numner" read a echo "Enter a numner" read b var=$((a+b)) echo $var
Comparison is used to check if statements evaluate to true or false . We can use the below shown operators to compare two statements:
Operation | Syntax | Explanation |
---|---|---|
Equality | num1 -eq num2 | is num1 equal to num2 |
Greater than equal to | num1 -ge num2 | is num1 greater than equal to num2 |
Greater than | num1 -gt num2 | is num1 greater than num2 |
Less than equal to | num1 -le num2 | is num1 less than equal to num2 |
Less than | num1 -lt num2 | is num1 less than num2 |
Not Equal to | num1 -ne num2 | is num1 not equal to num2 |
Syntax:
if [ conditions ] then commands fi
Example:
Let's compare two numbers and find their relationship:
read x read y if [ $x -gt $y ] then echo X is greater than Y elif [ $x -lt $y ] then echo X is less than Y elif [ $x -eq $y ] then echo X is equal to Y fi
Conditions are expressions that evaluate to a boolean expression ( true or false ). To check conditions, we can use if , if-else , if-elif-else and nested conditionals.
The structure of conditional statements is as follows:
Syntax:
if [[ condition ]] then statement elif [[ condition ]]; then statement else do this by default fi
To create meaningful comparisons, we can use AND -a and OR -o as well.
The below statement translates to: If a is greater than 40 and b is less than 6.
if [ $a -gt 40 -a $b -lt 6 ]
Example: Let's find the triangle type by reading the lengths of its sides.
read a read b read c if [ $a == $b -a $b == $c -a $a == $c ] then echo EQUILATERAL elif [ $a == $b -o $b == $c -o $a == $c ] then echo ISOSCELES else echo SCALENE fi
Output:
For loops allow you to execute statements a specific number of times.
In the example below, the loop will iterate 5 times.
#!/bin/bash for i in do echo $i done
We can loop through strings as well.
#!/bin/bash for X in cyan magenta yellow do echo $X done
While loops check for a condition and loop until the condition remains true . We need to provide a counter statement that increments the counter to control loop execution.
In the example below, (( i += 1 )) is the counter statement that increments the value of i .
Example:
#!/bin/bash i=1 while [[ $i -le 10 ]] ; do echo "$i" (( i += 1 )) done
Suppose we have a file sample_file.txt as shown below:
We can read the file line by line and print the output on the screen.
#!/bin/bash LINE=1 while read -r CURRENT_LINE do echo "$LINE: $CURRENT_LINE" ((LINE++)) done < "sample_file.txt"
Output:
Lines with line number printed
If you need to include the output of a complex command in your script, you can write the statement inside back ticks.
Example: Suppose we want to get the output of a list of mountpoints with tmpfs in their name. We can craft a statement like this: df -h | grep tmpfs .
To include it in the bash script, we can enclose it in back ticks.
#!/bin/bash var=`df -h | grep tmpfs` echo $var
It is possible to give arguments to the script on execution.
$@ represents the position of the parameters, starting from one.
#!/bin/bash for x in $@ do echo "Entered arg is $x" done
Run it like this:
./script arg1 arg2
Cron is a job scheduling utility present in Unix like systems. You can schedule jobs to execute daily, weekly, monthly or in a specific time of the day. Automation in Linux heavily relies on cron jobs.
Below is the syntax to schedule crons:
# Cron job example * * * * * sh /path/to/script.sh
Here, * represents minute(s) hour(s) day(s) month(s) weekday(s), respectively.
Below are some examples of scheduling cron jobs.
SCHEDULE | SCHEDULED VALUE |
---|---|
5 0 8 | At 00:05 in August. |
5 4 6 | At 04:05 on Saturday. |
0 22 1-5 | At 22:00 on every day-of-week from Monday through Friday. |
You can learn about cron in detail in this blog post.
crontab -l lists the already scheduled scripts for a particular user.
My scheduled scripts
The find command helps to locate files based on certain patterns. As most of the scripts end with .sh , we can use the find script like this:
find . -type f -name "*.sh"
If you are interested to read about the find command in detail, check my other post.
In this tutorial we learned the basics of shell scripting. We looked into examples and syntax which can help us write meaningful programs.
What’s your favorite thing you learned from this tutorial? Let me know on Twitter!
You can read my other posts here.