在这个实践教程中，你将学习如何使用 Bash 脚本逐行处理文件。处理文本文件是 Linux 系统管理和自动化中最常见的任务之一，理解如何遍历文件的每一行是处理配置文件、日志和数据处理的一项基本技能。
在本教程结束时，你将能够：
无论你是 Linux 新手还是希望提升脚本编写技能，本教程都将为你提供在 Bash 中高效处理文本文件的知识。
在深入学习文件处理技术之前，我们先创建一些示例文件来进行操作，并学习 Bash 脚本的基础知识。
在你的 LabEx 环境中打开一个终端。你应该位于 /home/labex/project 目录下。让我们创建一个简单的文本文件来进行操作：
mkdir -p ~/project/file_processing
cd ~/project/file_processingcat > sample.txt << EOF
This is the first line of the file.
This is the second line.
This is the third line.
This line comes after an empty line.
This is the last line of the file.
EOF此命令创建了一个名为 sample.txt 的文件，该文件包含六行，其中包括一个空行。
Bash 脚本只是一个包含一系列命令的文本文件，这些命令由 Bash shell 执行。以下是 Bash 脚本的关键组成部分：
#!/bin/bash 开头，以表明该脚本应由 Bash 解释器执行。# 开头的行是注释，会被 shell 忽略。让我们创建一个简单的 Bash 脚本来显示我们示例文件的内容：
cat > display_file.sh << EOF
#!/bin/bash
## A simple script to display the contents of a file
echo "Displaying the contents of sample.txt:"
echo "---------------------------------"
cat sample.txt
echo "---------------------------------"
echo "File displayed successfully!"
EOF现在，使脚本可执行并运行它：
chmod +x display_file.sh
./display_file.sh你应该会看到以下输出：
Displaying the contents of sample.txt:
---------------------------------
This is the first line of the file.
This is the second line.
This is the third line.
This line comes after an empty line.
This is the last line of the file.
---------------------------------
File displayed successfully!恭喜！你已经创建了第一个 Bash 脚本。现在让我们继续学习如何逐行处理文件。
在 Bash 中，逐行读取文件最常用且可靠的方法是使用 while 循环结合 read 命令。这种方法在处理空格、空行和特殊字符方面比其他方法更出色。
让我们创建一个脚本，使用 while 循环逐行读取 sample.txt 文件：
cd ~/project/file_processingcat > read_lines_while.sh << EOF
#!/bin/bash
## Script to read a file line by line using a while loop
file_path="sample.txt"
echo "Reading file: \$file_path using while loop"
echo "---------------------------------"
## Using while loop to read the file line by line
line_number=1
while read -r line; do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done < "\$file_path"
echo "---------------------------------"
echo "File reading completed!"
EOFchmod +x read_lines_while.sh
./read_lines_while.sh你应该会看到类似以下的输出：
Reading file: sample.txt using while loop
---------------------------------
Line 1: This is the first line of the file.
Line 2: This is the second line.
Line 3: This is the third line.
Line 4:
Line 5: This line comes after an empty line.
Line 6: This is the last line of the file.
---------------------------------
File reading completed!让我们详细分析这种方法的关键组成部分：
while read -r line; do：这会启动一个 while 循环，它每次从输入中读取一行，并将其存储在名为 line 的变量中。read 命令的 -r 选项会保留输入中的反斜杠，而不是将其解释为转义字符。在处理可能包含反斜杠的文件内容时，这一点很重要。done < "$file_path"：这会将 $file_path 指定的文件内容重定向到 while 循环的输入。while read 方法有几个优点：
让我们修改脚本，使其能够接受文件路径作为参数：
cat > read_lines_while_arg.sh << EOF
#!/bin/bash
## Script to read a file line by line using a while loop
## Usage: ./read_lines_while_arg.sh <file_path>
if [ \$## -eq 0 ]; then
echo "Error: No file specified"
echo "Usage: \$0 <file_path>"
exit 1
fi
file_path="\$1"
if [ ! -f "\$file_path" ]; then
echo "Error: File '\$file_path' does not exist"
exit 1
fi
echo "Reading file: \$file_path using while loop"
echo "---------------------------------"
## Using while loop to read the file line by line
line_number=1
while read -r line; do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done < "\$file_path"
echo "---------------------------------"
echo "File reading completed!"
EOF使脚本可执行，并尝试用不同的文件运行它：
chmod +x read_lines_while_arg.sh
./read_lines_while_arg.sh sample.txt现在你可以使用这个脚本逐行读取任何文本文件。让我们创建另一个示例文件来测试它：
cat > numbers.txt << EOF
1
2
3
4
5
EOF
./read_lines_while_arg.sh numbers.txt你应该会看到：
Reading file: numbers.txt using while loop
---------------------------------
Line 1: 1
Line 2: 2
Line 3: 3
Line 4: 4
Line 5: 5
---------------------------------
File reading completed!这种方法非常灵活，将是后续更复杂文件处理任务的基础。
虽然通常首选 while 循环方法来逐行读取文件，但 Bash 也提供了 for 循环的方式。这种方法在某些场景下很有用，值得了解。
让我们创建一个使用 for 循环逐行读取 sample.txt 文件的脚本：
cd ~/project/file_processingcat > read_lines_for.sh << EOF
#!/bin/bash
## Script to read a file line by line using a for loop
file_path="sample.txt"
echo "Reading file: \$file_path using for loop"
echo "---------------------------------"
## Using for loop with the cat command
line_number=1
for line in \$(cat "\$file_path"); do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done
echo "---------------------------------"
echo "File reading completed!"
EOFchmod +x read_lines_for.sh
./read_lines_for.sh你会在输出中注意到一些有趣的现象：
Reading file: sample.txt using for loop
---------------------------------
Line 1: This
Line 2: is
Line 3: the
Line 4: first
Line 5: line
Line 6: of
Line 7: the
Line 8: file.
Line 9: This
...
---------------------------------
File reading completed!输出可能并非你所预期的。for 循环不是逐行处理文件，而是按空白字符分割文件内容。这是因为 Bash 中 for 循环的默认行为是按空格、制表符和换行符分割输入。
为了解决这个局限性，我们可以使用另一种保留行结构的 for 循环方法：
cat > read_lines_for_improved.sh << EOF
#!/bin/bash
## Improved script to read a file line by line using a for loop
file_path="sample.txt"
echo "Reading file: \$file_path using improved for loop"
echo "---------------------------------"
## Save the current IFS (Internal Field Separator)
old_IFS="\$IFS"
## Set IFS to newline only
IFS=\$'\n'
## Using for loop with the cat command and modified IFS
line_number=1
for line in \$(cat "\$file_path"); do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done
## Restore the original IFS
IFS="\$old_IFS"
echo "---------------------------------"
echo "File reading completed!"
EOF使脚本可执行并运行它：
chmod +x read_lines_for_improved.sh
./read_lines_for_improved.sh现在输出应该类似于：
Reading file: sample.txt using improved for loop
---------------------------------
Line 1: This is the first line of the file.
Line 2: This is the second line.
Line 3: This is the third line.
Line 4:
Line 5: This line comes after an empty line.
Line 6: This is the last line of the file.
---------------------------------
File reading completed!让我们创建一个更复杂的文件，以更好地说明这两种方法的区别：
cat > complex.txt << EOF
Line with spaces: multiple spaces here
Line with "double quotes" and 'single quotes'
Line with special characters: !@#\$%^&*()
Line with a backslash: C:\\Program Files\\App
EOF现在，让我们创建一个比较这两种方法的脚本：
cat > compare_methods.sh << EOF
#!/bin/bash
## Script to compare while loop and for loop methods
file_path="complex.txt"
echo "WHILE LOOP METHOD:"
echo "---------------------------------"
line_number=1
while read -r line; do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done < "\$file_path"
echo "---------------------------------"
echo "FOR LOOP METHOD (with modified IFS):"
echo "---------------------------------"
## Save the current IFS
old_IFS="\$IFS"
## Set IFS to newline only
IFS=\$'\n'
line_number=1
for line in \$(cat "\$file_path"); do
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
done
## Restore the original IFS
IFS="\$old_IFS"
echo "---------------------------------"
EOF使脚本可执行并运行它：
chmod +x compare_methods.sh
./compare_methods.sh检查输出，看看每种方法如何处理这个复杂的文件。你会注意到，即使使用改进的 IFS 处理方式，while 循环方法通常也比 for 循环更能处理特殊情况。
根据我们的探索，我们可以得出以下结论：
while read 方法通常更健壮，能更好地处理特殊情况。for 循环方法在简单情况下可能有用，但需要仔细处理 IFS 变量。while read 方法。下一步，我们将探讨在处理文件时如何处理空行和其他边缘情况。
在 Bash 中处理文件时，你经常会遇到特殊情况，例如空行、包含特殊字符的行，或者格式不常见的文件。在这一步，我们将探讨如何有效地处理这些边界条件。
让我们创建一个脚本来演示在处理文件时如何处理空行：
cd ~/project/file_processingcat > empty_lines.txt << EOF
This is line 1
This is line 2
This is line 4 (after an empty line)
This is line 6 (after another empty line)
EOFcat > handle_empty_lines.sh << EOF
#!/bin/bash
## Script to demonstrate handling empty lines
file_path="empty_lines.txt"
echo "Reading file and showing all lines (including empty ones):"
echo "---------------------------------"
line_number=1
while read -r line; do
echo "Line \$line_number: [\$line]"
line_number=\$((line_number + 1))
done < "\$file_path"
echo "---------------------------------"
echo "Reading file and skipping empty lines:"
echo "---------------------------------"
line_number=1
while read -r line; do
## Check if the line is empty
if [ -n "\$line" ]; then
echo "Line \$line_number: \$line"
line_number=\$((line_number + 1))
fi
done < "\$file_path"
echo "---------------------------------"
EOFchmod +x handle_empty_lines.sh
./handle_empty_lines.sh你会看到类似以下的输出：
Reading file and showing all lines (including empty ones):
---------------------------------
Line 1: [This is line 1]
Line 2: [This is line 2]
Line 3: []
Line 4: [This is line 4 (after an empty line)]
Line 5: []
Line 6: [This is line 6 (after another empty line)]
---------------------------------
Reading file and skipping empty lines:
---------------------------------
Line 1: This is line 1
Line 2: This is line 2
Line 3: This is line 4 (after an empty line)
Line 4: This is line 6 (after another empty line)
---------------------------------许多数据文件使用逗号（CSV）或制表符（TSV）等分隔符来分隔字段。让我们创建一个脚本来处理一个简单的 CSV 文件：
cat > users.csv << EOF
id,name,email,age
1,John Doe,john@example.com,32
2,Jane Smith,jane@example.com,28
3,Bob Johnson,bob@example.com,45
4,Alice Brown,alice@example.com,37
EOFcat > process_csv.sh << EOF
#!/bin/bash
## Script to process a CSV file
file_path="users.csv"
echo "Processing CSV file: \$file_path"
echo "---------------------------------"
## Skip the header line and process each data row
line_number=0
while IFS=, read -r id name email age; do
## Skip the header line
if [ \$line_number -eq 0 ]; then
echo "Headers: ID, Name, Email, Age"
line_number=\$((line_number + 1))
continue
fi
echo "User \$id: \$name (Age: \$age) - Email: \$email"
line_number=\$((line_number + 1))
done < "\$file_path"
echo "---------------------------------"
echo "Total records processed: \$((\$line_number - 1))"
EOFchmod +x process_csv.sh
./process_csv.sh你应该会看到类似以下的输出：
Processing CSV file: users.csv
---------------------------------
Headers: ID, Name, Email, Age
User 1: John Doe (Age: 32) - Email: john@example.com
User 2: Jane Smith (Age: 28) - Email: jane@example.com
User 3: Bob Johnson (Age: 45) - Email: bob@example.com
User 4: Alice Brown (Age: 37) - Email: alice@example.com
---------------------------------
Total records processed: 4让我们处理包含特殊字符的文件，这些字符有时会导致问题：
cat > special_chars.txt << EOF
Line with asterisks: *****
Line with dollar signs: \$\$\$\$\$
Line with backslashes: \\\\\\
Line with quotes: "quoted text" and 'single quotes'
Line with backticks: \`command\`
EOFcat > handle_special_chars.sh << EOF
#!/bin/bash
## Script to demonstrate handling special characters
file_path="special_chars.txt"
echo "Reading file with special characters:"
echo "---------------------------------"
while read -r line; do
## Using printf instead of echo for better handling of special characters
printf "Line: %s\\n" "\$line"
done < "\$file_path"
echo "---------------------------------"
echo "Escaping special characters for shell processing:"
echo "---------------------------------"
while read -r line; do
## Escape characters that have special meaning in shell
escaped_line=\$(echo "\$line" | sed 's/[\$\`"'\''\\\\*]/\\\\&/g')
echo "Original: \$line"
echo "Escaped: \$escaped_line"
echo ""
done < "\$file_path"
echo "---------------------------------"
EOFchmod +x handle_special_chars.sh
./handle_special_chars.sh检查输出，看看脚本如何处理特殊字符。
处理非常大的文件时，使用节省内存的技术很重要。让我们创建一个脚本，演示如何逐行处理大文件，而无需将整个文件加载到内存中：
cat > process_large_file.sh << EOF
#!/bin/bash
## Script to demonstrate processing a large file efficiently
## For demonstration, we'll create a simulated large file
echo "Creating a simulated large file..."
## Create a file with 1000 lines for demonstration
for i in {1..1000}; do
echo "This is line number \$i in the simulated large file" >> large_file.txt
done
echo "Processing large file line by line (showing only first 5 lines):"
echo "---------------------------------"
count=0
while read -r line; do
## Process only first 5 lines for demonstration
if [ \$count -lt 5 ]; then
echo "Line \$((count + 1)): \$line"
elif [ \$count -eq 5 ]; then
echo "... (remaining lines not shown) ..."
fi
count=\$((count + 1))
done < "large_file.txt"
echo "---------------------------------"
echo "Total lines processed: \$count"
## Clean up
echo "Cleaning up temporary file..."
rm large_file.txt
EOF使脚本可执行并运行它：
chmod +x process_large_file.sh
./process_large_file.sh输出展示了你如何有效地逐行处理大文件，为了演示目的只显示部分数据。
在这一步，你学习了在 Bash 中处理文件时如何处理各种特殊情况和边界条件：
printf 或字符转义等技术。这些技术将帮助你在 Bash 中创建更健壮、更通用的文件处理脚本。
既然你已经学习了在 Bash 中逐行处理文件的各种技术，那么让我们运用这些知识来创建一个实用的日志分析脚本。这个脚本将分析一个示例 Web 服务器日志文件，以提取和总结有用的信息。
首先，让我们创建一个示例 Web 服务器访问日志文件：
cd ~/project/file_processingcat > access.log << EOF
192.168.1.100 - - [10/Oct/2023:13:55:36 -0700] "GET /index.html HTTP/1.1" 200 2326
192.168.1.101 - - [10/Oct/2023:13:56:12 -0700] "GET /about.html HTTP/1.1" 200 1821
192.168.1.102 - - [10/Oct/2023:13:57:34 -0700] "GET /images/logo.png HTTP/1.1" 200 4562
192.168.1.100 - - [10/Oct/2023:13:58:45 -0700] "GET /css/style.css HTTP/1.1" 200 1024
192.168.1.103 - - [10/Oct/2023:13:59:01 -0700] "GET /login.php HTTP/1.1" 302 0
192.168.1.103 - - [10/Oct/2023:13:59:02 -0700] "GET /dashboard.php HTTP/1.1" 200 3652
192.168.1.104 - - [10/Oct/2023:14:00:15 -0700] "POST /login.php HTTP/1.1" 401 285
192.168.1.105 - - [10/Oct/2023:14:01:25 -0700] "GET /nonexistent.html HTTP/1.1" 404 876
192.168.1.102 - - [10/Oct/2023:14:02:45 -0700] "GET /contact.html HTTP/1.1" 200 1762
192.168.1.106 - - [10/Oct/2023:14:03:12 -0700] "GET /images/banner.jpg HTTP/1.1" 200 8562
192.168.1.100 - - [10/Oct/2023:14:04:33 -0700] "GET /products.html HTTP/1.1" 200 4521
192.168.1.107 - - [10/Oct/2023:14:05:16 -0700] "POST /subscribe.php HTTP/1.1" 500 652
192.168.1.108 - - [10/Oct/2023:14:06:27 -0700] "GET /api/data.json HTTP/1.1" 200 1824
192.168.1.103 - - [10/Oct/2023:14:07:44 -0700] "GET /logout.php HTTP/1.1" 302 0
192.168.1.109 - - [10/Oct/2023:14:08:55 -0700] "GET / HTTP/1.1" 200 2326
EOF让我们创建一个脚本来分析这个日志文件并提取有用的信息：
cat > analyze_log.sh << EOF
#!/bin/bash
## Script to analyze a web server access log file
log_file="access.log"
echo "Analyzing log file: \$log_file"
echo "======================================"
## Count total number of entries
total_entries=\$(wc -l < "\$log_file")
echo "Total log entries: \$total_entries"
echo "--------------------------------------"
## Count unique IP addresses
echo "Unique IP addresses:"
echo "--------------------------------------"
unique_ips=0
declare -A ip_count
while read -r line; do
## Extract IP address (first field in each line)
ip=\$(echo "\$line" | awk '{print \$1}')
## Count occurrences of each IP
if [ -n "\$ip" ]; then
if [ -z "\${ip_count[\$ip]}" ]; then
ip_count[\$ip]=1
unique_ips=\$((unique_ips + 1))
else
ip_count[\$ip]=\$((ip_count[\$ip] + 1))
fi
fi
done < "\$log_file"
## Display the IP addresses and their counts
for ip in "\${!ip_count[@]}"; do
echo "\$ip: \${ip_count[\$ip]} requests"
done
echo "--------------------------------------"
echo "Total unique IP addresses: \$unique_ips"
echo "--------------------------------------"
## Count HTTP status codes
echo "HTTP Status Code Distribution:"
echo "--------------------------------------"
declare -A status_codes
while read -r line; do
## Extract status code (9th field in typical Apache log format)
status=\$(echo "\$line" | awk '{print \$9}')
## Count occurrences of each status code
if [ -n "\$status" ]; then
if [ -z "\${status_codes[\$status]}" ]; then
status_codes[\$status]=1
else
status_codes[\$status]=\$((status_codes[\$status] + 1))
fi
fi
done < "\$log_file"
## Display the status codes and their counts
for status in "\${!status_codes[@]}"; do
case "\$status" in
200) description="OK" ;;
302) description="Found/Redirect" ;;
401) description="Unauthorized" ;;
404) description="Not Found" ;;
500) description="Internal Server Error" ;;
*) description="Other" ;;
esac
echo "Status \$status (\$description): \${status_codes[\$status]} requests"
done
echo "--------------------------------------"
## Identify requested resources
echo "Top requested resources:"
echo "--------------------------------------"
declare -A resources
while read -r line; do
## Extract the requested URL (typical format: "GET /path HTTP/1.1")
request=\$(echo "\$line" | awk -F'"' '{print \$2}')
method=\$(echo "\$request" | awk '{print \$1}')
resource=\$(echo "\$request" | awk '{print \$2}')
## Count occurrences of each resource
if [ -n "\$resource" ]; then
if [ -z "\${resources[\$resource]}" ]; then
resources[\$resource]=1
else
resources[\$resource]=\$((resources[\$resource] + 1))
fi
fi
done < "\$log_file"
## Display the top resources
## For simplicity, we'll just show all resources
for resource in "\${!resources[@]}"; do
echo "\$resource: \${resources[\$resource]} requests"
done
echo "======================================"
echo "Analysis complete!"
EOFchmod +x analyze_log.sh
./analyze_log.sh输出将提供对访问日志的详细分析，包括：
让我们增强脚本，以包含更多有用的分析：
cat > enhanced_log_analyzer.sh << EOF
#!/bin/bash
## Enhanced script to analyze a web server access log file
log_file="access.log"
echo "Enhanced Log File Analysis: \$log_file"
echo "======================================"
## Count total number of entries
total_entries=\$(wc -l < "\$log_file")
echo "Total log entries: \$total_entries"
echo "--------------------------------------"
## Count unique IP addresses
echo "Unique IP addresses:"
echo "--------------------------------------"
unique_ips=0
declare -A ip_count
while read -r line; do
## Extract IP address (first field in each line)
ip=\$(echo "\$line" | awk '{print \$1}')
## Count occurrences of each IP
if [ -n "\$ip" ]; then
if [ -z "\${ip_count[\$ip]}" ]; then
ip_count[\$ip]=1
unique_ips=\$((unique_ips + 1))
else
ip_count[\$ip]=\$((ip_count[\$ip] + 1))
fi
fi
done < "\$log_file"
## Display the IP addresses and their counts
for ip in "\${!ip_count[@]}"; do
echo "\$ip: \${ip_count[\$ip]} requests"
done
echo "--------------------------------------"
echo "Total unique IP addresses: \$unique_ips"
echo "--------------------------------------"
## Count HTTP status codes
echo "HTTP Status Code Distribution:"
echo "--------------------------------------"
declare -A status_codes
while read -r line; do
## Extract status code (9th field in typical Apache log format)
status=\$(echo "\$line" | awk '{print \$9}')
## Count occurrences of each status code
if [ -n "\$status" ]; then
if [ -z "\${status_codes[\$status]}" ]; then
status_codes[\$status]=1
else
status_codes[\$status]=\$((status_codes[\$status] + 1))
fi
fi
done < "\$log_file"
## Display the status codes and their counts
for status in "\${!status_codes[@]}"; do
case "\$status" in
200) description="OK" ;;
302) description="Found/Redirect" ;;
401) description="Unauthorized" ;;
404) description="Not Found" ;;
500) description="Internal Server Error" ;;
*) description="Other" ;;
esac
echo "Status \$status (\$description): \${status_codes[\$status]} requests"
done
echo "--------------------------------------"
## Analyze HTTP methods
echo "HTTP Methods:"
echo "--------------------------------------"
declare -A methods
while read -r line; do
## Extract the HTTP method
request=\$(echo "\$line" | awk -F'"' '{print \$2}')
method=\$(echo "\$request" | awk '{print \$1}')
## Count occurrences of each method
if [ -n "\$method" ]; then
if [ -z "\${methods[\$method]}" ]; then
methods[\$method]=1
else
methods[\$method]=\$((methods[\$method] + 1))
fi
fi
done < "\$log_file"
## Display the HTTP methods and their counts
for method in "\${!methods[@]}"; do
echo "\$method: \${methods[\$method]} requests"
done
echo "--------------------------------------"
## Identify requested resources
echo "Top requested resources:"
echo "--------------------------------------"
declare -A resources
while read -r line; do
## Extract the requested URL
request=\$(echo "\$line" | awk -F'"' '{print \$2}')
resource=\$(echo "\$request" | awk '{print \$2}')
## Count occurrences of each resource
if [ -n "\$resource" ]; then
if [ -z "\${resources[\$resource]}" ]; then
resources[\$resource]=1
else
resources[\$resource]=\$((resources[\$resource] + 1))
fi
fi
done < "\$log_file"
## Display the resources
for resource in "\${!resources[@]}"; do
echo "\$resource: \${resources[\$resource]} requests"
done
echo "--------------------------------------"
## Find error requests
echo "Error Requests (4xx and 5xx):"
echo "--------------------------------------"
error_count=0
while read -r line; do
## Extract the status code and URL
status=\$(echo "\$line" | awk '{print \$9}')
request=\$(echo "\$line" | awk -F'"' '{print \$2}')
resource=\$(echo "\$request" | awk '{print \$2}')
ip=\$(echo "\$line" | awk '{print \$1}')
## Check if status code begins with 4 or 5 (client or server error)
if [[ "\$status" =~ ^[45] ]]; then
echo "[\$status] \$ip requested \$resource"
error_count=\$((error_count + 1))
fi
done < "\$log_file"
if [ \$error_count -eq 0 ]; then
echo "No error requests found."
fi
echo "======================================"
echo "Enhanced analysis complete!"
EOF使脚本可执行并运行它：
chmod +x enhanced_log_analyzer.sh
./enhanced_log_analyzer.sh这个增强的脚本提供了更多的见解，包括使用的 HTTP 方法和错误请求列表。
最后，让我们修改脚本，使其接受日志文件路径作为命令行参数，从而使其更加通用：
cat > log_analyzer_cli.sh << EOF
#!/bin/bash
## Log analyzer that accepts a log file path as command-line argument
## Usage: ./log_analyzer_cli.sh <log_file_path>
## Check if log file path is provided
if [ \$## -eq 0 ]; then
echo "Error: No log file specified"
echo "Usage: \$0 <log_file_path>"
exit 1
fi
log_file="\$1"
## Check if the specified file exists
if [ ! -f "\$log_file" ]; then
echo "Error: File '\$log_file' does not exist"
exit 1
fi
echo "Log File Analysis: \$log_file"
echo "======================================"
## Count total number of entries
total_entries=\$(wc -l < "\$log_file")
echo "Total log entries: \$total_entries"
echo "--------------------------------------"
## Count unique IP addresses
echo "Unique IP addresses:"
echo "--------------------------------------"
unique_ips=0
declare -A ip_count
while read -r line; do
## Extract IP address (first field in each line)
ip=\$(echo "\$line" | awk '{print \$1}')
## Count occurrences of each IP
if [ -n "\$ip" ]; then
if [ -z "\${ip_count[\$ip]}" ]; then
ip_count[\$ip]=1
unique_ips=\$((unique_ips + 1))
else
ip_count[\$ip]=\$((ip_count[\$ip] + 1))
fi
fi
done < "\$log_file"
## Display the IP addresses and their counts
for ip in "\${!ip_count[@]}"; do
echo "\$ip: \${ip_count[\$ip]} requests"
done
echo "--------------------------------------"
echo "Total unique IP addresses: \$unique_ips"
echo "--------------------------------------"
## Count HTTP status codes
echo "HTTP Status Code Distribution:"
echo "--------------------------------------"
declare -A status_codes
while read -r line; do
## Extract status code (9th field in typical Apache log format)
status=\$(echo "\$line" | awk '{print \$9}')
## Count occurrences of each status code
if [ -n "\$status" ]; then
if [ -z "\${status_codes[\$status]}" ]; then
status_codes[\$status]=1
else
status_codes[\$status]=\$((status_codes[\$status] + 1))
fi
fi
done < "\$log_file"
## Display the status codes and their counts
for status in "\${!status_codes[@]}"; do
case "\$status" in
200) description="OK" ;;
302) description="Found/Redirect" ;;
401) description="Unauthorized" ;;
404) description="Not Found" ;;
500) description="Internal Server Error" ;;
*) description="Other" ;;
esac
echo "Status \$status (\$description): \${status_codes[\$status]} requests"
done
echo "======================================"
echo "Analysis complete!"
EOF使脚本可执行，并使用我们的访问日志文件进行测试：
chmod +x log_analyzer_cli.sh
./log_analyzer_cli.sh access.log该脚本应产生与我们之前示例类似的输出，但现在更加灵活，因为它可以分析作为命令行参数指定的任何日志文件。
在这一步中，你应用了之前步骤中学到的文件处理技术，创建了一个实用的日志分析工具。这展示了 Bash 在处理和分析日志文件等文本文件方面的强大功能。
你学习了如何：
这些技能可以应用于除日志分析之外的广泛文件处理任务，使你在 Bash 脚本编写和文件处理方面更加熟练。
恭喜你完成了「如何使用 Bash 逐行遍历文件」教程。在整个实验中，你学习了在 Bash 脚本中逐行处理文件的重要技术，这些技术将为你在文本处理、日志分析和常规文件处理方面提供宝贵的技能。
while read 方法，这是处理各种文件格式和特殊字符最可靠的方法。for 循环方法，这种方法简洁，但需要特殊处理以保持行的完整性。为了进一步提升你的 Bash 脚本编写技能，你可以考虑探索以下内容：
awk、sed 和 grep 等工具，以获得更强大的文本处理能力。通过掌握 Bash 中的这些文件处理技术，你现在拥有了一套强大的工具，可以在 Linux 环境中处理文本数据。这些技能为更高级的 shell 脚本编写和系统管理任务奠定了坚实的基础。
