Practical unix utilities for text processing
Download as PPTX, PDF21 likes3,236 views
This document provides examples of common Linux utilities used for text processing and manipulation. It lists utilities like grep, sed, awk, cut, sort, uniq and provides usage examples for searching for strings, printing/deleting lines, making substitutions, counting words, splitting files and more. The takeaway is to use the man command or info coreutils to learn more about these powerful utilities.
![awkawk'{arr[$2]+=$1} END { for (id in arr) printf "%s\t%d\t\n",id,arr[id]}'](https://image.slidesharecdn.com/practical-unix-utilities-101002005258-phpapp01/85/Practical-unix-utilities-for-text-processing-28-320.jpg)
Practical unix utilities for text processing
- 1. grep | sed | awk | xargs | etcPractical *nix utilities(for text processing)
- 2. whoami
- 5. pwd | ls | find | teeGNU Coreutilshttp://www.gnu.org/software/coreutils/The takeaway command:man> info coreutils
- 6. pwd | ls | find | teeList of files:ls –lls–1ls –latrfind . –name *.txt
- 7. pwd | ls | find | teeSeek for a string in a file:grep“cat” file.txtgrep –v “dog” file.txtgrep –i “PaTtErN” file.txtegrep“cat|dog” file.txtzgrep“cat” file.txt.gz
- 8. for / xargsDo something with each file:for file in `find . –name *tmp` dorm$file donefind . –name *tmp| xargsrm
- 9. pwd | ls | find | teefind + grepfind . -name '*txt' -exec grep-l aaa{} \;find . -name '*txt' | xargsgrep-l aaa
- 10. pwd | ls | find | teecatgreptacecholsdutestmvsplittaildirjoinwcheadtrsortsumcutexpruniqpastekilltee
- 11. paste
- 12. join
- 13. sort | uniq
- 14. wc
- 15. cut
- 16. csplit
- 17. awksed
- 18. sedsfor substitutionsed‘s/cat/dog/’ # cat -> dogsed ‘s/\(a\)\(b\)/\2\1/’# ab-> ba
- 19. sedpfor printingsed –n ‘/dog/p’ # print lines that match ‘dog’sed–n ‘/start/,/end/p’# print range
- 20. seddto deletesed ‘/dog/d’# delete lines that match ‘dog’sed ‘1,/pattern/d’# delete range
- 21. sed| and –e for invocationsed ‘s/a/A/’ | sed ‘s/b/B/’#sed –e ‘s/a/A/’ –e ‘s/b/B/’ #
- 22. sed{ .. } to group the commandssed ‘/pattern/ { s/p/P/ s/e/E/ }’#pattern -> PattErn
- 23. sedrto read a filesed ‘/include/ r file.txt’# insert file.txt after includewto write to a filesed‘/pattern/ w file.txt’# write matched lines to a file
- 24. sedtris
- 25. awkaaabbb cccaaabbbzzzawk '/zzz/' 1.txt grepzzz 1.txtaaabbbzzz
- 26. awkawk'BEGIN{<initializations>}<pattern 1> {<actions>}<pattern 2> {<actions>}... END{<final actions>}'
- 27. awkawk'BEGIN{a=0, b=0} /aaa/{a++} /bbb/ {b++}END{printf “%d\t%d”,a,b}'
- 28. awkawk'{arr[$2]+=$1} END { for (id in arr) printf "%s\t%d\t\n",id,arr[id]}'