What does HackerNews think of Command-line-text-processi?

* http://www.compciv.org/unix-tools/

* https://www.commandlinefu.com/commands/browse/sort-by-votes

* https://linoxide.com/linux-how-to/linux-commands-brief-outli...

* https://github.com/learnbyexample/Command-line-text-processi... --> this is my own repo on text processing commands like grep/sed/awk/sort/pr/paste/etc

Bonus:

* https://github.com/jlevy/the-art-of-command-line

* https://stackoverflow.com/questions/68372/what-is-your-singl...

I had started tutorials on command line text processing (https://github.com/learnbyexample/Command-line-text-processi...) more than three years back. I learnt a lot writing them and continue to learn more with experience.

I finished first version of cookbook on Perl one-liners recently. With that, five of the major chapters from that repo are now accessible as better formatted ebooks, updated for newer software versions, exercises, solutions, etc.

You can download pdf/epub versions of the ebooks using the links below (free until this Sunday)

* Perl one-liners cookbook: https://gumroad.com/l/perl-oneliners or https://leanpub.com/perl-oneliners

* Five book bundle of grep/sed/awk/perl/ruby one-liners: https://gumroad.com/l/oneliners or https://leanpub.com/b/oneliners

---

I'd highly appreciate your feedback and hope that you find these resources useful. Happy learning and stay safe :)

* please consider using the same prompt for all examples, a few of them start with `code` while some others start with `awk book` and some do not have any prompt at all

* split long chapters into smaller sections plus add section headings as links at the start of chapter

* please please please avoid parsing ls [1] you could either reuse `sales.csv` or create another sample file instead of using `ls` as source of input... for example, your `ls -l | awk '$NF ~ /c/ {print}'` example will not work if a file is name `code xyz` (note the space)

Also, I have a similar example based hundreds of gawk one-liners [2] tutorial, which I'm currently working towards publishing as a book this month with better examples, descriptions, new regex chapter, etc

[1] https://unix.stackexchange.com/questions/128985/why-not-pars...

[2] https://github.com/learnbyexample/Command-line-text-processi...

Once you get a hang of how shell constructs like pipes, redirections, globs, variable/command substitutions, etc, the various cli text processing tools like grep, sed, awk, perl, sort, tr, pr, paste, etc are worth to learn at least the basics. They have been through years of use and heavily optimized for performance. Just today, a friend of mine called to ask how to improve a Python script's performance for 5-10 MB text file. After confirming he isn't using any other special modules, I advised to check if the performance improves by implementing it using awk.

If anyone's interested in examples based tutorials on cli text processing tools, check out my github repo [2]

[1] https://blog.jpalardy.com/posts/why-learn-awk/

[2] https://github.com/learnbyexample/Command-line-text-processi...

There's plenty of stuff that is similar to Perl, which in turn had borrowed from awk, sed and other tools. The biggest difference I'd pick is Perl's context based operation.

    # Ruby requires explicit conversion with to_i
    ruby -ane 'print if $F[1].to_i > 35'
    perl -ane 'print if $F[1] > 35'

[1] https://github.com/learnbyexample/Command-line-text-processi...

[1] https://github.com/learnbyexample/Command-line-text-processi...

    # input line has to be explicitly printed
    awk '{gsub(/Jack/,"Jill")} 1' file.txt

    # -i will do inplace editing, unlike the awk command
    # -i by itself won't work on non-GNU versions, needs backup extension
    sed 's/Jack/Jill/g' file.txt

    # use single quotes always, unless double is needed
    # -p will behave like default sed
    perl -pe 's/Jack/Jill/g' file.txt

However, I would agree that initial learning curve is tough for sed/awk/perl. Once you get familiar with their idioms, they become the swiss army knife of cli text processing (along with grep). I have an entire repo dedicated to such tools[1]

[1] https://github.com/learnbyexample/Command-line-text-processi...

https://github.com/learnbyexample/Command-line-text-processi...