Tuesday, 2 January 2018

Linux Tips & Tricks - using parallel in bash

Linux Tips & Tricks - using parallel in bash

So you got that fancy new umpteen core CPU, but what good is it when you run commands from the command line? Most often the answer is none, other than when compiling with -jn (where n = number of cores plus one).
However, with the "parallel" command, you can make it happen.

For OpenSuSE users, just go here and pick the one for your version of OpenSuSE.
https://software.opensuse.org/package/parallel
https://bash-prompt.net/guides/parallell-bash/
at

4 comments:

  1. Adrian Colley2 January 2018 at 18:34

    GNU parallel is the shit. Don't be distracted by the one in moreutils. I routinely use a "find | parallel zgrep" command (many flags not included here) to do cheaply what Splunk does expensively.

    ReplyDelete
  2. Christopher Gaul2 January 2018 at 22:08

    Adrian Colley the citation nonsense is annoying though, but other than that...

    ReplyDelete
  3. Adrian Colley3 January 2018 at 03:40

    Yeah, I find "parallel --plain" essential for scripting, because it disables the whole citation business.

    ReplyDelete
  4. Christopher Gaul3 January 2018 at 07:15

    Adrian Colley It's really annoying and I can't believe Stallman let's them get away with it. Seems so very anti-GNU.

    ReplyDelete