GNU Parallel Recommendations

Discussions recommending GNU Parallel as a tool for parallelizing command-line tasks and scripts, often questioning or comparing it to the parallelism features of a specific tool or suggesting it as an alternative.

πŸ“‰ Falling 0.4x Open Source
2,754
Comments
20
Years Active
5
Top Authors
#1942
Topic ID

Activity Over Time

2007
1
2008
16
2009
32
2010
88
2011
61
2012
98
2013
115
2014
99
2015
138
2016
195
2017
162
2018
183
2019
186
2020
185
2021
225
2022
225
2023
335
2024
192
2025
201
2026
17

Keywords

e.g CPU GNU IMO futures.html python.org L28 V8 HTTP tar.xz parallel gnu parallelism python linux tar node futures command concurrent

Sample Comments

gjvc β€’ Oct 31, 2021 β€’ View on HN

does this do the same as https://www.gnu.org/software/parallel/ ?

isaachier β€’ Mar 7, 2019 β€’ View on HN

Your tool looks nice, but it doesn't seem to parallelize the work in any way.

pdimitar β€’ Jan 29, 2021 β€’ View on HN

Wasn't aware of that one and it looks very promising, thank you. Does it work with `parallel`? Or does it have a similar built-in facility itself?

throwaway81523 β€’ Apr 26, 2025 β€’ View on HN

GNU Parallel seems like another convenient approach.

simonblanke β€’ Feb 28, 2021 β€’ View on HN

Your parallel computing approach sounds intriguing! Could you provide an example script? I would like to look into this. If you like you could open an issue as a feature request and provide a code snipped there.

dahart β€’ May 6, 2024 β€’ View on HN

Gnu parallel ftw, it’s the single easiest way to speed up command line batches.

dual_basis β€’ Apr 18, 2019 β€’ View on HN

Does it work in parallel though?

glic3rinu β€’ Nov 11, 2020 β€’ View on HN

when you say parallel you mean the work is distributed across multiple cores? e.g. multiple python worker processes. Or is all work running single threaded in a single process (concurrent IO, but not true parallelism)?

slt2021 β€’ Jul 31, 2023 β€’ View on HN

why? gnu parallel is strictly more inferior to multiprocessing module

mring33621 β€’ Jun 6, 2023 β€’ View on HN

GNU Parallel + some Python code?