Linux Foundation will host the PaSh project, accelerating Shell scripting with automated parallelization for industrial use cases

SAN FRANCISCO, September 21, 2021 / PRNewswire / – The Linux Foundation, the non-profit organization enabling mass innovation through open source, today announced that it will host the PaSh project. PaSh is an automatic POSIX shell script parallelization system that optimizes programs and speeds up execution times, leading to faster results for data scientists, engineers, biologists, economists, administrators and programmers.

The project is supported by MIT, Rice University, Stevens Institute of Technology, and the University of Pennsylvania and governed by a technical steering committee which includes Nikos Vasilakis, researcher at MIT; Michael greenberg, assistant professor at Stevens Institute of Technology; and Konstantinos Kallas, Ph.D. student at University of Pennsylvania.

“The Linux Foundation provides the infrastructure and technical governance services that PaSh needs as it has matured,” said Nikos Vasilakis, president of the technical steering committee of the PaSh project. “We created the project to improve and speed up execution of shell scripts in the face of new changes in web crawling, indexing and natural language processing. ”

Konstantinos Kallas, a member of the technical steering committee of the PaSh project, adds “PaSh has received considerable attention from the academic community and has the potential to have a disproportionate impact in the industry today, due to several synergistic trends. It’s the right decision at the right time. ”

The techniques behind the project have won several awards, including a Best Paper Award at the 16th EuroSys Conference and a Graduate Research Award for Konstantinos by the Association of Computing Machinery.

From succinct discussion of data and day-to-day processing, to orchestrating and administering the system, shell scripts (the ubiquitous glue of commands developed together in different languages) form the backbone of the IT user space of today. PaSh parallelizes shell scripts, which greatly improves performance. On modern multiprocessor computers, PaSh can perform tasks such as web crawling and indexing, COVID19-related scans, natural language processing, and other workloads in a fraction of their original time with minimal developer effort to zero.

“Shell scripts have been used ubiquitously for half a century, and recent trends in ‘containerization’ have only increased their importance,” said Michael greenberg, member of the technical steering committee of the PaSh project. “Correct and automated parallelization of shell scripts has been an issue for several decades. PaSh promises speed acceleration to shell users of all stripes.”

To speed up shell scripting, PaSh provides a source-to-source parallelization compiler, a program that takes a programmer’s shell script as input and returns a new program significantly faster than the original program. Since PaSh is source-to-source, it allows the optimized shell script to be inspected and executed using the same tools, in the same environment, and with the same data as the original script. A small runtime library and associated annotations on programs commonly used in shell scripts complete the picture, providing the PaSh compiler with high performance primitives and supporting its key functions.

“The PaSh project represents innovation in computing and open source software,” said Mike Dolan, Managing Director and Senior Vice President of Projects at the Linux Foundation. “As software development evolves to address machine learning, containerization, artificial intelligence and more, PaSh is coming forward to support developers and data scientists who need more from their scripting tools. We are happy to be able to host this important work at the Linux Foundation, a natural home for a project like this. ”

To find out more and get involved in the PaSh project, visit

About the Linux Foundation
Founded in 2000, the Linux Foundation is supported by more than 1,000 members and is the world leader in collaboration on open source software, open standards, open data and open hardware. Linux Foundation projects are essential to global infrastructure, including Linux, Kubernetes, Node.js, etc. The Linux Foundation’s methodology focuses on leveraging best practices and meeting the needs of contributors, users, and solution providers to create enduring models of open collaboration. For more information, please visit us at

The Linux Foundation has registered trademarks and uses trademarks. For a list of The Linux Foundation trademarks, please see our Trademark Usage page: Linux is a registered trademark of Linus Torvalds.

Media contact
Jennifer cloer
History changes culture
[email protected]

SOURCE The Linux Foundation

Related links

About Edward Fries

Check Also

Organist Peter Conte will perform in concert | Herald Community Newspapers

Renowned organist Peter Richard Conte will give a recital on May 13 at St Agnes …

Leave a Reply

Your email address will not be published.