The time-worn Network File System (NFS), designed by Sun Microsystems Inc. of Santa Clara, CA, over twenty years ago has been getting a much needed makeover. NFS, of course, helps systems to connect so that you can obtain a single view of all files in an environment. But as it was designed for networks circa 1984, its performance left a lot to be desired.
Enter NFSv4.1 which includes a key component known as parallel NFS (pNFS). pNFS enables high-speed data movement between machines.
“The most significant component of NFS V4.1 is the inclusion of pNFS which represents the first major performance upgrade to NFS in over a decade,” said Matt Reid, director of product marketing at Panasas Inc. of Fremont, CA. “pNFS represents the standardization of parallel IO and allows clients to access storage devices directly and in parallel thus eliminating the scalability and performance issues associated with NFS servers deployed today.”
pNFS let’s you do several things. You can stripe a single file across multiple NFS servers, which is essentially the same as RAID0. While RAID0 boosts performance by allowing multiple disk drives to serve up data to in parallel, pNFS takes the concept and extends it to multiple storage devices connected to the NFS client over a network. Even if files are too small to stripe, those files can be distributed across multiple NFS servers. As a result, it provides statistical load balancing. Further, with a capable cluster of NFS servers and a backend file system, files or ranges within files can be relocated transparent to the applications accessing data over pNFS.
This is achieved by the separation of data and metadata, i.e. pNFS moves the metadata server out of the data transfer path. It is actually the same thing that Panasas does in its ActiveStor Parallel Storage Clusters.
At its heart is the third generation ActiveScale OS with the PanFS parallel file system which turns files into smart data objects and then dynamically distributes data transfer operations across Panasas StorageBlade modules. This object-based storage clustering architecture enables parallel data paths between StorageBlade modules and client nodes. According to Reid, the ActiveScale OS dramatically lowers the cost of managing data storage by supporting a massive expansion in data capacity within a single, easily managed namespace.
“Panasas has been a leader in the development of the pNFS standard from the very beginning,” said Reid.
Panasas CTO Garth Gibson, for example, co-authored the standard’s initial problem statement in 2004. Since then, the company has provided substantial technical input to the NFSv4 committee working on pNFS. In addition, it is directly contributing source code to the Linux NFS client and server as well as to the Linux object storage driver, iSCSI driver, and SCSI stack.
Most importantly, the architecture for the pNFS proposal was derived from the Panasas DirectFLOW parallel protocol, which is a core component utilized by the Panasas PanFS parallel file system.
“The Panasas DirectFLOW protocol used in our ActiveStor Parallel Storage Clusters currently provides essentially all of the functionality expected to be available in the NFSv4.1 later this year,” said Reid.
That leads him to assert that his company offers the smoothest transition to fully compliant pNFS-compatible storage systems. Panasas and a host of other major storage vendors will begin shipping such systems next year.
“Users and application developers can take immediate advantage of the high performance and superior ease of use of the only production-proven parallel storage system today, the ActiveStor Parallel Storage Clusters from Panasas,” said Reid.
Panasas, of course, has been shipping parallel storage systems to Fortune 500 companies and major government institutions since 2003. It sees the fact that its architecture has essentially been incorporated into the NFS protocol as a significant validation.
“We are very excited that the Panasas architecture is being adopted as standard by the storage industry as it validates the importance of parallel storage and our vision for the future of file storage,” said Reid. “NFS V4.1 will finally give users a reason to aggressively migrate to the latest version of NFS, primarily because of the dramatic performance benefits of pNFS.”
This is good news for the user community as a whole. After all, there are a number of competing proprietary and open-source parallel file systems in existence. Standardization of parallel IO through pNFS will allow users to reap the benefits of parallel storage systems by choosing best-of-breed solutions without having concerns over vendor lock-in.
“pNFS will accelerate the adoption of parallel storage to a broad range of customers, from traditional HPC, to commercial HPC, to web infrastructure and media distribution,” said Reid. “The future of file storage is parallel and NFS V 4.1 is the start of this major industry transformation.”
This article was first published on EnterpriseITPlanet.com.
Huawei’s AI Update: Things Are Moving Faster Than We Think
FEATURE | By Rob Enderle,
December 04, 2020
Keeping Machine Learning Algorithms Honest in the ‘Ethics-First’ Era
ARTIFICIAL INTELLIGENCE | By Guest Author,
November 18, 2020
Key Trends in Chatbots and RPA
FEATURE | By Guest Author,
November 10, 2020
FEATURE | By Samuel Greengard,
November 05, 2020
ARTIFICIAL INTELLIGENCE | By Guest Author,
November 02, 2020
How Intel’s Work With Autonomous Cars Could Redefine General Purpose AI
ARTIFICIAL INTELLIGENCE | By Rob Enderle,
October 29, 2020
Dell Technologies World: Weaving Together Human And Machine Interaction For AI And Robotics
ARTIFICIAL INTELLIGENCE | By Rob Enderle,
October 23, 2020
The Super Moderator, or How IBM Project Debater Could Save Social Media
FEATURE | By Rob Enderle,
October 16, 2020
FEATURE | By Cynthia Harvey,
October 07, 2020
ARTIFICIAL INTELLIGENCE | By Guest Author,
October 05, 2020
CIOs Discuss the Promise of AI and Data Science
FEATURE | By Guest Author,
September 25, 2020
Microsoft Is Building An AI Product That Could Predict The Future
FEATURE | By Rob Enderle,
September 25, 2020
Top 10 Machine Learning Companies 2020
FEATURE | By Cynthia Harvey,
September 22, 2020
NVIDIA and ARM: Massively Changing The AI Landscape
ARTIFICIAL INTELLIGENCE | By Rob Enderle,
September 18, 2020
Continuous Intelligence: Expert Discussion [Video and Podcast]
ARTIFICIAL INTELLIGENCE | By James Maguire,
September 14, 2020
Artificial Intelligence: Governance and Ethics [Video]
ARTIFICIAL INTELLIGENCE | By James Maguire,
September 13, 2020
IBM Watson At The US Open: Showcasing The Power Of A Mature Enterprise-Class AI
FEATURE | By Rob Enderle,
September 11, 2020
Artificial Intelligence: Perception vs. Reality
FEATURE | By James Maguire,
September 09, 2020
Anticipating The Coming Wave Of AI Enhanced PCs
FEATURE | By Rob Enderle,
September 05, 2020
The Critical Nature Of IBM’s NLP (Natural Language Processing) Effort
ARTIFICIAL INTELLIGENCE | By Rob Enderle,
August 14, 2020
Datamation is the leading industry resource for B2B data professionals and technology buyers. Datamation's focus is on providing insight into the latest trends and innovation in AI, data security, big data, and more, along with in-depth product recommendations and comparisons. More than 1.7M users gain insight and guidance from Datamation every year.
Advertise with TechnologyAdvice on Datamation and our other data and technology-focused platforms.
Advertise with Us
Property of TechnologyAdvice.
© 2025 TechnologyAdvice. All Rights Reserved
Advertiser Disclosure: Some of the products that appear on this
site are from companies from which TechnologyAdvice receives
compensation. This compensation may impact how and where products
appear on this site including, for example, the order in which
they appear. TechnologyAdvice does not include all companies
or all types of products available in the marketplace.