Awesome Storage | File Sharing & File System Resources

  • A blessed day to our new members and guests. Feel free to explore and don't forget to read our Forum Rules.
    We’re looking forward to having you again as our UDPFamily :)
Welcome to UDPHub forum
Join this amazing group of people and start discussing what you like.
Register now

Beatrice

Moderator
Staff member
Verified
Contributor
You must be registered for see images

Awesome Storage
A curated list of storage open-source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Distributed file systems
Systems that expose a traditional file system interface with POSIX semantics.
  • - Ceph’s file system runs on top of the same object storage system that provides object storage and block device interfaces. The Ceph metadata server cluster provides a service that maps the directories and file names of the file system to objects stored within RADOS clusters. The metadata server cluster can expand or contract, and it can rebalance the file system dynamically to distribute data evenly among cluster hosts. This ensures high performance and prevents heavy loads on specific hosts within the cluster.
  • - LeoFS is a highly available, distributed, eventually consistent object/blob store. If you are searching a storage system that is able to store huge amount and various kind of raw data in its native format, LeoFS is suitable for that.
  • - XtreemFS is a general-purpose storage system and covers most storage needs in a single deployment. It is open-source, requires no special hardware or kernel modules, and can be mounted on Linux, Windows, and OS X.
  • - OrangeFS is a software-based scale-out parallel storage system. It is ideal for large storage problems faced by HPC, BigData, Streaming Video, Genomics and Bioinformatics.
  • - BeeGFS is the leading parallel cluster file system, developed with a strong focus on performance and designed for very easy installation and management. If I/O intensive workloads are your problem, BeeGFS is the solution.
  • - Gluster is a scalable network filesystem. Using common off-the-shelf hardware, you can create large, distributed storage solutions for media streaming, data analysis, and other data- and bandwidth-intensive tasks. Gluster is free.
  • - CloudFS is a distributed filesystem specifically intended to solve problems faced by a cloud provider when offering filesystem access “as a service” to cloud users (a.k.a. tenants).
  • - LizardFS Software Defined Storage is a distributed, parallel, scalable, fault-tolerant, Geo-Redundant and highly available file system.
File sharing
  • - Linshare is an Open Source secure file sharing application intended to cover your business security and file transfer needs. If confidentiality and traceability are paramount for your business file transfers, then LinShare is your solution and better yet it’s free! We also offer high-quality support services provided by our IT teams to suit your network at best.
  • - Seafile is an open-source file sync&share solution designed for high reliability, performance, and productivity. Sync, share, and collaborate across devices and teams. Build your team’s knowledge base with Seafile’s built-in Wiki feature.
  • - ProjectSend is a self-hosted application (you can install it easily on your own VPS or shared web hosting account) that lets you upload files and assign them to specific clients that you create yourself! Secure, private, and easy. No more depending on external services or e-mail to send those files!
  • - Aurora Files is an open-source file storage platform for small teams and personal users.
  • - With over 50 million users worldwide, ownCloud is the market-leading open-source software for cloud-based collaboration platforms. As an alternative to Dropbox, OneDrive, and Google Drive, ownCloud offers real data security and privacy for you and your data.
  • - Nextcloud Files enables enterprises to take back control over their data, ensuring compliance, security, and instant availability wherever their employees are.
  • - Modern file management platform built according to your business needs and regulations, Pydio is open-source software deployed on your servers or wherever you decide.
  • - YouTransfer is a simple but elegant self-hosted file transfer & sharing solution. It is an alternative to paid services like Dropbox and WeTransfer by offering similar features but without limitations, price plans, and a lengthy privacy policy. You remain in control of your files.
Backups, replication, distribution
Software that handles backup and high availability of information, independent from the storage itself.
  • - Bacula is a set of Open Source, computer programs that permit you (or the system administrator) to manage backup, recovery, and verification of computer data across a network of computers of different kinds.
  • - Zenko is Scality’s Open Source Multi-Cloud Data Controller. Zenko lets you be in control of your data and leverage the efficiency of private and public clouds.
  • - UrBackup is an easy to setup Open Source client/server backup system, that through a combination of image and file backups accomplishes both data safety and a fast restoration time.
  • - Amanda is the most popular open-source backup and recovery software in the world. Amanda protects more than a million servers and desktops running various versions of Linux, UNIX, BSD, Mac OS-X, and Microsoft Windows operating systems worldwide.
  • - Bareos is a 100% open-source fork of the backup project from . The fork is in development since late 2010, it has a lot of new features.
  • - Free backup software to store encrypted backups online. For Windows, macOS, and Linux.
  • - ElkarBackup is a free open-source backup solution based on RSync/RSnapshot.
  • - BackupPC is a high-performance, enterprise-grade system for backing up Linux, Windows, and macOS PCs and laptops to a server’s disk. BackupPC is highly configurable and easy to install and maintain.
S3 compatible file servers
File servers that expose S3 compatible APIs
  • - A high performance, distributed object storage server, designed for large-scale data infrastructure. It is an ideal S3-compatible replacement for Hadoop HDFS and scale-out NAS for machine learning and other big data workloads.
  • - Ceph’s file system runs on top of the same object storage system that provides object storage and block device interfaces. The Ceph metadata server cluster provides a service that maps the directories and file names of the file system to objects stored within RADOS clusters. The metadata server cluster can expand or contract, and it can rebalance the file system dynamically to distribute data evenly among cluster hosts. This ensures high performance and prevents heavy loads on specific hosts within the cluster.
  • - LeoFS is a highly available, distributed, eventually consistent object/blob store. If you are searching a storage system that is able to store huge amount and various kind of raw data in its native format, LeoFS is suitable for that.
  • - Riak® S2 is a highly available, scalable, easy-to-operate object storage software solution that’s optimized for holding videos, images, and other files. It provides simple but powerful storage for large objects built for private, public, and hybrid clouds.
  • - OpenIO SDS is an open-source object storage solution ideal for Big Data, HPC, and AI. With its distributed grid architecture and unique self-healing technology, OpenIO scales easily without mandatory data rebalancing, while delivering consistently high performance. OpenIO is S3 compatible and can be deployed on-premise or cloud-hosted, on any hardware that you choose.
Source: GitHub