Login  |  Join Us  |  Subscribe to Newsletter
Login to View News Feed and Manage Profile
☰
Login
Join Us
Login to View News Feed and Manage Profile
Agency
Agency
  • Home
  • Information
    • Discussion
    • Articles
    • Whitepapers
    • Use Cases
    • News
    • Contributors
    • Subscribe to Newsletter
  • Courses
    • Data Science & Analytics
    • Statistics and Related Courses
    • Online Data Science Courses
  • Prodigy
    • Prodigy Login
    • Prodigy Find Out More
    • Prodigy Free Services
    • Prodigy Feedback
    • Prodigy T&Cs
  • Awards
    • Contributors Competition
    • Data Science Writer Of The Year
  • Membership
    • Individual
    • Organisational
    • University
    • Associate
    • Affiliate
    • Benefits
    • Membership Fees
    • Join Us
  • Consultancy
    • Professional Services
    • Project Methodology
    • Unlock Your Data
    • Advanced Analytics
  • Resources
    • Big Data Resources
    • Technology Resources
    • Speakers
    • Data Science Jobs Board
    • Member CVs
  • About
    • Contact
    • Data Science Foundation
    • Steering Group
    • Professional Standards
    • Government And Industry
    • Sponsors
    • Supporter
    • Application Form
    • Education
    • Legal Notice
    • Privacy
    • Sitemap
  • Home
  • Information
    • Discussion
    • Articles
    • Whitepapers
    • Use Cases
    • News
    • Contributors
  • Courses
    • Data Science & Analytics
    • Statistics and Related Courses
    • Online Data Science Courses
  • Prodigy
    • Prodigy Login
    • Prodigy Find Out More
    • Prodigy Free Services
    • Prodigy Feedback
    • Prodigy T&Cs
  • Awards
    • Contributors Competition
    • Data Science Writer
  • Membership
    • Individual
    • Organisational
    • University
    • Associate
    • Affiliate
    • Benefits
    • Membership Fees
    • Join Us
  • Consultancy
    • Professional Services
    • Project Methodology
    • Unlock Your Data
    • Advanced Analytics
  • Resources
    • Big Data Resources
    • Technology Resources
    • Speakers
    • Data Science Jobs Board
    • Member CVs
  • About
    • Contact
    • Data Science Foundation
    • Steering Group
    • Professional Standards
    • Government And Industry
    • Sponsors
    • Supporter
    • Application Form
    • Education
    • Legal Notice
    • Privacy
    • Sitemap
  • Subscribe to Newsletter

Open Source Solutions for Building Your Own Storage Area Network and Network Attached Storage

A DSF Whitepaper
21 May 2020
Balakrishnan Subramanian
Author Profile
Other Articles
Follow (91)

Share with your network:

  1. INTRODUCTION

    Generally, Storage solutions can be grouped into following four categories: SoHo NAS systems, Cloud-based/object solutions, Microsoft Storage Server solutions, Enterprise NAS (Networked Attached Storage) and Storage Area Network (SAN) solutions.

    Enterprise NAS and SAN solutions are generally closed systems offered by traditional vendors like EMC and NetApp with a very large price tag, so many businesses are looking at Open Source solutions to meet their needs. This is a collection of links and brief descriptions of Open Source storage solutions currently available.

    Open Source of course means it’s free to use and modify, however some projects have do commercially supported versions as well for enterprise customers who require it.

    1. Factors for choosing Storage Solutions

      When you are in the need of Storage solutions for managing your own infrastructure in your private Data Center, there are many offerings but selecting the right one depends upon your requirement.

      Factors involved in selecting a Storage type

      • Budget
      • Type of Data that you want to store
      • Scaling concerns and
      • Usage pattern

      In this article, we will be discussing two different methods (i.e. NAS and SAN), these two methods define the Structure of the storage, it is important to choose the right one based upon your use case and type of data.

  2. NETWORK ATTACHED STORAGE

    A Network Attached Source (NAS) is a device/server attached to the TCP/IP network, the data stored in this device can be shared. When a file read/write is requested in the form of an Network File system (NFS) or Common Internet File System (CIFS), it is sent to the NAS attached to a TCP/IP server, which on receiving the NFS or CIFS request, converts the request into local storage IO command set.

    1. Features of NAS

      NAS uses File Level Data access. The main I/O protocol of NAS is NFS or CIFS. NAS may appear like a “shared folder” but it is connected by means of Ethernet, this can in some cases exacerbate the execution if the system is being utilized for some different things (which are the typical case) or the network slacks.

      Figure 1: Network Attached Storage with LAN Network (Source: WikiMedia)
       
  3. STORAGE AREA NETWORK

    Storage Area Network (SAN) is a rapid system of storage device and switches associated with the computer systems. SAN works as the result of sharing the pool with multiple servers. Each server can have direct access to the storage. SAN provides centralized storage management. SAN can move information starting with one storage device then onto the next and can share information between different servers, which makes the restoration and backup of information quickly. A productively and legitimately designed SAN encourages both calamity recuperation and high accessibility.

    1. Features of SAN

      SAN uses block level data access. The main I/O protocol of SAN is Small Computer System Interface (SCSI). SAN appears to the computer as its own storage. It is connected by means of Fiber channel which results in excellent speeds and performance.

      Figure 2: Storage Area Network with Network (Source: www.slideshare.net)
       

      Nowadays many organizations and sectors have switched to Software-defined infrastructure which means they have to store large amount of data safe and secure. Many of the organizations were using open source software to meet their requirement in the section of storing data. E.g.: Projects like Hadoop, Ceph, Gluster.

      Home users and small businesses can also use open source storage software to meet their needs of storing data, this software allows them to set up their own NAS or SAN device, which uses industry standard hardware without paying the high prices for buying a dedicated storage equipment. It is also possible to set up a cloud storage which is safe, secured and private, it is affordable too when looking for backup and recovery.

  4. NAS/SAN OPEN SOURCE SOFTWARE
    1. Ceph

      Red Hat's Ceph offers multiprotocols (i.e. unified) objects and block storage capabilities. It is a distributed storage solution that boasts scalability, reliability and excellent performance. Well-known users include Cisco, DreamHost, CERN, Bloomberg, and Deutsche Telekom.

      Operating System: Linux

    2. CryptoNAS

      This project aims to simplify the process of setting up an encrypted fileserver. It comes in a live-CD package or a server package that adds a web front-end.

      Operating System: Linux

    3. ESOS

      Short for Enterprise Storage OS, ESOS is a Linux distribution for setting up a storage array on your own hardware. Commercial support is available.

      Operating System: Linux

    4. FreeNAS

      FreeNAS claims to be the "the World's No.1 storage OS with over 10+ million downloads." It counts the United Nations, the University of Florida, and the Salvation Army, Reuters, Michigan State University, the Department of Homeland Security and many other organizations among its users. It can be installed on nearly any hardware to turn it into a network attached storage (NAS) device. Paid, supported enterprise solutions based on the same technology are available under the TrueNAS brand name.

      Operating System: FreeBSD

    5. NAS4Free

      NAS4Free claims to be “the simplest and fastest way to create a centralized and easily accessible server for all kinds of data”. Its features are Zettabyte File System (ZFS), software RAID (levels 0, 1 or 5) and disk encryption.

      Operating System: FreeBSD

    6. Openfiler

      As a unified storage solution, Openfiler combines the best features of NAS storage and SAN storage. Key features include high availability/failover, block replication and Web-based management. London Metropolitan Police, Bill Me Later, Pratt & Whitney and Motorola are some of the users. A paid commercial version is likewise accessible.

      Operating System: Linux

    7. OpenMediaVault

      OpenMediaVault describes itself as a ”next-generation network attached storage (NAS) solution." Its goal is to give NAS shape home clients or small workplaces. It offers Web based organization support and incorporates programming RAID abilities.

      Operating System: Linux

    8. Turnkey Linux File Server

      The Turnkey Linux Project gives pictures to setting up Linux-based servers for various purposes. It supports SFTP, SMB, NFS, rsync and WebDAV file transfer protocols.

      Operating System: Linux

    9. BUILDING OF OUR OWN SAN AND NAS STORAGE USING FREENAS OPEN SOURCE SOFTWARE

      Boot the machine with the CD/DVD:

    Figure 3: FreeNAS Installer
     

    Select the option 1 Install/Upgrade:

    Figure 4: FreeNAS Stable Console Setup
     

    Select the drive where the Operating System will be installed. We recommend utilizing a Flash drive (8GB) yet you can utilize a Hard Disk as well:

    Figure 5: Choosing of Destination Media
     

    Then root password is specified:

    The installation is very quick, now you can discharge the DVD/CD and reboot:

    Figure 6: Installation Success
     

    Presently FreeNAS is fully operational. The shell educates us of the relegated IP. In our lab network we have an Active Directory Domain Services so we need to design the domain controller as the DNS server. To do as such we should choose choice 6:

    Figure 7: Console Setup
     

    Then specify the DNS domain and the nameserver IP:

    Figure 8: DNS domain and the nameserver IP Specification
     

    Presently it's an ideal opportunity to find the FreeNAS web interface. To get to the web UI utilize the IP address of the machine, determine the root credentials:

    Figure 9: Root Credentials
     

    Then, a quick wizard will be started as follows:

    Figure 10: Initial Wizard setup
     

    Next, Select the default volume and go on:

    Figure 11: Wizard Volume setup
     

    Specify the domain administrator credentials:

    Figure 12: Domain Administrator Credentials
     

    Then, we will see how to create a CIFS (SMB) share in future posts, for now leave the fields empty:

    Figure 13: Choosing of Windows (CIFS)
     

    Presently you can configure FreeNAS to send alarms and notices to an email account and affirm it:

    Figure 14: Configuration of FreeNAS for sending alarms
     

    We have to make the volume where we will put the information. Go to the Storage section and click Volume Manager:

    Figure 15: Identifying Storage
     

    We have 4 disks accessible and a RaidZ setup is the best exchange off between security, storage capacity and performance:

    Figure 16: RaidZ setup
     

    Then volume is ready for use:

    Figure 17: FreeNAS is ready for use
     

    That’s it, we've installed and configured the FreeNAS server.

  5. THE ROAD AHEAD

    As the amount of usage of data is increasing day by day, Storage solutions are more advanced solution which is easy to maintain. When these storage solutions are implemented and maintained properly, they provide the required safety to data. NAS and SAN offers centralized storage, they are very easy to maintain and do not require huge investments for setting up. The above considered open source technologies NAS and SAN paves the way for small business users to securely store their data and move on towards their development in IT world.

Rate this Whitepaper
Rate 1 - 10 by clicking on a star
(35 Ratings) (1 Comments) (7445 Views)
Download

If you found this Whitepaper interesting, why not review the other Whitepapers in our archive.

Login to Comment and Rate

Email a PDF Whitepaper

Comments:

Subrata Chowdhury

25 May 2020 08:54:10 AM

Very good informative and knowledgeable article for the learners to learn and get the ideas of the working of the different types of setup which are been used over here.

Very nice work.

Go to discussion page

Categories

  • Data Science
  • Data Security
  • Analytics
  • Machine Learning
  • Artificial Intelligence
  • Robotics
  • Visualisation
  • Internet of Things
  • People & Leadership Skills
  • Other Topics
  • Top Active Contributors
  • Balakrishnan Subramanian
  • Abhishek Mishra
  • Mayank Tripathi
  • Michael Baron
  • Santosh Kumar
  • Recent Posts
  • AN ADAPTIVE MODEL FOR RUNWAY DETECTION AND LOCALIZATION IN UNMANNED AERIAL VEHICLE
    12 November 2021
  • Deep Learning
    05 November 2021
  • Machine Learning
    05 November 2021
  • Data is a New oil : A step into WSN enabled IoT and security
    26 October 2021
  • Highest Rated Posts
  • Piecewise hazard model for under-five child mortality
  • TOP 10 BEST FREE AND OPEN SOURCE BACKUP SOLUTIONS
  • What have the changes made to primary and secondary assessment frameworks done to the ‘London effect’ in school performance?
  • DEEP LEARNING: FIGHTING COVID-19 WITH NEURAL NETWORKS
  • Graph Analytics and Big Data
To attach files from your computer

    Comment

    You cannot reply to your own comment or question. You can respond to another member's comment in this thread.

    Get in touch

     

    Subscribe to latest Data science Foundation news

    I have read and agree to the Data science Foundation Privacy Policy

    • Home
    • Information
    • Resources
    • Membership
    • Services
    • Legal
    • Privacy
    • Site Map
    • Contact

    © 2022 Data science Foundation. All rights reserved. Data S.F. Limited 09624670

    Site By-Peppersack

    We use cookies

    Cookie Information

    We are using cookies to provide statistics that help us to improve your experience of our site. You can choose to use the site without cookies. However, by continuing to use the site without changing your settings, you are agreeing to our use of cookies.

    Contact Form

    This member is participating in the Prodigy programme. This message will be directed to Prodigy Admin the Prodigy Programme manager. Find out more about Prodigy

    Complete your membership listing and tell others about your interests, experience and qualifications with a Personal Profile page.

    Add a Personal Profile

    Your Personal Profile page is missing information about your experience and qualifications that other members would find interesting. Click here to update.

    Login / Join Us

    Login to your membership account to view your personalised news feed, update your profile, manage your preferences. publish articles and to create a following.

    If you are not a member but work with or have an interest in Data Science, Machine Learning and Artificial Intelligence, join us today.

    Login | Join Us

    Support the work of the Data Science Foundation

    Help to fund our work and enable us to provide free communications and knowledge sharing services to members across the globe.

    Click here to set-up a donation of £30 per year

    Follow

    Login

    Login to follow this member

    Login