Networking Forums

Networking Forums > Computer Networking > Linux Networking > Network Distributed File System

Reply
Thread Tools Display Modes

Network Distributed File System

 
 
andrei.stoian@gmail.com
Guest
Posts: n/a

 
      11-02-2006, 05:36 PM
Hello,

I am trying to find a solution for distributing the storage of large
amounts of data in our network.

We operate a file distribution system based on bittorrent and we host
all the files on the network which require quite a lot of storage. Our
file serving network is comprised of several old computers (low
performance but high storage space) which run apache and use webseeding
to send the files. We do not plan to use a high performance central
storage solution because of costs and because we want to keep our
network as flexible as possible by seamlessly adding and removing
machines.

So I am looking for some kind of system (maybe a filesystem, or some
clustering software) which allows multiple directories on the network
(I'm guessing access will be through NFS) to be available as a single
directory. In this 'virtual directory' files added will be
automatically placed by the system onto a machine with the most
available drive space, and, of course, files could be deleted. Also
files could be accessed by any machine in the network. Another feature
would be adding and removing machines easily, just by changing a config
file, possibly on the fly (without restarting any deamons)

I imagine a possible configuration to be something like this:

- List of network directories making up the 'virtual dir':
/mnt/machine1, /mnt/machine2, ... where these directories are mounted
through nfs.
- Virtual dir: /mnt/storage
- Apache running and serving files from /mnt/storage
- Dns load balancing forwarding requests to one of the machines so
calls to download storage.mydomain.com/myfile.dat could be downloaded
from an outside machine.

Am I looking for trouble and using a central storage system would be
more efficient? If so, why?

Andrei Stoian

 
Reply With Quote
 
 
 
 
Tore Skogly
Guest
Posts: n/a

 
      11-02-2006, 06:43 PM
(E-Mail Removed) wrote:

> Am I looking for trouble and using a central storage system would be
> more efficient? If so, why?


What amount of storage space do you require?
You can do exactly the same with a single computer, several large SATA
drives and, if required, multiple NICs to increase network performance.
It would be a low cost solution, and by using LVM you can add more hard
drives later if required.

--
Regards,
ToreS
 
Reply With Quote
 
andrei.stoian@gmail.com
Guest
Posts: n/a

 
      11-03-2006, 11:55 AM

Tore Skogly wrote:
> (E-Mail Removed) wrote:
>
> > Am I looking for trouble and using a central storage system would be
> > more efficient? If so, why?

>
> What amount of storage space do you require?
> You can do exactly the same with a single computer, several large SATA
> drives and, if required, multiple NICs to increase network performance.
> It would be a low cost solution, and by using LVM you can add more hard
> drives later if required.
>
> --
> Regards,
> ToreS


I'm guessing we would grow to about 5-7TB in quite a short time so I
want a solution that scales well.

 
Reply With Quote
 
 
 
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Installing services for Network File System JJP Windows Networking 0 05-17-2010 04:13 PM
Network File System Not Based on Microsoft Networking? Will Windows Networking 0 07-31-2006 06:00 AM
Distributed File Service and Home Folders =?Utf-8?B?SmFjaw==?= Windows Networking 0 10-29-2004 09:05 PM
Distributed Laptop Network Michael Windows Networking 5 09-09-2004 03:11 PM
Network file system like NFS but with login/pass ? sebmil Linux Networking 2 03-05-2004 03:53 AM



1 2 3 4 5 6 7 8 9 10 11