Tjyylli

Did Mueller's report provide an evidentiary basis for the claim of Russian govt election interference via social media?

How do I find out the mythology and history of my Fortress?

Lagrange four-squares theorem --- deterministic complexity

How could we fake a moon landing now?

Random body shuffle every night—can we still function?

Would it be easier to apply for a UK visa if there is a host family to sponsor for you in going there?

Maximum summed subsequences with non-adjacent items

How can I set the aperture on my DSLR when it's attached to a telescope instead of a lens?

1-probability to calculate two events in a row

Getting prompted for verification code but where do I put it in?

Girl Hackers - Logic Puzzle

The Nth Gryphon Number

How much damage would a cupful of neutron star matter do to the Earth?

Why weren't discrete x86 CPUs ever used in game hardware?

If Windows 7 doesn't support WSL, then what is "Subsystem for UNIX-based Applications"?

How to run automated tests after each commit?

Sum letters are not two different

Do wooden building fires get hotter than 600°C?

Is there hard evidence that the grant peer review system performs significantly better than random?

Antipodal Land Area Calculation

Crossing US/Canada Border for less than 24 hours

Do I really need to have a message in a novel to appeal to readers?

How did Fremen produce and carry enough thumpers to use Sandworms as de facto Ubers?

Can a sorcerer use careful spell on himself?

Sharing filesystem between linux hosts?

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}

2

I'm running a website that uses user-uploaded files heavily. Those files are served to users only after a permission check by a Django application.

Now I need to scale horizontally and spin up another instance of a web server. It needs to have access to the same directory structure that contains uploaded files. What I likely need is some distributed filesystem.

I've been thinking about:

1. 
   NFS — done that 15 years ago and even then I felt that standard was quite outdated. Although robust and easy to set up, the lack of transfer encryption and the need of syncing UIDs/GIDs between servers creates more problems than it solves.


2. periodic rsync — sounds like a dirty hack and would probably lead to out-of-sync problems. And take N times the storage size for N servers.


3. 
   sshfs — well, if it has the same performance as scp, I don't want to hear about it actually.


4. 
   LustreFS , Gluster, or other DFS — never used those and have no idea which would suit my needs. Redundancy is not critical (we have frequent backups) but I'd like to have the traffic between servers encrypted.

What would you recommend?

linux filesystems file-sharing

share|improve this question

edited 6 hours ago

Michał Sałaban

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Re: NFS encryption - have you considered using a VPN between the nodes? If you don't want to go as heavy as an IPSec VPN, WireGuard would be a good alternative that may meet your performance needs.
  
  – AfroThundr
  5 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks, @AfroThundr I'm reading about tinc Do you know how they compare?
  
  – Michał Sałaban
  5 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I've never used Tinc personally, but from several other discussions on HackerNews, it would seem that Tinc also incorporates a mesh networking and self-healing capability, but lags behind WireGuard in straight performance. They're both still fairly lightweight though, compared to Strongswan or OpenVPN.
  
  – AfroThundr
  5 hours ago
  
  
  

  
  
  
  

add a comment | 

2

I'm running a website that uses user-uploaded files heavily. Those files are served to users only after a permission check by a Django application.

Now I need to scale horizontally and spin up another instance of a web server. It needs to have access to the same directory structure that contains uploaded files. What I likely need is some distributed filesystem.

I've been thinking about:

1. 
   NFS — done that 15 years ago and even then I felt that standard was quite outdated. Although robust and easy to set up, the lack of transfer encryption and the need of syncing UIDs/GIDs between servers creates more problems than it solves.


2. periodic rsync — sounds like a dirty hack and would probably lead to out-of-sync problems. And take N times the storage size for N servers.


3. 
   sshfs — well, if it has the same performance as scp, I don't want to hear about it actually.


4. 
   LustreFS , Gluster, or other DFS — never used those and have no idea which would suit my needs. Redundancy is not critical (we have frequent backups) but I'd like to have the traffic between servers encrypted.

What would you recommend?

linux filesystems file-sharing

share|improve this question

edited 6 hours ago

Michał Sałaban

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Re: NFS encryption - have you considered using a VPN between the nodes? If you don't want to go as heavy as an IPSec VPN, WireGuard would be a good alternative that may meet your performance needs.
  
  – AfroThundr
  5 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Thanks, @AfroThundr I'm reading about tinc Do you know how they compare?
  
  – Michał Sałaban
  5 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I've never used Tinc personally, but from several other discussions on HackerNews, it would seem that Tinc also incorporates a mesh networking and self-healing capability, but lags behind WireGuard in straight performance. They're both still fairly lightweight though, compared to Strongswan or OpenVPN.
  
  – AfroThundr
  5 hours ago
  
  
  

  
  
  
  

add a comment | 

I'm running a website that uses user-uploaded files heavily. Those files are served to users only after a permission check by a Django application.

Now I need to scale horizontally and spin up another instance of a web server. It needs to have access to the same directory structure that contains uploaded files. What I likely need is some distributed filesystem.

I've been thinking about:

1. 
   NFS — done that 15 years ago and even then I felt that standard was quite outdated. Although robust and easy to set up, the lack of transfer encryption and the need of syncing UIDs/GIDs between servers creates more problems than it solves.


2. periodic rsync — sounds like a dirty hack and would probably lead to out-of-sync problems. And take N times the storage size for N servers.


3. 
   sshfs — well, if it has the same performance as scp, I don't want to hear about it actually.


4. 
   LustreFS , Gluster, or other DFS — never used those and have no idea which would suit my needs. Redundancy is not critical (we have frequent backups) but I'd like to have the traffic between servers encrypted.

What would you recommend?

linux filesystems file-sharing

share|improve this question

edited 6 hours ago

Michał Sałaban

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this question

edited 6 hours ago

Michał Sałaban

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this question

edited 6 hours ago

Michał Sałaban

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

asked 7 hours ago

Michał SałabanMichał Sałaban

1112

New contributor

Michał Sałaban is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

asked 7 hours ago

Michał SałabanMichał Sałaban

1112