Data Archiving

PersistentFS provides unlimited online storage that can be mounted on any Linux computer system.

For data archiving, we recommend increasing the file block size from 256 KB to 16 MB by adding the following settings to the PersistentFS configuration file:

DefaultFileBlockSize = 16777216
CachePageSize = 16777216


After making this changes, we recommended starting with a new file system (--CreateNewFileSystem).

PersistentFS's default file block size is 256 KB. Increasing the file block size will not increase performance, but it will decrease the number of PUT operations that occur when saving data to S3, and correspondingly decrease your Amazon usage charges. For example, writing 100 GB of data with a 16 MB block size requires 6400 PUT's, for a total Amazon S3 request charge of $0.064 ($0.01 per 1000 PUTs). In comparison, writing 100 GB of data with PersistentFS's default 256 KB block size requires 409600 PUTs, for a total Amazon request charge of $4.10.

Note that when transferring 100 GB across the internet, Amazon would also charges $10.00 for bandwidth usage ($0.10 per GB transfered from the internet to S3). The bandwidth charge does not apply for transfer to/from an EC2 instance and S3-USA.