Ask HN: How do you store customer-supplied (POC) data?

1 points by quizotic 10y ago ↗ HN

How would you handle/store customer-supplied data and/or code for a POC? Store it in git? It would be nice to have version control to know what arrived when and what changed when. What if it's a LOT of data (TBs). Store it in an S3 bucket or a DropBox?

We'd like something that gives our employees shared access, version control, is relatively inexpensive, is reliable, etc.

1 comment

[ 4.4 ms ] story [ 12.3 ms ] thread

rcownie 10y ago ↗

I think (though not from first-hand experience) there may be some ugliness in keeping large binary data in git ?

If the data is reasonably small, then I would pick S3 (or some other redundant cloud object-storage) as an easy and disaster-proof solution.

If it gets big, then access bandwidth and latency and cost may all be a problem. Maybe a master copy in S3, and a copy on hard disk of some machine near the benchmark system ?