There are several other systems I would recommend before TernFS for your environment. If you're looking at Lustre versus this in particular, Lustre has been through the wringer, and ANL/DOE has plenty of people who understand it enough to run it well and fix it when it breaks.
However, you are right. Your bandwidth needs don't really require Lustre.
Seriously man, I'm asking because I don't know: which filesystems do you recommend instead? I dabbled in CephFS because our data is write-once, but helping computer illiterate research scientists at other universities and national labs retrieve their data is a lot simpler from Lustre because it's just plain-old POSIX filesystem semantics.
I'm not joking, I didn't ask this as a way to namedrop my experience and credentials (common 'round this neck o' the woods), I honestly don't know what all the much more competent organizations are doing and would really like to find out.
It's a serious requirements-gathering exercise. I would look inside your organization for HPC storage experts and ask them to sit down with you for an hour to walk through your users' typical workflows, expectations, and budget. If you need some names, send me an email.
Or just shell out for as much Weka as they can convince you that you need and call it a day.
I read somewhere that Hacker News should have been named Startup News, and sometimes interactions like the one upthread reminds me of that. I'm not saying it's wrong - if you're good at something don't do it for free and all that - but it's kinda sad that in-depth discussions on public forums are getting harder and harder to find these days.
Normal conversations by topic enthusiasts usually have fun stuff hidden in their profiles and at times lead to fun rabbit holes where you endlessly learn and somehow, forgot that you were initially browsing HN.
Agree about the public discussion part, one of the reasons why I'm here lately.
Also, why can't someone create Startup News: Where every article reply is an opportunity to be sold a service, SN would take a cut of transactions. /s
These are people already trying to divert the discussion off-site for their benefit. Very few would honestly report any resulting transaction for the cut to be taken from.
[yeah, it did see the sarcasm tag, just clarifying to put off would be entrepreneurs so we aren't inundated by show-hn posts from people vibe-coding the idea over the next few days!]
I saw the follow-up responses complaining about you soliciting, but I've got no problem with you offering to solve a problem and being remunerated for it.
However, my lab is a brokedick operation with barely enough cash reserves to pay staff salaries. We sincerely do not have the budget to buy new software, especially after the NIH funding cuts.
"Legitimate" is relative here. I would count you as using unusual software to hide your actual source address. Not a huge concern because if you're doing that, I assume you also know how to move around to avoid getting blocked.
In fact, the ability to move to a different cloud on short notice is also part of the CAPTCHA, because large cloud-based botnets usually can't. They'd get instabanned if they tried to move their crawling boxes to something like DigitalOcean.
My only issue with OVH is that they wouldn't let me rent a VPS ($30/month?) without sending a copy of my government identification. I'm not willing to distribute copies of that without a good reason, so I ended up paying more elsewhere.
Cheap hosters have problems with people not paying or using the hosting for borderline illegal stuff. Asking ID is a good way to deter that. Not perfect.
EDIT: This comment is wrong, see fsmv’s comment below. Leaving for posterity because I’m no coward!
- - -
Undefined behavior only means that the spec leaves a particular situation undefined and that the compiler implementor can do whatever they want. Every compiler defines undefined behavior, whether it’s documented (or easy to qualify, or deterministic) or not.
It is in poor taste that gcc has had widely used, documented behaviors that are changing, especially in a point release.
I think you're confusing unspecified and undefined behavior. UB could do something randomly different every time and unspecified must chose an option.
In a lot of cases in optimizing compilers they just assume UB doesn't exist. Yes technically the compiler does do something but there's still a big difference between the two.
Nothing specific. Just some more expensive meals, maybe more theater/other entertainment. I'm pretty happy with where I am for hotels (which will chew up additional cash pretty quickly anyway). I don't really have a formal budget for travel as such. I just don't find lounges are a very good value for me these days as they were in the past.
That might be where Intel and AMD failed. With the hindsight watching ARM gobble up a number of sectors, Intel and AMD should have allowed their IP to be customized which may have slowed ARM's advance. Competition is good though. If this continues, AMD and Intel may have to merge. I wonder how RISCV is going to shake things up? Intel and AMD should build RISCV chips and chance ARM. That'll form a nice loop.
Right now RISC-V is ultra slow in all implementations I've seen. Like 30x slower than a top of the line Apple Mx series CPU. Maybe there is a high performing RISC-V chip out there but I haven't yet run into one.
That said, RISC-V is good for embedded applications where raw performance isn't a factor. I think no other markets are yet accessible to RISC-V chips until their performance massively improves.
Google’s AI tool says that 20-25% of the world’s population flies at least three times a year. Not a good source, but at least a surprising statistic if true.
Some hard data says that 12% of US flyers take 66% of flights [1]. Those are all likely very frequent fliers, and is much more than 1%.
At the moment, yes. For a short while, it was very hard to find eggs for less than $5-6 a dozen due to a supply issue. Since then, some egg prices have fallen back to normal. Some egg producers, however, have decided that this new price is just fine for them, so you can still see that price on the shelf.
However, you are right. Your bandwidth needs don't really require Lustre.