cuno

6 ms·

1.
by cuno 9mo ago
This stuff dates way, way before 2004. For non-power of two, just checked our own very old circular byte buffer library code and using the notation from this article, it is: entriesAllocated() { return ((wrPtr-rdPtr+2*bufSize) % (2*bufS
2.
by cuno 1y ago
So after transforming multispectral satellite data into a 128-dimensional embedding vector you can play "Where's Wally" to pinpoint blackberry bushes? I hope they tasted good! I'm guessing you can pretty much pinpoint a
3.
by cuno 2y ago
We ended up overriding and replacing with our own thread-safe version years ago when we also hit this.
4.
by cuno 2y ago
Good to see you too! Lets catchup sometime - tried to connect with you separately but no luck.
5.
by cuno 2y ago
Founder of cunoFS here, brilliant to see lots of activity in this space, and congrats on the launch! As you'll know, there's a whole galaxy of design decisions when building file storage, and as a storage geek it's fun to see
6.
Dynasaur: Userspace syscalls that are super fast(cuno.io)
1 points by cuno 2y ago|1 comments
7.
by cuno 2y ago
Dynasaur intercepts syscalls in Linux entirely in userspace, superfast and across static, semi-static and dynamic binaries. It even works inside containers and doesn't need admin or any special privileges like PTRACE, or need a VM like
8.
by cuno 2y ago
Yes Bali was the next gen architecture and incredibly scalable. It consisted of many different chips connected together in a network that could scale. The R chip was so big existing tools couldn't handle it and ppl were writing their o
9.
by cuno 2y ago
Nintendo wasn't loyal to the company it was loyal to the team, so when they just decided to leave and form ArtX they took the customer with them... SGI was happy with the Nintendo contract. They earned $1 in additional royalties for ev
10.
by cuno 2y ago
I worked at SGI on the next generation (code named Bali) in 1998 (whole year as an intern) and 1999 (part time while finishing my degree, flying back and forth from Australia). Bali was revolutionary. The goal was realtime Renderman and it
11.
by cuno 3y ago
Sorry for the late response - I didn't see your comment until now. Our aim is to unleash all the potential that S3/Object has to offer for file system workloads. Yes, the scale of AWS S3 helps, as does erasure coding (which enhanc
12.
by cuno 3y ago
The problem with these approaches is that the data is scrambled on the backend, so you can't access the files directly from S3 anymore. Instead you need an S3 gateway to convert from scrambled S3 to unscrambled S3. They rely on a separ
13.
by cuno 3y ago
IOPS is a really lazy benchmark that we believe can greatly diverge from most real life workloads, except for truly random I/O in applications such as databases. For example, in Machine Learning, training usually consists of taking lar
14.
by cuno 3y ago
It depends on if you want to expose filesystem semantics or metadata to applications using it. For example random access writes are done by ffmpeg, which is a workhorse of the media industry, but most things can't handle that or are to
15.
by cuno 3y ago
For example, you can do separate parallel ListObjectV2 for files starting a-f and g-k, etc.. covering the whole key space. You can parallelize recursively based on what is found in the first 1000 entries so that it matches the statistics of
16.
by cuno 3y ago
For AWS, we're comparing against filesystems in the datacenter - so EBS, EFS and FSx Lustre. Compared to these, you can see in the graphs where S3 is much faster for workloads with big files and small files: https://cuno.io&
17.
by cuno 3y ago
Actually we've found it's often much worse than that. Code written against AWS S3 using the AWS SDK often doesn't work on a great many "S3-compatible" vendors (including on-prem versions). Although there's docu
18.
by cuno 3y ago
We and our customers use S3 as a POSIX filesystem, and we generally find it faster than a local filesystem for many benchmarks. For listing directories we find it faster than Lustre (a real high performance filesystem). Our approach is to f
19.
by cuno 3y ago
We've spent a lot of time identifying bottlenecks and fixing them, up and down the stack, with FUSE being just one of them, even the AWS SDK itself introduces its own set that we've addressed. cunoFS can also be used with FUSE, an
20.
Show HN: cunoFS – mount S3/AZ/GCP storage *without* FUSE, 60x faster than s3fs(cuno.io)
19 points by cuno 3y ago|4 comments
21.
The Cloud Under the Sea [interactive / the geopolitics of undersea cables](abc.net.au)
2 points by cuno 3y ago|0 comments
22.
The miracle of modern chip manufacturing (visual)(ig.ft.com)
5 points by cuno 3y ago|1 comments
23.
by cuno 3y ago
This is a nice simple visual guide to chip fabrication, chiplets, and the advantage of back-side power.
24.
by cuno 3y ago
Funnily enough I published something similar as part of my PhD (2010). Essentially communication costs dominate over computation costs - an addition operation is practically free compared to the time and energy of moving data within a chip
25.
by cuno 3y ago
Hi sorry I missed this. Yes, you can run Samba for SMB, and Ganesha for NFSv4. Feel free to email us if you think there's a better way though.
26.
by cuno 3y ago
Hi author here, sorry I missed this post. The performance benchmarks and cost comparisons are for comparing S3 vs EBS (ext4 formatted), EFS, FSx Lustre and others within the same datacenter (i.e. LAN use case rather than WAN use case). That
27.
by cuno 3y ago
Hi, author here. Yes agree that you can't "just" put a POSIX API on S3, but that doesn't make it impossible. For the sake of keeping the article to a reasonable size, I left a lot of things out. There are tradeoffs that
28.
by cuno 3y ago
Depends on what you mean by metadata. MP4 metadata is data inside the file - and is modified by server-side-copy semantics that replaces only the bits that are changed. If you mean POSIX metadata, we avoid storing that in the object, and fo
29.
by cuno 3y ago
Hi, author here. Funny you should give the stream-encoding MP4 example, because yes that is what people's experience has been for S3. We've solved that - no temporary local file needed - all streamed directly to S3, for example us
30.
by cuno 3y ago
Hi, author here. Yes we have many large companies (Fortune Global 500) down to small organisations using our software with this kind of interception (see for example https://cuno.io/about-us/ ). It took us a decent size

More ›