jd20

6 ms·

1.
by jd20 2y ago
I didn't see it mentioned, but why not just use robots.txt? Does Bytespider ignore it?
2.
by jd20 6y ago
I'd really love to see more data on whether ergonomic keyboards actually work. From what I've read, it sounds like the results are mixed: I kind of want to try a split keyboard like the ergodox or Kinesis, but I feel I tend to cr
3.
by jd20 6y ago
One does (it's a southpaw, numeric keypad on the left). A few are TKL (full size keyboard without the numpad). Actually, as a programmer, I pretty much never use the numeric keypad. But when I start seeing smaller layouts with no arrow
4.
by jd20 6y ago
A clarification: these are interviews with people who assemble custom keyboards, I was expecting chats with the people who actually design and produce custom keyboards (like yuktsi, Rama, Wilba, ZealPC, etc...) Still, very cool to see what
5.
by jd20 6y ago
It's possible that wasn't the default setting on Macs back then. I don't know that cgo would be a good choice either, if you're resolving a ton of domains at once. Early versions of Go would create new threads if a gorou
6.
by jd20 6y ago
Trash cans :)
7.
by jd20 6y ago
Nope, you don't really need a database. What you need for fast, scalable web crawling is more like key-value storage: a really fast layer (something like RocksDB on SSD) for metadata about URL's, and another layer that can be very
8.
by jd20 6y ago
Some Apple services were written in C/C++. One downside is it's very hard to source engineers across the company who can then work on that code, or for those engineers to go work on other teams.
9.
by jd20 6y ago
Everything was on 10gigE. The average page size was around 17KB gzipped. Everything's a careful balance between CPU, memory, storage, and message throughput between machines. Apple's corporate network also had incredible bandwidth
10.
by jd20 6y ago
You should check out Manning's "Introduction to Information Retrieval", it has far more detail about web crawler architecture than I can write in a post, and served as a blueprint for much of Applebot's early design deci
11.
by jd20 6y ago
I think WebObjects was supporting Java even before it came to Apple from Next. In the early days, many of Apple's services built with WebObjects even ran on Sun server hardware, and XServe's. But nowadays it's all commodity L
12.
by jd20 6y ago
No idea, it's been years since I last worked on it. It was also not the only Go service written at Apple (90% of cloud services at Apple were written in Java), though it may have been the first one used in production.
13.
by jd20 6y ago
Some fun facts: - Applebot was originally written in Go (and uncovered a user agent bug on redirects, revealing it's Go origins to the world, which Russ Cox fixed the next day). - Up until the release of iOS 9, Applebot ran entirely on
14.
by jd20 6y ago
If Apple Maps has taught us anything, probably not. But Apple would first need to pour an equally large amount of resources into web search, they way it did for Maps.
15.
by jd20 6y ago
Applebot was built for crawling web pages, to be used for search results in Spotlight and Siri. That user agent might also be used for attachment previews, but the original intent of Applebot was for search indexing.
16.
by jd20 6y ago
Apple built their own search engine over 5 years ago, under the Siri / Spotlight umbrella. When people talk about Apple building their own search engine, they generally seem to expect a website dedicated primarily to web page results,
17.
by jd20 8y ago
Thanks for clarifying, I figured I was generalizing it a bit.
18.
by jd20 8y ago
> The phone boots into an operating system known as “Switchboard,” which has a no-nonsense black background and is intended for testing different functionalities on the phone. I think the article confuses the meaning of "dev-fused&q
19.
by jd20 8y ago
I've found the same to be true for Uber Eats. If my order is wrong, they give a full refund no questions asked (and a meal is typically $20-25). And orders get messed up a lot (maybe 1 out of 5). Even something as small as missing ketc
20.
by jd20 8y ago
Made me wonder how likely it was that "Funded by YC" was one of the criteria used by the analyst to come up with the list.
21.
by jd20 8y ago
Would also love to hear more about how this is done... I'm in the process of setting up Stripe subscriptions on a website, but have been scratching my head over the best way to accomplish everything without setting up my own back-end s
22.
by jd20 8y ago
One unfortunate side effect of being at a FAANG company is that most of your best work is probably proprietary and you will never have the chance to show it to anyone outside the company, nor will you have much free time for personal projec
23.
by jd20 8y ago
Not sure why it's not possible, though I could've had a defective unit. Specifically, I had a Fiio D3 ($20) which had bad background noise, even when not playing. I always assumed it was a power supply or shielding issue. The audi
24.
by jd20 8y ago
There's a sharp curve of diminishing returns, for DAC's especially. The super cheap units you find for like $10-20 will usually have serious shielding / noise issues, which is immediately apparent upon listening. Beyond $100-
25.
by jd20 8y ago
It's not a new idea, really. I remember seeing Nagra come out with a battery-powered preamp for home stereos, many years ago (and I think they still make them). I also remember hearing back in the day of some audiophiles powering their
26.
by jd20 8y ago
Looks cool! The problem of enumerating the best routes between two given airports is indeed an interesting problem. My favorite discussion of the problem is from Carl de Marcken: http://www.ai.mit.edu/courses/6.034f&#x2
27.
by jd20 8y ago
I'm surprised Ryanair is supported, given that they've been engaged in a long and nasty lawsuit with Expedia, over scraping their fares. I was under the impression Ryanair only wanted to sell fares through their own website.
28.
by jd20 8y ago
Kind of OT, but I agree phosphate pollution's a big problem and there's a lot of measures people can take to wash their cars responsibly. I've switched to just a bucket and low-flow pressure washer, which uses about 30x less
29.
by jd20 8y ago
Driving through Cupertino neighborhoods, I've seen several homes with not one, not two, but three(!) Tesla's in their driveway. When I wash my Model S in the driveway, people walking by will often come up to tell me how much they
30.
by jd20 8y ago
Same here. It seems to check all the authors needs, other than being constantly updated.... But then, if it's not broke, not sure what need there is to keep pushing updates?

More ›