10 ms·
The Rise and Fall of Thinking Machines (1995)
- sokoloff 13y agoThanks for posting. Really enjoyed the historical read... I wish I'd known the backstory of the antique fire engine that I'd periodically see driving around the Lechmere area (back when Lechmere was still "a thing" :) )
- kken 13y ago>Hillis is what good scientists call a very bright guy -- creative, imaginative, but not quite a genius. What an odd classification.
- ScottBurson 13y agoThat's my assessment too. When I learned about the CM, I thought it was crazy. How could a SIMD machine work for AI? Intelligence emerges from the interaction and integration of multiple, somewhat independent "agents" -- not really the right word but I can't think of a better one. This is Marvin Minsky's own theory, to which I happen to subscribe, but even if I didn't or even if you don't, I still can't understand how Marvin got sucked into this (except that Danny was engaged to his daughter Margaret). The key point is how SIMD machines handle conditionals. The conditional "branch" is emitted, and those processors on which the test fails simply don't execute the next n instructions. This means that for a complex conditional that's rarely satisfied, only one or two processors out of the tens of thousands the machine might be built with would actually be executing. This is why you wouldn't run a compiler, for example, on a SIMD machine: most of the time, most of the machine would be idle. Anyway, I wasn't involved in TMC, though I knew people who were. Nobody asked my opinion, nor would they likely have given it much weight if they had (I'm sure there were skeptics with much better credentials than mine who also were not listened to). But I was right. As I once heard someone else comment, the CM turned out to be useful for approximately the complement of the set of problems that it was intended for. It wound up being pretty good for number crunching, at least for a while until better things emerged, but useless for AI.
- e12e 13y ago> How could a SIMD machine work for AI? I guess it depends on how you define AI, from the excellent article linked above: http://longnow.org/essays/richard-feynman-connection-machine/ http://longnow.org/essays/richard-feynman-connection-machine... "Part Two of Feynman's "Let's Get Organized" campaign was that we should begin a regular seminar series of invited speakers who might have interesting things to do with our machine. Richard's idea was that we should concentrate on people with new applications, because they would be less conservative about what kind of computer they would use. For our first seminar he invited John Hopfield, a friend of his from CalTech, to give us a talk on his scheme for building neural networks. In 1983, studying neural networks was about as fashionable as studying ESP, so some people considered John Hopfield a little bit crazy. Richard was certain he would fit right in at Thinking Machines Corporation. What Hopfield had invented was a way of constructing an [associative memory], a device for remembering patterns. To use an associative memory, one trains it on a series of patterns, such as pictures of the letters of the alphabet. Later, when the memory is shown a new pattern it is able to recall a similar pattern that it has seen in the past. A new picture of the letter "A" will "remind" the memory of another "A" that it has seen previously. Hopfield had figured out how such a memory could be built from devices that were similar to biological neurons. Not only did Hopfield's method seem to work, but it seemed to work well on the Connection Machine. Feynman figured out the details of how to use one processor to simulate each of Hopfield's neurons, with the strength of the connections represented as numbers in the processors' memory. Because of the parallel nature of Hopfield's algorithm, all of the processors could be used concurrently with 100\% efficiency, so the Connection Machine would be hundreds of times faster than any conventional computer." edit: This made me wonder how Moore's greenarray forth computers might be used for neural nets...
- ScottBurson 13y agoOkay, fair enough, neural nets (often called "connectionist AI") might have been the one kind of AI that involved enough number crunching that the CM was a favorable choice for running it. But if you wanted to do, say, genetic evolution of your neural net topology -- not sure that had been thought of then, but people do it now -- the CM wouldn't have worked very well. Anyway, if my rather faint recollection is accurate, the hot application I heard TMC people talking about the most back then was ray tracing.
- pge 13y agoAn entertaining article by Hillis about Richard Feynman's involvement in Thinking Machines: http://longnow.org/essays/richard-feynman-connection-machine/ http://longnow.org/essays/richard-feynman-connection-machine...
- elteto 13y agoYou beat me to the punch, came here to post exactly this. A very entertaining story and I couldn't stop laughing when they sent Feynman to get office supplies (!!!) because they didn't quite know what to with him.
- deleted 13y ago[deleted]
- skorgu 13y ago"Hillis envisioned his machine eventually becoming a sort of public-intelligence utility into which people would tap their home PCs, thereby bringing artificial intelligence to the world." Jesus can you imagine AT&T as an AI? Shudder.
- IvyMike 13y agoIsn't that a description of Google?
- greenyoda 13y agoNot really, since Google doesn't do anything related to AI (OK, maybe self-driving cars, but that's not part of their public internet services). IBM's Watson might turn into a public AI utility, however.
- IvyMike 13y agoI once typed "That thing where a boat is replaced one part at a time" and Google came back with the right answer. If that's not AI I have no idea what is. (And if you don't think that Hillis envisioned his AI doing things like "answers random questions" and "translating between human languages", what do you think he had in mind?)
- greenyoda 13y agoMy guess is that Google's search algorithm has no idea what a "boat" is, and that it just has some clever algorithm that matched your query against some words in one of its indexed documents. That doesn't sound like it would qualify as AI. An AI program would have some kind of knowledge representation[1] and inference engine that would allow it to reason about boats. If your query was "that thing where a boat gives birth to a tree", it could tell you your query didn't make sense, as opposed to just returning nothing relevant. By the way, when I tried my nonsensical query on Google, the first result was about a Syrian woman giving birth on a boat. So Google doesn't even understand the basics of grammar, let alone that a boat is an inanimate object that can't give birth to anything. That doesn't sound like "intelligence" to me. There were AI programs in the 1980s that could do better than that. [1] https://en.wikipedia.org/wiki/Artificial_intelligence https://en.wikipedia.org/wiki/Artificial_intelligence
- JPKab 13y agoThe guys from Thinking Machines (at least quite a few of them) ended up starting a very weird enterprise software company called Ab Initio. They're an odd company who doesn't even get included in Gartner surveys because they won't release any information about their product. The only reason they get any business is because they participate in "bake-offs" with big companies like international banks and blow the competition (IBM, MS, Oracle, etc) away with fully scalable Proof of Concepts. I work with Ab Initio software sometimes, and its weird and annoyingly "enterprisey", but due to the parallel computing background of the guys who started Ab Initio, the software was capable of scaling up storage and processing long before anyone came up with Hadoop. Obviously its extremely closed-source stuff with a proprietary language used to configure it. I hate enterprise software companies, but Ab Initio is certainly pretty cool compared to the other ones, and the people I meet there who are old Thinking Machines guys are super brilliant and interesting. Another interesting point: the author of this article is Gary Taubes, who is the metascience guy who got big into low carb, high fat diets and the science that supports them.
- rst 13y agoA whole lot of TMC alumni also wound up at Sun Microsystems. These included Guy Steele, Greg Papadapoulos (for a time, Sun's CTO), John Rose (a major JVM developer), Lew Tucker (who was running their cloud computing division for a while), and a whole lot of hardware engineers who were key in a bunch of different capacities.
- ScottBurson 13y agoAlso, Brewster Kahle, founder of the Internet Archive, is a TMC alumnus.
- i386 13y agoThey may not be as sexy as your next Snapchat/Uber/X for Y clone but enterprise software companies really do make the world go round.
- milhous 13y agoI always loved their motto: "We're building a machine that will be proud of us."
- ColinWright 13y agoOK, now I get the complaints about https://hn.algolia.io https://hn.algolia.io that I was reading earlier. First glance it's absolutely terrible. I have no idea if it will get better if I persevere, but I've just tried searching for things that have "rise" and "thinking" in the title so I could review the discussions from the past gazzilions of times this has been posted. Nightmare. Absolute nightmare. I really, really hope they take on board the feedback they've had, because this is horrible. I hate to be so negative. Maybe it'll grow on me, although I feel seriously disinclined to make the effort. Added in edit: I can't even work out how to use the search function to find that discussion. Eurgh. Added in further edit: OK, now found it, but I'm reluctant to say anything more as my impressions are so unremittingly negative. I hope you guys have thick skins and serious programming ability to make it usable quickly. For now, there's no way I'll be using it, so the search box is now useless. Bookmarking HNSearch. Final edit: OK, I'm surprised, this has only been submitted on five previous occasions under this title. I thought it was more.
- redox_ 13y agoAll feedback are read and welcome :) We've already deployed a few UX improvements and are currently working on improving the usability. We'll deploy it soon, preview available here: https://hn.algolia.com/beta https://hn.algolia.com/beta.
- ihnorton 13y agoA couple requests: 1. sort by date. this is very useful to find discussions which have dropped off the front page but might still have interesting updates. 2. verbatim search (right now "algolia" -> "algorithm") 3. fix the fact that this thread doesn't show up when I search for "algolia" with [last 24h] checked.
- redox_ 13y ago1. Sorting by date and not by points often produces ugly results (especially on long period) so we introduced the "last 24", "past week" and "past month" options filtering the resultset but keeping the default ranking. Would love to have more feedback about it, because even it's different than before, we think it fits quite well. 2. verbatim search is something we do not provide yet, I opened a feature-request our side :) 3. Have you check [All] or [Comment] instead of default [Story]? (I've just updated hn.algolia.com with last ranking/design tweaks)
- f2f 13y agothis is the fat-tree connection diagram for one of the cabinets of a CM-5. it was posted on a wall at one of the national labs in the US which had the pleasure of working with a CM-5 around the time War Games was in theatres. People still gushed about how nice that machine was to program 10-15 years later. SyCortex tried to do something similar with their computers, unfortunately they failed and with them the last interesting connector architecture... http://i.imgur.com/jHtf4QB.jpg http://i.imgur.com/jHtf4QB.jpg
- smoyer 13y agoInteresting that nCube [1] was also mentioned in the article. I remember HRB Systems (here in State College PA - and later part of E-Systems, now Raytheon) bought nCube computers that were based on the HyperCube architecture. I was at C-COR in 2005 when we purchased nCube from Larry Ellison's holding company and added their VOD servers to our product family. Now that C-COR has been merged into ARRIS, the legacy of nCube lives on in that company's VOD/IA servers [2]. [1] http://en.wikipedia.org/wiki/NCUBE http://en.wikipedia.org/wiki/NCUBE [2] http://www.arrisi.com/products/product.asp?id=17 http://www.arrisi.com/products/product.asp?id=17
- chiph 13y agoWhat were the compute cells like in the Connection Machine? The article uses the phrase "single-bit processor", but that doesn't sound all that useful - you'd want something with at least a little memory and a decent instruction set. Too small a cell and it runs out of work and spends most of it's time waiting on the network. Too big and you'll run into packaging problems.
- rst 13y agoThe processors on the CM-1 were indeed bit-serial, with 16 of these per processor chip. On the CM-2, pairs of 16-processor chips were lashed up with a Weitek FPU and glue circuitry for floating point computation. For the CM-5, processor nodes were Sparc chips with custom vector processors.
- hga 13y agoFrom old memory (of Danny Hillis explaining it in a general seminar, etc.; if they'd had their hiring act together, I would have joined them), the key in the CM-1 is the connections. It was a SIMD machine, a single instruction at a time was transmitted to all the CPUs (one of the reasons a company had to be formed, the top notch analog EEs he had to hire to make it work had salaries higher than an MIT professor's, which just isn't done), and depending on their state they'd do something, or perhaps ignore it. How you laid out your data was key; what I remember of the example he gave, each street intersection was allocated to a CPU. There's of course much better accounts out there, but this might give you a flavor. It's entirely unlike the usual MIMD machines which they and many others built later.
- csense 13y agoThe wikipedia article for the Connection Machine has a link to manuals. The one I'm reading is for the CM-5, so maybe the earlier arches were different, but to me it looks an awful lot like modern GPU's. [1] http://people.csail.mit.edu/bradley/cm5docs/ http://people.csail.mit.edu/bradley/cm5docs/
- abecedarius 13y ago
- hga 13y agoFrom what little I saw, Sheryl Handler indeed had no business skills. My experience was trying to be the 1st or 2nd person to fill a particular job. I had a great interview process (except for Danny, a friend, initially giving me a hard time for not being in school ($$$)) ... and then nothing. So long, that it was more than a month later, when I'd accepted and started another job, that they contacted me to proceed. As I understand it (I knew practically everyone who could do this job), it took them three tries to fill it. The worse story, though, which was well sourced, was that they once contacted an applicant's current workplace to get recommendation info.... In part, I suspect they're another example of "Death by Lethal Reputation" in hiring: http://www.asktheheadhunter.com/halethalrep.htm http://www.asktheheadhunter.com/halethalrep.htm
- look_lookatme 13y agoAnyone have a clear video of the CM-2 LEDs in action? Can't seem to find anything on Youtube. It is a beautiful piece of hardware: http://www.mission-base.com/tamiko/cm/CM-1_500w.gif http://www.mission-base.com/tamiko/cm/CM-1_500w.gif While search I found this awesome post about someone rescuing a panel from a CM-5: http://www.alternet.us.com/?p=1272 http://www.alternet.us.com/?p=1272
- markc 13y agoIf you're ever near Maryland head over to the National Cryptologic Museum where you can see a CM-5 still running. I just saw it a couple days ago.
- badsock 13y agoI'm conflicted about Hillis. On one hand there's stuff like this, and especially his involvement with the Long Now foundation (if you haven't checked out his design for the 10,000 year clock, you really should; clever solutions to engineering challenges that almost no one has ever thought about before): http://longnow.org/clock/ http://longnow.org/clock/ On the other hand he's part of Intellectual Ventures: http://www.intellectualventures.com/inventor-network/senior-inventors/w.-daniel-hillis http://www.intellectualventures.com/inventor-network/senior-...
- caycep 13y agoHow successful are the "neuromorphic chips" (or even GPU's) in doing what TM tried to do?
- juliendorra 13y agoWhen I was a teenager, back in 1993, I played with this this genetic image generator by Karl Sims, running on a Connection Machine with 32768 processor: http://www.karlsims.com/genetic-images.html http://www.karlsims.com/genetic-images.html (At the Pompidou Center, a contemporary art museum). It obviously blew my young mind, with the 16 screens, the ability to select an image as the seed for the new series, the endless playability and the vertigo of not being able to ever go back and find any series again. I don't know if a Cray would have been less or more suited to that kind of interactive installation. But it surely was a incredible feat for the time.