7 ms·
DAWN: Tools for AI and Data Product Development
- cl42 9y agoThis is great. In some ways it reminds me of the recent "Software 2.0" posts around here -- make the code and architecting so easy that we begin teaching machines by creating data rather than writing code.
- cscurmudgeon 9y agoA lot of research has been done in that direction. http://www.inductive-programming.org http://www.inductive-programming.org
- haZard_OS 9y agoI always thought the Wolfram language was a good step toward "Software 2.0". It's a shame the language isn't open source.
- pella 9y agosummary(slides): http://dawn.cs.stanford.edu/assets/dawn-overview.pdf http://dawn.cs.stanford.edu/assets/dawn-overview.pdf
- hacker_9 9y agoThe link to Snorkel [1] is really interesting, labeling data in a low quality programmatic way, which is then fed through a neural network to produce high quality labels is really smart. [1] https://github.com/HazyResearch/snorkel https://github.com/HazyResearch/snorkel
- myth_drannon 9y agoYes, Snorkel and DeepDive look extremely useful. At my job we have a lot of data but it's unlabeled, it will cost millions of dollars to outsource it to India for labeling/data entry.
- thisisit 9y agoSo anyone using these tools in live/production environment?
- tuomosipola 9y agoWould be interesting to hear any experiences. These researchers have background in Spark etc. so setting up might not be that difficult.
- mateiz 9y agoMatei Zaharia (one of the PIs on DAWN) here. Snorkel, MacroBase and ASAP are already being used in production at several companies, and we intend to continue publishing everything as open source. We only started this lab a year ago, so a lot of the projects listed are still new.
- Vkkan2016 9y agoI am trying to see any sample projects to learn, if its possible pls share
- tuomosipola 9y agoI like many of these ideas, they address real practical problems in the area and new research is always welcome. How this all will be packaged into a working environment is not clear to me but even the individual parts should be useful.
- tabtab 9y agoSeems it has similar goals to the idea behind factor tables: https://github.com/RowColz/AI https://github.com/RowColz/AI
- Houshalter 9y agoI'm pretty sure that guy just reinvented nearest neighbor.
- tabtab 9y agoFinding the "nearest matching pattern" is part of just about ANY pattern matching. The devil-of-the-detail is dealing with noise, precision-loss-for-speed, generalization (compression), tuning, etc. This attempts to break such down into staff-digestible chunks.