11 ms·
First you run a program (training framework) to generate a database of values. Then you run a program (inference engine) which performs calculations against the
by applfanboysbgon 5d ago
First you run a program (training framework) to generate a database of values.
Then you run a program (inference engine) which performs calculations against the database of values.
To put it in ELI5 terms: run a program against a book, counting how many times "I love <x>" appears in the book. Note "dogs" 4 times, "cats" 5 times, "you" 1 time into a database. Then run a program against that database. When inputting "I love" as the preceding text, the second program determines the most likely result is "cats" and returns "I love cats" (or returns "I love cats" 50% of the time, or dogs 40% of the time, or you 10% of the time, or some variation by different methods of weighting).
Yes, this is an extreme simplification. Yes, the model is not technically a database either. But this is fundamentally the process followed. You would consider it a single program if the training framework and inference engine were part of the same software and stored the computed training values to memory instead of disk, taking an input dataset and an input context as params and returning "I love cats" as the output. There's all kinds of incredibly sophisticated techniques applied on top of this foundation to vastly improve the statistical modeling and efficiency, but the underlying basics have not fundamentally changed.
> Then you follow it up with print statements as if that is a good analogy.
The print statements were not an analogy. They were pointing out the ridiculousness of doubting whether software is conscious because it generated self-referential text. Gettting software to generate self-referential text is as easy as `print(self_referential_text)`. So the only question is how the self-referential text is generated. For self-referential text generation to be more interesting than passing it as a literal print value, there would have to be some really wondrous "how" going on. But, it turns out, the "how" of an inference engine isn't that much more interesting than literally doing a `print`.