isaacfung

5 ms·

1.
by isaacfung 11mo ago
Some models use vector quantized variational autoencoders to discretize images into sequences of discrete symbols from a fixed codebook. https://grok.com/share/bGVnYWN5LWNvcHk%3D_572b4955-6265-4210...
2.
by isaacfung 1y ago
What AI tools have you used recently? Have you verified if they all use models trained on copyrighted material with permission?
3.
by isaacfung 2y ago
Something similar happened to Google Map in Hong Kong recently. A dozen schools had their names changed by some pranksters. It's surprisingly easy. https://www.scmp.com/news/hong-kong/society/article&#x2F
4.
by isaacfung 2y ago
Also this blog post https://yang-song.net/blog/2021/score/
5.
by isaacfung 2y ago
You may find the huggingface course more approachable https://huggingface.co/learn/diffusion-course/en/unit0/1
6.
by isaacfung 2y ago
How do you keep table structure?
7.
by isaacfung 2y ago
It sees embeddings that is trained to encode semantic meanings. The way we tokenize is just a design choice. Character level models(e.g. karpathy's nanoGPT) exist and are used for educational purpose. You can train it to count number o
8.
by isaacfung 2y ago
The text is converted to embeddings after tokenization. The neural networwk only sees vectors. Imagine the original question is posed in English but it is translated to Chinese and then the LLM has to answer the original question based on t
9.
by isaacfung 2y ago
The possibility seems far beyond gaming(given enough computation resources). You can feed it with videos of usage of any software or real world footage recorded by a Go Pro mounted on your shoulder(with body motion measured by some sesnors
10.
by isaacfung 2y ago
When people say "LLMs are not capable of innovation", what exactly do they consider as innovation? If LLMs are not capable of innovation on their own, what if we augment them with means to interact with the environment so they can
11.
by isaacfung 2y ago
bro, it's not just about the money. He's promoting himself, building up a portfolio, learning new skills and entertaining himself.
12.
by isaacfung 2y ago
We have translators. Doesn't mean we can't replace them with a cheaper, more accessible tool. That's the whole point of automation. Reasoning stuff is not useless. They provably(according to benchmarks) improve the performanc
13.
by isaacfung 2y ago
This repo has some less trivial examples. https://github.com/ganarajpr/awesome-dspy You can try STORM(also from Stanford) and see the prompts it generates automatically, it tries to expand on your topic and simulate th
14.
by isaacfung 2y ago
Aside from being used alone, T5 is also used as the text encoder of some recent multimodal models. https://stability.ai/news/stable-diffusion-3-research-paper https://t5tts.github.io/ Related discussio
15.
by isaacfung 2y ago
I don't get why some people seem to think the only way to use a LLM is for next token prediction or AGI has to be bult using LLM alone. You want planning, you can do monte carlo tree search and use LLM to evaluate which node to explore
16.
by isaacfung 2y ago
There's a recently released kungfu movie whose story happened in the Kowloon walled city. The government is planning to relocate the movie set to the original address for exhibition. https://www.youtube.com/watch?v=5uZm
17.
by isaacfung 2y ago
Maybe it's easier to understand in the format of annotated code https://nlp.seas.harvard.edu/2018/04/03/attention.html
18.
by isaacfung 2y ago
There are way more text training data than voice data. It also allows you to use all the benchmarks and tool integrations that have already been developed for LLMs.
19.
by isaacfung 2y ago
How do I know if it is the original "Where's Waldo" under the paper?
20.
by isaacfung 2y ago
Some "agents" like the minecraft bot Voyager( https://github.com/MineDojo/Voyager ) have a control loop, they are given a high level task and then they use LLM to decide what actions to take, then evaluate the
21.
by isaacfung 2y ago
I am not sure what you mean by "turn these one-shot APIs into Markov chains." To me, langchain was mostly marketed as a framework that makes RAG easy by providing integration with all kinds of data sources(vector db, pdf, sql db,
22.
by isaacfung 2y ago
The current gen llms tokenize numbers digit by digit unlike earlier llms.
23.
by isaacfung 2y ago
I recommend reading https://github.com/bkitano/llama-from-scratch over the article op linked. It actually teaches you how to build llama iteratively, test, debug and interpret the training loss rather than just desribi
24.
by isaacfung 2y ago
Write a chrome extension that prompts a LLM/uses a custom trained (BERT based) text classification model to filter the posts. https://github.com/thomasj02/AiFilter https://github.com/GoogleChrome&#
25.
by isaacfung 2y ago
There is an upcoming Mech movie Atlas, starring Jennifer Lopez with a heavy Titanfall vibe.
26.
by isaacfung 3y ago
Open source would also mean it is available to sanctioned countries like china.
27.
by isaacfung 3y ago
These may be useful https://github.com/ggerganov/llama.cpp/blob/master/grammars https://github.com/guidance-ai/guidance?tab=readme-ov-file#c... https://github.com/et
28.
by isaacfung 3y ago
It may provide a way for AI to learn a complete new topic(a new programming language, stock investment, sport, games) in a zero shot way and immediately apply it by just feeding a youtube playlist/udemy course into an AI model.
29.
by isaacfung 3y ago
There are lots of video content with audio. We can train a facial expression classification model to detect the speaker's emotion(we can also use a multimodal model to take in consideration of the language context). Another potential s
30.
by isaacfung 3y ago
It seems we can add antagonistic AI to correct many kinds of undesirable human behaviors Browser extension that monitors how much time I have wasted on social media/porn Browser extension that reminds me when I made a comment without r

More ›