nnechm

7 ms·

1.
by nnechm 1y ago
Had a similar experience with meta. Extremely opaque decision making, terrible UX. Account permanently disabled ... did not follow community standards, literally on sign up to get a dx account. It's difficult after an experience like t
2.
by nnechm 2y ago
Feels more and more like it's the best of times and the worst of times... Things feel off,but you have (mostly well-off) people talking about how great things are going to be and are. I suspect a lot of this correlates to the stock mar
3.
by nnechm 3y ago
Thank you for the advice, will implement accordingly.
4.
by nnechm 3y ago
I am assuming this is on Cofin and not on beatandraise.com, if so, please let me know, I shall fix it. You have 20 chats etc.
5.
by nnechm 3y ago
:) I guess its not very odd to say investment research is a lot of reading and LLMs are already very good at reading. So there is little doubt that LLMs will change the investment research process. Have you used CapitalIQ, do you use it on
6.
by nnechm 3y ago
I don't think excel can be defeated :) I certainly do not expect financial professionals to switch to a chat interface. When you login into capitaliq or factset or look at a bloomberg screen, you access data, you can then do the same h
7.
by nnechm 3y ago
I think you are referring to the more hyped version where somehow LLMs can figure out how to get the most relevant information from 10Ks and do most of the investment process. My mental model is simply that we have an assistant, an amazing
8.
by nnechm 3y ago
Yes, information retrieval is hard :) A lot of people ask for 'can you get Apple's revenues by product category for all of 2020', how do you get the smallest piece of text that has the most information about product category
9.
by nnechm 3y ago
That's a good question, for e.g if you want to get Microsoft's revenues by product category or apple's revenues in greater China. https://imgur.com/a/LdQkt7j You can also do this across time with constra
10.
by nnechm 3y ago
A few things on prompting: 1. Get me google cloud revenues fails, because somehow gpt4 thinks i am talking about an entity called google cloud and not google :) 2. So in order to fix it, you can either ask for Get me google's cloud rev
11.
by nnechm 3y ago
Thanks for letting me know, i guess you use a different strategy of querying by company and by document. I see this when I try to get Apple's rest of asia pacific revenues for e.g I guess it really depends on how your targeted user wou
12.
by nnechm 3y ago
Yes, they are definitely not primitive, but considering how the breakthrough in LLMs happened, i.e MSFT, GOOGL were working on it, even as late as 2021, Google's BERT was not really there (at least the one they showed the public in the
13.
by nnechm 3y ago
Hi, Thanks for bringing that concern up. I shall keep it in mind and change it based on feedback from customers if it is an issue. Typically, people search for a company after a price move rather than before. And these are searches on publ
14.
by nnechm 3y ago
It would be possible for example to get AMD's revenues over time like this, it's tedious because of context size, but it's unrestricted, so you can get whatever datapoint you want... If we run this query over an api for incom
15.
by nnechm 3y ago
The functions tend to fail when the prompt is complex and the user asks for a lot of fields, and typically the last field in the json is not closed i.e missing a }, i guess openai is aware of it. It doesn't fail that often to have to w
16.
by nnechm 3y ago
As the answers are from the text, we can avoid hallucinations for the most part. I have not experienced made up numbers, instead errors are numbers that are typically misplaced, where it gives you revenues for the last 6 months instead of t
17.
by nnechm 3y ago
Yes, I think the broader point is you have these readers available on call via api, so you can do all that you suggested and more...
18.
by nnechm 3y ago
I am using openai's latest functions api, so you can get it to return arguments that will ensure that you get a json, it works pretty well most of the time. The json would then be used to fetch a report from a database.
19.
by nnechm 3y ago
Embeddings did not really work well enough for me, let us say you are looking for numerical text, so for e,g get me AMD's revenue from March 2022. The embedding representation needs to understand that March 2022 together is way more i
20.
by nnechm 3y ago
I am using openai's functions as that is a more reliable form of extracting json, but even that can fail sometimes as the response misses a "'" or a }
21.
by nnechm 3y ago
You can try it out for yourself... :) Here's an example, that asks for AMD's cash and makes an arbitrary calculation on total liabilities, the ai is smart enough to sum up everything until equity and gets the numbers right, withou
22.
by nnechm 3y ago
You are probably right, but there has been nothing like gpt4 before, having seen some versions before I would wager that their entire application can probably be redone for a fraction of the cost and it would work better... :)
23.
by nnechm 3y ago
I am not using inline XBRL, instead relying on gpt's ability to read tables.
24.
by nnechm 3y ago
I don't do handle news articles, and was just focusing on filings, so my answer would look for a filing. That's why it looks the way it does :)
25.
by nnechm 3y ago
Thanks, I don't feed the whole report in, unless necessary. Context size is a real limiting factor :), so you need to split it up into chunks that are meaningful on their own and find those relevant to the question. In this case, what
26.
by nnechm 3y ago
Thanks ! It's really interesting to see how LLMs have now brought back projects that were last updated years ago back into the limelight :)
27.
by nnechm 3y ago
I do not really imagine this as something that does all the investment work and makes a decision. Instead, the mental model is you have an army of people who can read texts really well, as in 'reading comprehension' as they call i
28.
by nnechm 3y ago
This is how GPT4 answers the question... I assumed the question, but presumably will be along those lines :) https://chat.openai.com/share/c736abf4-ae3c-4fbd-9427-b7d2f9...
29.
by nnechm 3y ago
Yes, that's right, I avoid hallucinations that way. In addition, I mark up existing texts so that the LLM knows what it is reading even if it is a piece of a larger text, so for e.g if you need to get Apple's Greater China sales f
30.
by nnechm 3y ago
Thanks, will try that.

More ›