tmabraham

13 ms·

1.
by tmabraham 11mo ago
Sophont Inc. | Founding Research Engineer / Scientist | Remote | Full-time Sophont is a public-benefit corporation building open multimodal foundation models for medicine. Joining Sophont means you are paid to lead and contribute to hi
2.
Sophont announces $9.22M seed round to build multimodal models for healthcare(sophont.med)
2 points by tmabraham 1y ago|0 comments
3.
by tmabraham 1y ago
I'm the co-founder of Sophont, happy to answer any questions!
4.
Sophont: Building open multimodal foundation models for the future of healthcare(sophontai.com)
5 points by tmabraham 1y ago|1 comments
5.
by tmabraham 1y ago
https://x.com/iScienceLuvr/status/1905144432791609480
6.
by tmabraham 2y ago
it was already planned for open-sourcing, the leak did not affect the plans in any way
7.
by tmabraham 3y ago
Nicolas Bourbaki is the name of a character in twenty one pilots' concept album "He'll always try to stop me, that Nicolas Bourbaki He's got no friends close, but those who know him most know He goes by Nico" It is
8.
Celebrating One Year of MedARC(stability.ai)
1 points by tmabraham 3y ago|0 comments
9.
by tmabraham 3y ago
The paper has preliminary results for video as well
10.
Scaling Rectified Flow Transformers for High-Resolution Image Synthesis [pdf](stabilityai-public-packages.s3.us-west-2.amazonaws.com)
2 points by tmabraham 3y ago|0 comments
11.
CheXagent: Towards a Foundation Model for Chest X-Ray Interpretation(stanford-aimi.github.io)
1 points by tmabraham 3y ago|0 comments
12.
Evaluating the Medical Knowledge of Open LLMs(medarc.ai)
2 points by tmabraham 3y ago|0 comments
13.
Evaluating the Medical Knowledge of Open Language Models(medarc.ai)
3 points by tmabraham 3y ago|0 comments
14.
RLHF for Diffusion Models from Scratch(tanishq.ai)
2 points by tmabraham 3y ago|0 comments
15.
Enhancing Diffusion Models with Reinforcement Learning(carper.ai)
2 points by tmabraham 3y ago|0 comments
16.
DRLX: RLHF for Diffusion Models(github.com)
2 points by tmabraham 3y ago|0 comments
17.
GPU Puzzles(github.com)
2 points by tmabraham 3y ago|0 comments
18.
by tmabraham 3y ago
Because you can take advantage of pretrained CNNs and perform transfer learning, which is significantly more data-efficient than training from scratch, which is what you'd likely have to do with raw digital signals. This paper is not u
19.
by tmabraham 3y ago
Yeah using data from a 7T MRI giving higher spatial resolution definitely helps! The fMRI dataset includes signal from the whole brain but we only use the data from the visual cortex for this study.
20.
by tmabraham 3y ago
Our model generates CLIP image embeddings from fMRI signals and those image embeddings can be used for retrieval (using cosine similarity for example) or passed into a pretrained diffusion model that takes in CLIP image embeddings and gener
21.
by tmabraham 3y ago
Yes we've been looking into ControlNet as well, and I think there is one recent fMRI-to-image paper that also has tried ControlNet. Maybe we'll use ControlNet in MindEye v2 :)
22.
by tmabraham 3y ago
We think it could be useful for clinical research and maybe even diagnostics. For example, you could imagine a person with depression(or other neurological disorders) may have a different perception of the same image than a healthy person.
23.
fMRI-to-image with contrastive learning and diffusion priors(stability.ai)
146 points by tmabraham 3y ago|64 comments
24.
Talk to Claude 2(claude.ai)
2 points by tmabraham 3y ago|0 comments
25.
fMRI-to-Image with Contrastive Learning and Diffusion Priors(stability.ai)
1 points by tmabraham 3y ago|0 comments
26.
by tmabraham 3y ago
I use GitHub Copilot very frequently for any programming I do. I also use BingChat very often, I consider it to be a very underrated tool that people haven't fully explored. Of course, it's great for when you want your LLM queries
27.
MindEye: fMRI-to-Image with Contrastive Learning and Diffusion Priors(medarc-ai.github.io)
2 points by tmabraham 3y ago|0 comments
28.
State-of-the-art fMRI-image reconstruction (MindEye)(arxiv.org)
3 points by tmabraham 3y ago|0 comments
29.
Mind’s Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors(medarc-ai.github.io)
1 points by tmabraham 3y ago|0 comments
30.
by tmabraham 3y ago
Okay, but are you a diffusion model/generative AI researcher? As a researcher in this field, I found the article fairly understandable and accessible. I suspect that was the target audience. The domain of diffusion models have a lot of

More ›