hazrmard

6 ms·

1.
by hazrmard 1mo ago
I read this paper ( https://arxiv.org/pdf/2410.13722 ) on pre-training poisoning of LLMs. The authors demonstrated that poisoning 0.1% of the pretraining dataset can measurably manipulate beliefs of the model. What I rea
2.
by hazrmard 1mo ago
Turns out the balance of my PhD thesis was coming up with ways to cheer up disappointed drones >:(
3.
by hazrmard 2mo ago
I resonate with the author's point that I can modify my own website to my will. I use hugo to build my website and I wrote my own theme. It's clunky, but control over the design/build lets me: - Put PyIodide into posts to
4.
by hazrmard 2mo ago
Using Django w/ frontend frameworks has been a struggle for me. (I only dabble as a hobbyist.) I think splitting the backend off into a restful API makes the marriage work. I've looked at django-rest-framework ( https://
5.
by hazrmard 2mo ago
Does the peak starting in mid-2020 correspond to mass speculative / adversarial / bandwagon hiring by tech companies during the pandemic?
6.
by hazrmard 2mo ago
Looks fun, but I don't quite understand this product: - Do the buttons map to configurable skills / prompts? - Is it meant to be used remotely with some independence (like codex remote), or is it a peripheral like a trackpad
7.
by hazrmard 2mo ago
You'd be right to be surprised by lack of mention of quaternions. I (blog author) was not too familiar with them when I did the work this post is based on. With the benefit of hindsight, I may yet revise the post.
8.
by hazrmard 2mo ago
Hello, blog author here. I agree the math appears overkill. I wrote this as a learning aid for myself with the benefit of hindsight of having worked with some drone sims. I wanted to dispel any doubt in my mind that I could derive drone phy
9.
by hazrmard 2mo ago
It's my blog. Bartosz Ciechanowski's work was my inspiration!
10.
by hazrmard 3mo ago
Good work! I wonder if meta-learning can play a better role here compared to heuristics or hindsight. MAML requires hessians, but first-order MAML or Reptile variants could help apply layer-wise adjustments to learning rates.
11.
by hazrmard 3mo ago
These day's I'm super-into information theory and entropy, so I liked the connection made at the end. I'm a visual person, and I found this schematic of SVD on the wikipedia page very insightful [1]. [1]: https://e
12.
by hazrmard 3mo ago
This is very impressive! I researched fault-tolerant octorotor control using RL in grad school for a NASA project. Perhaps this may be helpful[1, see section 8.3]! The field is moving fast, so there may be better or more suitable approaches
13.
Drone Physics(iahmed.me)
14 points by hazrmard 3mo ago|0 comments
14.
by hazrmard 4mo ago
Check my understanding & follow-up Qs: An auto-encoder is trained on [activation] -AV-> [text] -AR-> [activation], where [activation] belongs to one layer in the LLM model M. Architecture.: Model being analyzed (M): >||||
15.
by hazrmard 6mo ago
Very cool! Interesting how the choice of solver affects the solution. Euler doesn't handle misbehaved equations very well. You can see this in the Helix setup where the bodies just fly off.
16.
by hazrmard 6mo ago
I should read up on Tailscale more. I have been using ddclient[1] or the router's built-in dynamic DNS[2] to set up my servers / homelab. This leaves the endpoints exposed to the public internet, as the author says. [1]: htt
17.
by hazrmard 7mo ago
cue the bell curve meme for learning autonomy: ____.----.____ ______/ \______ _____/ \_____ ________________________________________ (simulations)
18.
by hazrmard 8mo ago
https://iahmed.me Hugo website, with a theme I made from scratch myself. Github Pages deployment. Here's my first website from when I was in college and had no experience in web dev. I still keep it on for nostalgia
19.
by hazrmard 8mo ago
This reflects my experience. Yet, I feel that getting reliability out of LLM calls with a while-loop harness is elusive. For example - how can I reliably have a decision block to end the loop (or keep it running)? - how can I reliably cal
20.
by hazrmard 8mo ago
The paper finds: - For LLM-assisted output, the more complex the LLM-writing is, the less likely the paper is to be published. From eyeballing, at WC=-30, both have similar chances of publication (~46%). At the upper range of WC=25, LLM-ass
21.
A Derivation of Entropy(iahmed.me)
2 points by hazrmard 8mo ago|0 comments
22.
by hazrmard 9mo ago
I can vouch for this with my experience. Back in grad school, I was out making new friends. I was playing tennis 4-5 times a week. I'd invite players for post-game coffees (in the morning) and dinner (evenings) at every game. Consisten
23.
by hazrmard 11mo ago
Do I understand this right? A light-weight speculative model adapts to usage, keeping the acceptance rate for the static heavy-weight model within acceptable bounds. Do they adapt with LoRAs?
24.
by hazrmard 1y ago
This takes me down a memory lane! For my undergrad capstone project, we made a cubesat tracker for our university's satellite using a RPi/Arduino/Software-defined-radio to receive transmissions every time it passed over us. I
25.
by hazrmard 1y ago
I am working on a budgeting app! Features: - Local. No internet connection needed. - Manual. Every transaction is added by the user. - One-off or arbitrarily recurring transactions. - No lock-in. Check out your data any time.
26.
by hazrmard 1y ago
Thank you very much! I had been reading up on effect of diet for treatment & management. I like the focus on citations.
27.
Ask HN: What is the latest on treatment of Metastatic Breast Cancer?
28 points by hazrmard 1y ago|10 comments
28.
by hazrmard 2y ago
Thank you. This is great. I also appreciated the linked code for MinRL ( https://github.com/10-OASIS-01/minrl ). Having done research in RL, a big problem with incremental research was to reproduce comparative works, and
29.
by hazrmard 2y ago
It's great to see proliferation of models in other languages! Shoutout to Alif, a finetune of Llama 3 8b on Urdu datasets: https://huggingface.co/large-traversaal/Alif-1.0-8B-Instruct It'd be great to see a
30.
by hazrmard 2y ago
Good read! I am developing PINNs at work and this certainly helped me recall important concepts. This post used deepxde library [2] to compose the PINN. Can anyone comment on how NVIDIA's modulus [2] compares to this? Modulus appears t

More ›