6 ms·

Thank you for sharing this. Sorry for a possible noob question. How are embedding generated? Does it use a hosted embedding model? (I was trying to understand h

• sync 1y ago
  It, uh... generates mock embeddings? https://github.com/trvon/yams/blob/c89798d6d2de89caacdbe50d21cc74b0c8952d29/src/vector/embedding_generator.cpp#L333-L336 https://github.com/trvon/yams/blob/c89798d6d2de89caacdbe50d2... (seems like there's some vague future plans for models like all-MiniLM-L6-v2, all-mpnet-base-v2)
  • pbronez 1y ago
    Hmm I wonder how much that effects the compression benefits of block level duplication. The mock embeddings choose vector elements from a normal distribution, so it’s far from uniform