8 ms·
I've seen bitmaps mentioned a number of times lately. I must admit it is not something I am all that familiar with. Can someone explain to me why bitmaps are
by JAA1337 4y ago
I've seen bitmaps mentioned a number of times lately. I must admit it is not something I am all that familiar with. Can someone explain to me why bitmaps are more valuable than standard column oriented databases?
I havn't wrapped my head around how this helps speed up queries while data is being ingested.
- kurosknight 4y agoThey are useful for categorical variables. For example, is a record in the "Likes motorcycles" category? They are fast because (well, one reason) bitwise logical operations are very fast for CPUs to do. Adtech is an example of a sector that benefits from this...they slice and dice datasets a lot to target ad campaigns and such. Being able to do that quickly is useful.
- JAA1337 4y agoSo are you saying that the data is stored in categories which allows for those types of lookups to run faster? Do you have specifics on how the design of a bitmap based database achieves this? How does it maintain these relationships? Just through 0 and 1's? I guess it's easy for me to visualize both row and column based. Im struggling with the bitmaps concept.
- kordlessagain 4y agoHere's a good write up on some of what you are asking in their blog: https://www.featurebase.com/blog/bitmaps-making-real-time-analytics-real https://www.featurebase.com/blog/bitmaps-making-real-time-an...
- deniscoady 4y ago
- witchbane 4y agoSo is the thinking you run them alongside a traditional RDBMS as sort of a cache or view optimized for bitwise operations?