Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Analytics: you don't want to slow down your app, and you don't care if you lose a few records in the process.


Importantly, in analytics workloads, it is very important to know roughly how many writes aren't making it. Otherwise your analytics system sucks.


Interesting. How would one know that?


Good question. You'd need some accurate-enough data source telling you about failed writes. Which eventually comes back around to needing a consistent database and indications of client disconnects.


With a huge amount of data (as I've heard analytics is), could you take a sampling approach where you log every n transaction and only check those against the DB?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: