Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

In the context of machine learning, notebooks are a crutch people lean on when the production environment lacks the right abstractions--isn't convenient enough. Notebooks fall under the "prototype smell" in Google's Hidden Technical Debt in Machine Learning Systems (2015).

I agree that notebooks are best reserved for exposition.



I don't think I've met a single data scientist or ML person who used Python and didn't use notebooks.

What are the "right abstractions" that everyone seems to miss?


I use them too, but for data science rather than machine learning. The right abstractions include handling authenticating to the ML services, experiment tracking, hyper-parameter optimization, distributed compute, access to PII data, etc. If you're dealing with nonsensitive data that fits on a laptop you might not need these.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: