I'm gearing all my personal tooling stuff towards collecting a ton of data points—screenshots, logs, notes, todos—that I can then pare down over time to make them useful. I've got a similar setup with a central monolith that can handle anything I throw at it from stdout.
Lately, I've been focusing mainly on the collectors because I figure the state-of-the-art in any middleware I write is going to change quickly. I've been playing around with knowledge graphs for visualization and might consider using them as a data store for this kind of thing. I'm still thinking about it. My watchword has been minimalism when it comes to design—no added steps or latency to existing workflows.
Lately, I've been focusing mainly on the collectors because I figure the state-of-the-art in any middleware I write is going to change quickly. I've been playing around with knowledge graphs for visualization and might consider using them as a data store for this kind of thing. I'm still thinking about it. My watchword has been minimalism when it comes to design—no added steps or latency to existing workflows.