Hey mapleeman, why is the benchmark infrastructure not language agnostic? Shouldn't it be more desirable to keep the infra as a scheduler and verifier which can take an input in any language and process it while collecting the useful metrics. Restricting it to cypher leaves a bunch of DBs unable to run this.
That's a lot of work and would be a large project in itself to separate the test driver to different query formats and have it drivable from multiple programming languages.
I implemented a toy Cypher database (samsquire/hash-db) and I just use a python test script. I am yet to benchmark, the performance is probably poor.
I tried running standardised SQL benchmarks against MySQL but the benchmark code fell behind the MySQL client and it's work to maintain it.
I inherited a Jepsen suite to test ActiveMQ and it wasn't easy to understand
Yes, testing and benchmarking is a full-time job! The extra issue here is making it work under a single client to minimise latency penalties across measurements, then, there is also a protocol issue.
Nice project with hash-db, I guess it is quite the learning experience(distributed-multimodal)?
I agree. Designing a generic test runner running workloads by reading them from raw arbitrary SQL files and then executing them against XYZ database backend would have been much easier for adding new workloads and extending supported database backends. I wrote few such frameworks so I for sure know it's not a big deal. Sysbench does this through Lua which is also ok if you need more advanced scripting capabilities in the workload itself.
Hey, thanks for the comment, you are 100% right, this is just the initial version since we are compatible with Neo4j, so it was a least effort to do it. It is just the initial setup, making it language agnostic will take a bit time. If you peak at the methodology and future part: https://github.com/memgraph/memgraph/tree/master/tests/mgben...
You will see that we have the plan to add more database vendors + make it language-agnostic. We are also keeping track of all comments regarding this, I have opened an issue: https://github.com/memgraph/memgraph/issues/689, there is a language agnostic note in there. If you have any other input, it would be highly appreciated.
You can login and create survey forms and then use GraphQL queries either from the dashboard or any other client to query responses.
For more details and demo see this blog post: https://dgraph.io/blog/post/surveyo-into/
Dgraph Labs | Palo Alto, Bangalore, Remote | Hiring Community Engineers, Technical Writers, Distributed Systems, Frontend, and Fullstack Engineers | Full-time, VISA | https://dgraph.io/
Dgraph Labs was started by ex-Google engineers and is VC funded. We are a team of dedicated engineers with a mission to build the world's best graph database. Nothing less excites us! Dgraph has solid open-source traction with over 13,000 GitHub stars and over 2 million Docker Hub pulls and is being used in production at multiple Fortune 500 companies.
We are hiring for community engineers, frontend engineers, fullstack engineers, technical writers, and distributed systems engineers. We love what we do and take care of each other while hand-crafting the best graph database.
Dgraph Labs | Palo Alto, Bangalore, Remote | Hiring Community Engineers, Technical Writers, Distributed Systems, Frontend, and Fullstack Engineers | Full-time, VISA | https://dgraph.io/
Dgraph Labs was started by ex-Google engineers and is VC funded. We are a team of dedicated engineers with a mission to build the world's best graph database. Nothing less excites us! Dgraph has solid open-source traction with over 13,000 GitHub stars and over 2 million Docker Hub pulls and is being used in production at multiple Fortune 500 companies.
We are hiring for community engineers, frontend engineers, fullstack engineers, technical writers, and distributed systems engineers. We love what we do and take care of each other while hand-crafting the best graph database.
Yay! Thanks for the love :) :). Did you try filing an issue here https://github.com/dgraph-io/dgraph with specific features you would like to see? We will try to prioritize if we see the traction from a lot of users.
