What does HackerNews think of Rath?
Automated data exploratory analysis and visualization tools.
RATH, auto exploratory data analysis: https://github.com/Kanaries/Rath
GraphicWalker, embeddable data exploration component: https://github.com/Kanaries/graphic-walker
They are using vega-lite for now. But there is a limit of building more fancy and customized visualizations. It seems Plot has a more flexible layer based visualization system that can support larger design space.
Is Plot stable enough now to migrate from vega-lite based system to Plot based? Are there any large milestone or roadmap of Plot in future?
There’s a lot of really nice features in this other tool, the author’s thought of everything: https://github.com/Kanaries/Rath
1. High memory usage: When loading large datasets, the memory usage can become quite high. (50MB csv will use 700MB memory in RATH)
2. Slow computation tasks: Group-by, filter, bin, or even Cube operations can be slow and sometimes block the main thread.
3. Slow chart rendering: Chart rendering can also be slow and sometimes block the main thread. (Currently using VegaLite)
I have implemented some solutions to address these issues:
1. For high memory usage, I am storing large raw data in indexedDB and reading it as needed. This reduces memory usage but can still consume a lot of memory when the data is loaded into the main thread.
2. To improve the performance of computation tasks, I am using web workers for some data computations (such as group-by, bin, transform, and filters). I am also testing duckDB-wasm, but lack of some knowledge of its best practice.
3. For slow chart rendering, I have tried using offscreen canvas to render the chart in a web worker. However, this approach creates a static canvas without any interactive features (such as tooltips, zooming, or callbacks for data selections). I am looking for methods on how to make the chart rendered in the web worker interactive.
Any suggestions or experiences shared would be greatly appreciated.
RATH Github Repo: https://github.com/Kanaries/Rath
RATH basic background: RATH is beyond an open-source alternative to Data Analysis and Visualization tools such as Tableau. It automates your Exploratory Data Analysis workflow with an Augmented Analytic engine by discovering patterns, insights, causals and presents those insights with powerful auto-generated multi-dimensional data visualization.