[ros-users] [Discourse.ros.org] [ROS Projects] Slice and dice large ROS bag files on Hadoop and Spark

Jan ros.discourse at gmail.com
Wed Jul 26 19:53:06 UTC 2017



Both are possible, data center and on-premise. There are no hardware requirements but we recommend a 3 nodes setup to see the benefits of parallelism. Start with 64-128 GB memory, 4 disks and quad-core per node.

Spark performance really scale out with multiple machines. If there are 3 splits is 3 times faster with 3 workers. etc.





---
[Visit Topic](https://discourse.ros.org/t/slice-and-dice-large-ros-bag-files-on-hadoop-and-spark/2314/3) or reply to this email to respond.




More information about the ros-users mailing list