[ros-users] [Discourse.ros.org] [ROS Projects] Slice and dic…

Top Page
Attachments:
Message as email
+ (text/plain)
Delete this message
Reply to this message
Author: Jan via ros-users
Date:  
To: ros-users
Subject: [ros-users] [Discourse.ros.org] [ROS Projects] Slice and dice large ROS bag files on Hadoop and Spark


Both are possible, data center and on-premise. There are no hardware requirements but we recommend a 3 nodes setup to see the benefits of parallelism. Start with 64-128 GB memory, 4 disks and quad-core per node.

Spark performance really scale out with multiple machines. If there are 3 splits is 3 times faster with 3 workers. etc.





---
[Visit Topic](https://discourse.ros.org/t/slice-and-dice-large-ros-bag-files-on-hadoop-and-spark/2314/3) or reply to this email to respond.


If you do not want to receive messages from ros-users please use the unsubscribe link below. If you use the one above, you will stop all of ros-users from receiving updates.
______________________________________________________________________________
ros-users mailing list

http://lists.ros.org/mailman/listinfo/ros-users
Unsubscribe: <http://lists.ros.org/mailman//options/ros-users>