The dataset has two parts: (1) 8 atomic manipulation actions, each has 15 versions. (2) 20 chained manipulations. For each recorded manipulation we provide the raw orginazed pcl data (xyzrgb). Attached movies show how each manipulation looks like. We also provide segment labels that were extraced from RGBD pcl data using the method in Abramov 2012 (see below). The label set for each frame was saved in a matrix format in the respective .dat file. File names between pcl and segment labels are compatible! In order to get the respective labeled point cloud, one has to simply assign labels to points in the cloud. We additionally provide the extracted Semantic Event Chain (SEC) data. In each SEC folder, SEC data are provided as a GraphML file with respective key frame images. These key frame images are just for the visualization. Upon the request, we can also provide an xml parser that converts SEC GraphML files into Matlab matrices. Inside the SEC folder, the SEC data was also provided in a matrix format as .dat file. Please feel free to contact Eren Erdal Aksoy (aksoyeren@gmail.com) if there is anything missing! Please cite the following paper in the case of using this dataset in your publications: Eren Erdal Aksoy, Tamosiunaite Minija, and Wörgötter Florentin (2014). “Model-Free Incremental Learning of the Semantics of Manipulation Actions”. Robotics and Autonomous Systems (In press). -------- segmentation paper -------------- A. Abramov, K. Pauwels, J. Papon, F. Wörgötter, B. Dellen, Depth supported real-time video segmentation with the kinect, in: Applications of Computer Vision (WACV), 2012 IEEE Workshop on, 2012, pp. 457-464.