RINIONS
- Demos
- Local Dance (by SLKinect v1): http://youtu.be/tl2gLw-GJws
- Over the Network (by SLKinect2): http://youtu.be/KhqbGAWqvLI
- Multi-Execution on OpenSim (by Rinions): http://youtu.be/WOX3GuaIJ60 (this used non-safety mode)
RINIONS is Real Time Input from NI/NUI and Output to the Network and Shared Memory System
- Glossary: NI: Natural Interaction, NUI: Natural User Interface
Rinions
- Rinions transfers animation data from Kinect/Xtion to Second Life/OpenSim Viwer.
- And Rinions realizes Real-Time Animation on Second Life or OpenSim.
- Rinions supports animation data file (BVH), too.
- Technical Data: ppt
Latest Version is 3.4.0 (4 March 2013).
- Voice Control (for Kinect SDK 1.6/1.7)
- Support OpenNI2 and NiTE2
- Enhancement of a log function
- Face Tracking is enable.
- Joint Rotation Restriction.
- Rinions supports BVH file and MikuMikuDance(MMD). (Support of MMD is experimental, now).
- Rinions supports Imprudence, Firestorm and Singularity Viewers.
- There is very little change of source code. Therefore, if recompile is possible, it will work on other Viewers.
- If you want to use other Viewer, please request to us at Rinions Forum.
- Latest information about supported Viewers is here.
- Why is SLKinect renamed to Rinions ?
- It works also except Kinect. (Is Kinect TM of Microsoft?)
- It can be used also except Second Life (SL).
Animation Relay Server
- Animation Relay Server (anm_server) relays UDP packet data from one Rinions to all Rnionss of same group.
- More information about Animation Relay Server
Functions of Rinions
- Dual Library Stack (OpenNI2+NiTE2 and Kinect SDK 1.6/1.7)
- Voice Control (for Kinect SDK 1.6)
- Support Log File of Joint Data.
- Detection of position and Qauternion of joints. And write them to shared memory and send to network server.
- Read data from any data file and network server.
- Over the NAT (using UDP Hole Punching)
- Detection Speed is Up (-30FPS)
- Quality is Up (Use Position data instead of Rotation Matrix)
- Data Save/Load
- OpenNI Raw Data, Original Text File, BVH, MikuMikuDance Motion File (VMD). (Support of VMD is experimental, now).
- QoS of Server and Clients
- 64bit application
- Not need calibration (OpenNI)
- Delete Local Mode
- Supports for Xtion (with no camera)
- Control of LED and Tilt Motor (when Kinect SDK is used, LED is not controled)
- Correction of Kinect's Data
- Moving Average (implementation by SDK or us)
- Include anm_server.exe that is compiled by Cygwin
Dual Library Stack (OpenNI/NiTE and Kinect SDK)
/ | Device | Detection Speed | Incorrect Detection | Tracking Speed | Software Reset of User Detection | Initializing Camera Image | Turn (Spin) | Detection of Upper | Audio | Face Tracking |
Kinect SDK 1.6 | Kinect | Fast | Often | Late for Camera Image | OK | Fast | NO | OK | OK | OK |
OpenNI2 + NiTE2 | Xtion, Kinect | Very Slow | Sometimes | Fast | OK | Slow | OK | NO | Not Support Yet | Use OpenCV |
- Kinect at Device means Kinect for Xbox360 and Kinect for Windows
If you want to use Kinect for Xbox360 with OpenNI+NiTE, you need to use avin2 driver.
Voice Control (for Kinect SDK)
- You need to install Runtime of Speech Platform. Please execute SpeechPlatformRuntime.msi at Redist folder of Rinions (Program Folder)
- if you want to open sensor (camera) view and start detection, please say Window, Camera, Two, Start, Record Or say W, C, Two, Start and Record
- About menu open commands. (Window must be foreground)
- Please say menu string or alphabet in ( )
- File or F : Open File Menu ............... As Menu is File (F)
- Window or W : Open Window Menu
- Setting or T : Open Setting Menu
- Help or H : Open Help Menu
- It available at sub menu
- About sensor (camera) view commands.
- Start : Start to detect skeleton
- Record : Start to record skeleton
- Stop : If Rinions is executing record, stop to record. If Renions is not executing record, stop to detection.
- User : Search next user.
- Motor up : Tilt motor is up
- Motor down : Tilt motor is down
- Motor center : Tilt motor is center
- These speech grammar file is speech_grammar.grxml at same folder with Rinions.exe. You can edit it.
Log Function
- Rinions can save Log Files. Format of the Log File is Joints Text File Format + Joint Angle.
- About Setting of Log File
OpenNI
- Rinions 3.2 can detect face position using OpenCV.
- If you want to face detection,
- Download and extract OpenCV
- Copy data folder from OpenCV to Rinions program Folder. ex.) C:\Program Files (x86)\NSL\Rinions
Restriction of Joint Rotation
- At Rinions 3.2, you can restrict joint rotation using joint_restriction.txt
- Please see joint_restriction.txt in Rinions Program Folder. ex.) C:\Program Files (x86)\NSL\Rinions
- More detail is here.
- see also http://wiki.secondlife.com/wiki/Suggested_BVH_Joint_Rotation_Limits (this is QAvimator coodinate)
Support of BVH
- From v3.1, Rinions supports BVH File.
- Reading and writing BVH file are possible.
- Blog: http://www.metaverse.jp.net/2012/09/07/bvh-変換 (Sorry, contents is Japanese)
- Youtube: http://www.youtube.com/watch?v=Ts3l44lVUh0 (Sorry, description is Japanese)
Support of MikuMikuDance
- This function is experimental now.
- Motion Capture
- Read VMD File (A complicated motion is difficult to display)
- Please see
- http://youtu.be/ALGVOGBQg7w (sorry, description is Japanese)
- http://youtu.be/BVmfgs_wHSc (It seems that my practice is insufficient still more. )
Save and Load Data
- If you click record button on sensor window, animation data is wrote as temporary data.
- Next, when you select Save File from File Menu, temporary animation data is saved.
- If you select Load File from File Menu and specify data file, animation data is loaded automatically.
Supported Data File
- OpenNI Raw Data File
- Joints Text File
- BVH File
- VMD File (Experimental. A complicated motion is difficult to display)
Tutorial Videos
- Installation of Rinions: http://youtu.be/jU1xxu19Gn4
- Setup and Easy Execution: http://youtu.be/3gatR6MbtAU
- Use Our Animation Relay Server: http://youtu.be/x942bCfTSso
- User Local Animation Relay Server on your PC: http://youtu.be/aNCvDxzlGjA
- Save and Load ONI and Joints Text File: http://youtu.be/MoUXM1XCP64
Known Bugs
Under execution of Rinions, do not connect or disconnect Kinect/Xtion. In that case, Rinions will be crashed.(Fixed at 3.0.1)FilePlayer has Timer bug and Initial Parameter Bug.(Fixed at 3.0.1)
License
This software is free for non-commercial use. Distribution and the use library is also free for non-commercial use. Distribution must include all elements as provided, including the library. Copyright notices to all material must remain intact and as displayed in all components.
If you want to use this software for business (i.e. when you demand value from sales, use, or otherwise from this software), please send e-mail to iseki@solar-system.tuis.ac.jp.
Disclaimer
This software is not guaranteed at all. The author makes no representations regarding the fitness of this software and does not assume responsibility for any problems that may occur with the use, remodeling, or re-distribution of this software under any circumstances. Use is entirely at your own risk.
Acknowledgments
- Thanks for Kinect Hackers.
- Thanks for Japanese Kinect Hackers.
- Thanks for Imprudence Viewer development Team.
- Thanks for Firestorm Viewer development Team.
- Thanks for Singularity Viewer development Team.
- Thanks for Cygwin development Team. anm_server.exe is compiled using cygwin.
- Thanks for other All developers of Open Source.
- Thanks for students of NSL.
- And Thaks for your bug reports.
添付ファイル: Rinions.ppt 633件 [詳細] Log.pdf 1283件 [詳細] Rinions_System.png 907件 [詳細] Rinions_demo.png 826件 [詳細]