Network System Laboratory - Backup source of Rinions(No. 42)

View the diff.
View the diff current.
Go to Rinions.
* RINIONS [#i5a0b194]
- [[日本語はここ>Rinions (J)]]

- [[''Download''>./Download/Latest]]

- Demos
-- Local Dance (by SLKinect v1): http://youtu.be/tl2gLw-GJws
-- Over the Network (by SLKinect2): http://youtu.be/KhqbGAWqvLI
-- Multi-Execution on OpenSim (by Rinions): http://youtu.be/WOX3GuaIJ60 (this used non-safety mode)
#br

** RINIONS is Real Time Input from NI/NUI and Output to the Network and Shared Memory System [#w9d7aa38]
- Glossary: NI: Natural Interaction, NUI: Natural User Interface

#br

*** Rinions [#d9209e38]
- ''Rinions'' transfers animation data from Kinect/Xtion to Second Life/OpenSim Viwer.
- And ''Rinions'' realizes Real-Time Animation on Second Life or OpenSim.
- ''Rinions'' supports animation data file (BVH), too.
- ''Technical Data'': [[ppt>http://www.nsl.tuis.ac.jp/xoops/modules/xpwiki/gate.php?way=attach&_noumb&refer=Rinions&openfile=Rinions.ppt]]
#br

**** ''Latest Version is 3.4.0 (4 March 2013)''. [#gcfe3ac5]
- ''Voice Control (for Kinect SDK 1.6/1.7)''
- ''Support OpenNI2 and NiTE2''
- ''Enhancement of a log function''

- Face Tracking is enable.
- Joint Rotation Restriction.
- Rinions supports ''BVH'' file and [[MikuMikuDance(MMD):http://www.geocities.jp/higuchuu4/index.htm]]. (Support of MMD is experimental, now).
- Rinions supports ''[[Imprudence:http://wiki.kokuaviewer.org/wiki/About_Imprudence]]'', ''[[Firestorm:http://www.phoenixviewer.com/]]'' and ''[[Singularity:http://www.singularityviewer.org/]]'' Viewers.
-- There is very little change of source code. Therefore, if recompile is possible, it will work on other Viewers.
-- If you want to use other Viewer, please request to us at [[Rinions Forum:http://www.nsl.tuis.ac.jp/xoops/modules/d3forum/index.php?forum_id=14]].
-- [[Latest information about supported Viewers is here.>./Supported Viewers]]

&ref(Rinions_demo.png,20%); &nbsp;&nbsp; &ref(SLKinect2/SLKINECT2_2_E.jpg,20%); &nbsp;&nbsp; &ref(Rinions_System.png,20%);

#br
- Why is [[SLKinect]] renamed to Rinions ?
++ It works also except Kinect. (Is Kinect TM of Microsoft?)
++ It can be used also except Second Life (SL).
#br

*** Animation Relay Server [#lcdbcbd2]
- Animation Relay Server (anm_server) relays UDP packet data from one Rinions to all Rnionss of same group.
- [[More information about Animation Relay Server>anm_server]]
#br

*** Functions of Rinions [#f78bf212]
- Dual Library Stack (''OpenNI2+NiTE2'' and ''Kinect SDK 1.6/1.7'')
- Voice Control (for Kinect SDK 1.6)
- Support Log File of Joint Data.

- Detection of position and Qauternion of joints. And write them to shared memory and send to network server.
- Read data from any data file and network server.
- Over the NAT (using UDP Hole Punching)
- Detection Speed is Up (-30FPS)
- Quality is Up (Use Position data instead of Rotation Matrix)
- Data Save/Load
-- OpenNI Raw Data, Original Text File, ''BVH'', MikuMikuDance Motion File (VMD). (Support of VMD is experimental, now).
- QoS of Server and Clients
- 64bit application
- Not need calibration (OpenNI)
- Delete Local Mode
- Supports for Xtion (with no camera)
- Control of LED and Tilt Motor (when Kinect SDK is used, LED is not controled)
- Correction of Kinect's Data
-- Moving Average (implementation by SDK or us)
- Include ''anm_server.exe'' that is compiled by Cygwin
#br

*** Dual Library Stack (OpenNI/NiTE and Kinect SDK) [#bedd5c7d]
| / | Device | Detection Speed | Incorrect Detection  | Tracking Speed | Software Reset of User Detection | Initializing Camera Image | Turn (Spin) | Detection of Upper | Audio | Face Tracking |
| Kinect SDK 1.6 | Kinect | Fast | Often | Late for Camera Image | OK | Fast | NO | OK | OK | OK |
| OpenNI2 + NiTE2 | Xtion, Kinect | Very Slow | Sometimes | Fast | OK | Slow | OK | NO | Not Support Yet | Use OpenCV |
- Kinect at Device means Kinect for Xbox360 and Kinect for Windows
- %%If you want to use Kinect for Xbox360 with OpenNI+NiTE, you need to use avin2 driver.%%
#br

** [[DownLoad>./Download]] [#d17a34de]
- [[Download Page is here (Latest Version)>./Download/Latest]]
- [[Supported Viewers>./Supported Viewers]]

#br

** Usage and Fuctions [#l61ede8a]

*** Quick Start [#n903e29e]
- [[Quick Start of Rinions (Local)>./Quick Start]]
- [[Use Animation Relay Server>./Easy_Network]]
- [[You have no Kinect, but you want to see a dance of your friend>./No_Kinect]]
#br
*** Voice Control (for Kinect SDK) [#w45b05c5]
- You need to install Runtime of Speech Platform. Please execute ''SpeechPlatformRuntime.msi'' at Redist folder of Rinions (Program Folder)
- if you want to open sensor (camera) view and start detection, please say ''Window'', ''Camera'', ''Two'', ''Start'', ''Record'' Or say ''W'', ''C'', ''Two'', ''Start'' and ''Record''

- About menu open commands. (Window must be foreground)
- Please say menu string or alphabet in ''( )''
-- ''File'' or ''F''     : Open File Menu ............... As Menu is ''File (F)''
-- ''Window'' or ''W''   : Open Window Menu
-- ''Setting'' or ''T''  : Open Setting Menu
-- ''Help'' or ''H''     : Open Help Menu
- It available at sub menu

- About sensor (camera) view commands.
-- ''Start''        : Start to detect skeleton
-- ''Record''       : Start to record skeleton
-- ''Stop''         : If Rinions is executing record, stop to record. If Renions is not executing record, stop to detection.
-- ''User''         : Search next user.
-- ''Motor up''     : Tilt motor is up
-- ''Motor down  '' : Tilt motor is down
-- ''Motor center'' : Tilt motor is center

- These speech grammar file is ''speech_grammar.grxml'' at same folder with Rinions.exe. You can edit it.



#br

*** Log Function [#g328b037]
- Rinions can save Log Files. Format of the Log File is [[Joints Text File Format>./Joints Text File]] + Joint Angle.
- [[About Setting of Log File:http://www.nsl.tuis.ac.jp/xoops/modules/xpwiki/gate.php?way=attach&_noumb&refer=Rinions&openfile=Log.pdf]]
#br

*** Face Tracking [#z3b07c40]
- Please check ''Face Detection'' in Motion Setting Dialog.

**** Kinect SDK [#qc2056ab]
- Rinions 3.2 can detect face position and face direction using ''Kinect Developer Toolkit''.

**** OpenNI [#o604af2a]
- Rinions 3.2 can detect face position using OpenCV.
- If you want to face detection,
-- Download and extract OpenCV
-- Copy ''data'' folder from OpenCV to Rinions program Folder. ex.) C:\Program Files (x86)\NSL\Rinions
#br

*** Restriction of Joint Rotation [#zd9eb2c5]
- At Rinions 3.2, you can restrict joint rotation using ''[[joint_restriction.txt>./joint_restriction.txt]]''
- Please see ''[[joint_restriction.txt>./joint_restriction.txt]]'' in Rinions Program Folder. ex.) C:\Program Files (x86)\NSL\Rinions
- [[More detail is here>./Joint Restriction]].
- see also http://wiki.secondlife.com/wiki/Suggested_BVH_Joint_Rotation_Limits (this is QAvimator coodinate)
#br

*** Support of BVH [#i434d44d]
- From v3.1, Rinions supports BVH File.
- Reading and writing BVH file are possible.
//- [[More details>./BVH]]

- Blog: http://www.metaverse.jp.net/2012/09/07/bvh-%E5%A4%89%E6%8F%9B (Sorry, contents is Japanese)
- Youtube: http://www.youtube.com/watch?v=Ts3l44lVUh0 (Sorry, description is Japanese)
#br

*** Support of MikuMikuDance [#l50b5a21]
- This function is experimental now.
- [[Motion Capture>./MMD]]
- [[Read VMD File>./MMD]] (A complicated motion is difficult to display)

- Please see
-- http://youtu.be/ALGVOGBQg7w (sorry, description is Japanese)
-- http://youtu.be/BVmfgs_wHSc （It seems that my practice is insufficient still more.  &worried;）
#br

*** Save and Load Data [#g0e8133a]
+ If you click record button on sensor window, animation data is wrote as temporary data.
+ Next, when you select ''Save File'' from ''File Menu'',  temporary animation data is saved.
+ If you select ''Load File'' from ''File Menu'' and specify data file, animation data is loaded automatically.

**** Supported Data File [#z723ca21]
- OpenNI Raw Data File
- [[Joints Text File>./Joints Text File]]
- BVH File
- VMD File (Experimental.  A complicated motion is difficult to display)
#br

*** More Details of Rinions [#w8b439ad]
- [[Whole View of Rinions>./Whole_View]]
- [[File Player>./File Player]]
- ''Menu Bar''
-- [[File Menu>./File Menu]]
-- [[Window Menu>./Window Menu]]
-- [[Setting Menu>./Setting Menu]]
#br

*** Tutorial Videos [#p383ef37]
+ Installation of Rinions: http://youtu.be/jU1xxu19Gn4
+ Setup and Easy Execution: http://youtu.be/3gatR6MbtAU
+ Use Our Animation Relay Server: http://youtu.be/x942bCfTSso
+ User Local Animation Relay Server on your PC: http://youtu.be/aNCvDxzlGjA
+ Save and Load ONI and Joints Text File: http://youtu.be/MoUXM1XCP64
#br

** FAQ [#ed3eb78f]
- [[Trouble Shooting>./Trouble Shooting]]
#br

** Known Bugs [#w350512d]
- %%Under execution of Rinions, do not connect or disconnect Kinect/Xtion. In that case, Rinions will be crashed.%% (Fixed at 3.0.1)
- %%FilePlayer has Timer bug and Initial Parameter Bug.%% (Fixed at 3.0.1)
#br

** ETC [#d378f4af]
*** License [#o6af16c3]
This software is free for non-commercial use. Distribution and the use library is also free for non-commercial use.
Distribution must include all elements as provided, including the library. Copyright notices to all material must remain intact and as displayed in all components.

If you want to use this software for business (i.e. when you demand value from sales, use, or otherwise from this software), please send e-mail to iseki@solar-system.tuis.ac.jp.
#br

*** Disclaimer [#jbcf6f91]
This software is not guaranteed at all. The author makes no representations regarding the fitness of this software and does not assume responsibility for any problems that may occur with the use, remodeling, or re-distribution of this software under any circumstances.
Use is entirely at your own risk.
#br
*** Acknowledgments [#s49e6ef3]
- Thanks for Kinect Hackers.
- Thanks for Japanese Kinect Hackers.
- Thanks for Imprudence Viewer development Team.
- Thanks for Firestorm Viewer development Team.
- Thanks for Singularity Viewer development Team.
- Thanks for Cygwin development Team. anm_server.exe is compiled using cygwin.
- Thanks for other All developers of Open Source.
- Thanks for students of NSL.
- And Thaks for your bug reports. :-)
#br
« Prev Next »
Backup source of Rinions (No. 42)

Site Search

Login

Sub Menu

Books

mini Calendar

Who's Online

Access Counter
