Headline

Hanyuan Xiao, Hyuck Ju (Tommy) Kim

  • As we investigated and learned multiple camera calibration approaches, here we publish an instruction to the public.
  • Finished and tested script to convert 2D keypoint to 3D keypoint.
  • In order to feed data to Unity and transform the avatar's 3D joints, we used openpose-rig and edited the script
  • The result was very bad as shown in the gif.
  • Thus starting debugging, and realized that the 2D keypoints were fine, but the converted 3D keypoints were very off.

Hong Liu (Sherry)

  • Adjust the size of the folder, enhance the user feelings.
  • Make each layer of the folder semi-transparent so that you can see objects in the back layer.
  • Add socket to the 3D folder, so that the containerobject can be attracted to the socket.
  • Made a traditional folder to compare efficiency with the 3D folder.

Jessi Jia

  • A traditional keyboard layout is implemented to compare input speed with 3d keyboards. A testing paragraph is added to both scenes so that if a user enters this paragraph with both layouts, we cam calculate the input speeds and compare.
  • Challenges: Unable to make traditional keyboard layout clickable because the there is no parent canvas to the button.

Shinyee Lin

  • Add a screenshot taker working on Unity Editor and PC Build (Test on Mac).
  • Challenges: Unable to test it on Android and VR headset.
Feiyu(Robert) Miao

  • Seperate components of controllers into different layers.
  • Fixed the bug that some objects which have Movement Type of Velocity Tracking collide with the ray emitters.
  • Fixed the bug that the object grabbed may change its forward direction and position when direction of ray is changed.
  • Fixed the problem that components of controller may interact with other objects unexpectly.
  • Fixed the problem that ray emitter may select its own controller body (sphere around the controller)
  • Fixed the problem that if user's controller's ray emitter collide with other physical object while changing its dierection, the emitter may turning unexpectly.
  • Implement the fucntion of ray length changes. User now could point to the sphere around the controllers and grab to change the length of the ray.

Hanyuan Xiao, Hyuck Ju (Tommy) Kim

  • Debug through 2D-3D skeleton extraction pipeline.
  • Look into using Kinect v2 to make a real-time pose estimating unity avatar
Hong Liu (Sherry)

  • Continue adjust 3D folder.
  • Make a traditional 2D folder to compare with 3D folder.
Jessi Jia

  • Add a backspace button to both layouts. Make testing paragraph lower so that users are able to see it easily.
Shinyee Lin

  • Add a panel with a scrollbar that shows multiple pictures like a simple photo gallery.
Robert(Feiyu) Miao

  • Implement the function of movable ray emitters.
  • Find the appropriate logrithmic function to map the length of ray to the distance between two controllers when user are changing the length of ray.
  • Since Powen has given me the prior demonstration environment, I will try to implement it into the new project.
  • Fix possible bugs.