Headline

  • [Subsystem 1]
    • Measured camera parameters (intrinsic and extrinsic) to use for triangulation
    • Wrote code to convert 2D body keypoints to 3D keypoints
  • [Subsystem 2]
    • The prefab which enables controller's laser module adjustable to different directions. Direction can be changed by interacting(grab) with right hand controller or pointing and grabbing a specific object in the scene, in the case, the laser will lock on the object which user moves their controller. The demo video will be updated when gif is uploaded.
    • The way of adjusting the direction of laser has been changed from angle detect to relative position detect, with a more intuitive user experience.
    • Laser will be hided when user are grabbing item, in addition, laser direction will not change the direction or position of the item grabbed.

Hanyuan Xiao, Hyuck Ju (Tommy) Kim

  • Calibrated camera to use in equation for triangulation.
  • Wrote python script to take 2D keypoints generated by Openpose and covert them into 3D.

Jessi Jia

  • Create a 3d keyboard with traditional keyboard layout. The key cubes are intractable with controller. Once controller touches the keyboard, a key is going to be generated and show up in input field.
  • Problems I was not able to implement OnTriggerEnter to make controller and key cubes intractable. One object has to be isTrigger and the other one cannot be isTrigger. Keyboard layout is hard to adjust. Initially, the keyboard is too big to interact with.

Huijun Jiang

  • Create UI menu system, there is a comparison between General menu triggering way and VR ways.
  • Create the VR menu, alternative way to trigger menu system, grab from the headphone and goggle glass positions to take the volume and goggle objects then if put the object to a specific menu object on the left hand, that will trigger the menu.

Hong Liu (Sherry)

  • This week so far, I have a scene to place the container and put layers in it. The layer is to represent the folders. So, I make three layers and I want to put the object in the layer. Make the object interactable, so when I hover the object, it will change the color and when I grab the object it can give me a haptic feedback. So, I can know I successfully grab the object. In order to grab the object, I give hand controller a direct interactor, so hand controller can interact with object.

Robert(Feiyu) Miao

  • Change the way of adjusting laser direction from relative angle to relative position, more intuitive user experience.
  • Deployed Oculus Rift.
  • Hide laser while user are grabbing item, which help the user have refined experience.
  • Research on how to avoid unnecessary physical colision and make item in hand at right position instead of influenced by direction of laser.
Hanyuan Xiao, Hyuck Ju (Tommy) Kim

  • Finish writing script to convert 2D to 3D keypoints.
  • Feed 3D keypoints to Unity and try making the avatar move as we do in the webcam
Jessi Jia

  • Change normal key cubes to complex key cubes
  • Design test for testing keyboard input speed
  • Add a 180 degree keyboard degree that’s better suited to VR environment
Huijun Jiang

  • Sockets for VR equipment.
  • Show General Menu using controller button.
  • Gestures for VR Equipment.
Hong Liu (Sherry)

  • place object in right place and make layers disappear if I approach the layer.
Robert(Feiyu) Miao

  • Implement the physical layers to avoid unnecessary physical collision.
  • implement the feature of controller laser length control based on controllers' interaction.
  • Laser should not be hided when adjusting length.
  • Implement proper layers to refine interaction of different controller components.
  • bug fix and new features researching...