How is Hatsune Miku's hologram synchronized with her band of musicians?

Discussion in 'Software' started by ElMoreno, Aug 19, 2018.

  1. ElMoreno

    ElMoreno Kapellmeister

    Joined:
    Jan 13, 2012
    Messages:
    373
    Likes Received:
    57
    Hello audioboyz,
    this time the challenge is a bit more difficult because it involves both audio and, I think, graphic animation.

    Can anyone tell me how they manage to synchronize Hatsune Miku's hologram with the band of musicians playing 'Live' on stage and accompanying her concerts? Is it the hologram that is synchronized on the band or does the band follow the movements of the hologram?


    I believe that there must be a sort of Midi (or SMPTE) track to which the hologram and the band are hooked... what is your opinion?
    Do you also believe that we can do this with LogicPro X or do you need a special software?

    Thanks for the answers and happy holidays...
     
    Last edited: Aug 21, 2018
  2.  
  3. No Avenger

    No Avenger Audiosexual

    Joined:
    Jul 19, 2017
    Messages:
    9,097
    Likes Received:
    6,350
    Location:
    Europe
    Maybe I keep it too simple, but where is the problem???

    At first, it's not a hologram, but a projected movie. Second use a DAW, a movie, a vocal track and a click for the drummer, done.
     
    • Agree Agree x 4
    • Like Like x 1
    • Interesting Interesting x 1
    • List
  4. ElMoreno

    ElMoreno Kapellmeister

    Joined:
    Jan 13, 2012
    Messages:
    373
    Likes Received:
    57
    Well, I do not know but I do not think it's just as simple as you say...

    Anyway I'm interested in how to do it because I'd like to incorporate that technology into one of my projects. So, if possible, it would be interesting to have a step by step explanation
     
  5. TW

    TW Guest

    It is that simple. Good musicians and they play to a click. There is no other way.
     
    Last edited by a moderator: Aug 19, 2018
  6. Baxter

    Baxter Audiosexual

    Joined:
    Jul 20, 2011
    Messages:
    3,909
    Likes Received:
    2,752
    Location:
    Sweden
    The video is synced with the music (backing tracks + live musicians). All musicians (usually) on stage has synced click track (and also often guide-tracks) in their monitoring system.
    It really is that simple.

    I've played many shows with backing tracks. It takes a bit of practice in the beginning, but after a while it becomes as natural as playing with/to any musician.
     
    Last edited: Aug 19, 2018
    • Agree Agree x 2
    • Like Like x 1
    • List
  7. lerkjurk

    lerkjurk Platinum Record

    Joined:
    May 22, 2014
    Messages:
    403
    Likes Received:
    297
    Location:
    Behind you
    somethings like-

    FACIAL ANIMATION SOFTWARE

    CrazyTalk is the world's most popular facial animation software that uses voice and text to vividly animate facial images. The brand new CrazyTalk 8 contains all the powerful features people love about CrazyTalk plus a highly anticipated 3D Head Creation tool, a revolutionary Auto Motion engine, and smooth lip-syncing results for any talking animation projects.

    Learn More- https://www.reallusion.com/crazytalk/

    Create click track projection video- drummer hear click track- learn song- perform
     
  8. nobodyspecial

    nobodyspecial Platinum Record

    Joined:
    Feb 4, 2017
    Messages:
    420
    Likes Received:
    200
    i don't think its a simple projections as you can see through her legs the lights from behind, ... so you never could do that and move her all over the stage (see further in the video) with a projection on screen .
     
  9. TW

    TW Guest

    It is a projection on a screen. Vocaloid/Miku is a Sony trademark. With that in mind, you can be sure one of the most expensive and best projection (holo) technology you can find is used.
    If you watch a fancam video you can clearly see the screen/projection
     
    Last edited by a moderator: Aug 19, 2018
  10. Baxter

    Baxter Audiosexual

    Joined:
    Jul 20, 2011
    Messages:
    3,909
    Likes Received:
    2,752
    Location:
    Sweden
    DILAD screen.

     
    Last edited: Aug 19, 2018
  11. No Avenger

    No Avenger Audiosexual

    Joined:
    Jul 19, 2017
    Messages:
    9,097
    Likes Received:
    6,350
    Location:
    Europe
    It's a semi-reflective/semi-transparent screen, several meters wide. That's why you can see through her/it and she/it can move from left to right.
    You may laugh, but you can try this yourself with a projection on a black mosquito net.
     
    • Agree Agree x 2
    • Interesting Interesting x 1
    • List
  12. Xupito

    Xupito Audiosexual

    Joined:
    Jan 21, 2012
    Messages:
    7,226
    Likes Received:
    3,995
    Location:
    Europe
    Obviously, the gear for the hologram/projection (whatever is called) must be crazy expensive. But the idea of how to sync I think it's simple like has been commented.
    Say, like @Baxter explanation.
     
  13. DarthFader

    DarthFader Audiosexual

    Joined:
    Sep 28, 2014
    Messages:
    907
    Likes Received:
    768
    Location:
    Atlantis
     
    • Like Like x 2
    • Interesting Interesting x 1
    • List
  14. artwerkski

    artwerkski Audiosexual

    Joined:
    Apr 20, 2016
    Messages:
    683
    Likes Received:
    544
    Location:
    Neptune
    Band plays to a backing track. As @Baxter said. 100%.
    ('audioboyz' I like that! .. sorry girls.. )
     
  15. nobodyspecial

    nobodyspecial Platinum Record

    Joined:
    Feb 4, 2017
    Messages:
    420
    Likes Received:
    200
    sometimes you must admit your mistake, and i do , my apologies, its a projection . but a damn good one
     
  16. Xupito

    Xupito Audiosexual

    Joined:
    Jan 21, 2012
    Messages:
    7,226
    Likes Received:
    3,995
    Location:
    Europe
    Me too. Be it audioboyz, audiogirlz or audioguyz.
    The queston is: do audioboyz cry? :dunno:
    Because I do, I'm a sensitive .. whatever I am:rofl:
     
  17. [​IMG]
     
  18. DarthFader

    DarthFader Audiosexual

    Joined:
    Sep 28, 2014
    Messages:
    907
    Likes Received:
    768
    Location:
    Atlantis
    Me too, but only when I read posts by art.movement.style
     
  19. Someware

    Someware Ultrasonic

    Joined:
    Nov 5, 2014
    Messages:
    78
    Likes Received:
    35
    As a bit of fun, I bought the Pocket Miku Synth a year ago on Ebay for £25 it's not exactly a classic synth, but it's very funny running it through my Moog Sub Phatty filter and using it as a freaky extra oscillator lol :rofl:Suprisingly well specced MIDI and has full GM sounds too......
    Pocket Miku
    [​IMG]
     
    • Interesting Interesting x 2
    • Like Like x 1
    • List
  20. reliefsan

    reliefsan Audiosexual

    Joined:
    Jul 31, 2014
    Messages:
    1,065
    Likes Received:
    938
    they had alot of rehearsals
     
Loading...