Scribd Logo
Upload

Welcome to Scribd!

  • Image 1

    Uploaded by

    scribd.cycling071
    3 views2 pages
    The document discusses the technical challenges of creating a real-time online music collaboration app. It notes that for the experience to be enjoyable, latency between players needs to be as close to zero as possible. While true zero latency may not be possible, the latency cannot be inherently larger than the human "feel" for responding to events. It also discusses using headphones to isolate each player's incoming audio from other players, and the need for echo cancellation processing to address delays from room acoustics. Each player would send only their individual audio to all others, and a final mix could be created and recorded in the cloud.

    Original Description:

    a

    Original Title

    image-1

    Copyright

    © © All Rights Reserved

    Available Formats

    ODT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses the technical challenges of creating a real-time online music collaboration app. It notes that for the experience to be enjoyable, latency between players needs to be as close to zero as possible. While true zero latency may not be possible, the latency cannot be inherently larger than the human "feel" for responding to events. It also discusses using headphones to isolate each player's incoming audio from other players, and the need for echo cancellation processing to address delays from room acoustics. Each player would send only their individual audio to all others, and a final mix could be created and recorded in the cloud.

    Copyright:

    © All Rights Reserved
    Download as ODT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    3 views2 pages

    Image 1

    Uploaded by

    scribd.cycling071
    The document discusses the technical challenges of creating a real-time online music collaboration app. It notes that for the experience to be enjoyable, latency between players needs to be as close to zero as possible. While true zero latency may not be possible, the latency cannot be inherently larger than the human "feel" for responding to events. It also discusses using headphones to isolate each player's incoming audio from other players, and the need for echo cancellation processing to address delays from room acoustics. Each player would send only their individual audio to all others, and a final mix could be created and recorded in the cloud.

    Copyright:

    © All Rights Reserved
    Download as ODT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    of 2

    On Thursday, July 2, 2020, Ananda Narayan <anandacontact@gmail.

    com> wrote:

    Okay, a few confusions so replying inline..


    Ananda

    On Thu, Jul 2, 2020 at 6:48 PM mark couling <mcouling@gmail.com> wrote:


    correct. you need speed of light sound from all players to all players.
    makes sense
    say you had an app, it would have to have a virtual mixer letting
    players set audio level FROM any of the other musicians (plus the
    musician themselves)
    here you mean a player can, like a usual dj, mix the different tracks from the
    other players so he hears the mixed output?
    Yes. Plus their own sound assuming they could be playing an electronic instrument.

    and send the signal TO all others for them to create a mix at their
    location.
    here, does this mean that the player is sending his mixed output to all others or
    the player is sending just his signal to all others?
    I think all players would only send their own or “solo” sound to all other players in the
    group. A cloud based recorder should record each of the solo tracks and allow a final mix
    to be created later or allow a real time listener to create their own mix of the available
    sources. In a commercial product I could see that a “broadcast mix” would be created by
    an “mix engineer” and streamed or /and recorded as a final stereo mix in addition

    with headphones to isolate them (echo cancellation processing


    would add yet more delays)
    can you tell me what "them" refers to here? the different tracks? and the echo is
    created because of the room's acoustics (room or place where the person is
    performing)?
    The headphones must be used to allow the player to listen to the incoming players of the
    virtual group. And allow the subject player’s instrument microphone to record only the
    subject player’s microphone. ( assuming an acoustic instrument being recorded by an
    iPhone mic or better separate microphone)

    yes, for it to be enjoyable for all latency must be as close to zero as


    possible
    this I am not sure - human ears, body and the entire experience, will surely
    have some form of least count for responding to events aka the "feel", correct?
    can't be truly zero right? but yes I agree that packets of data may have delays
    that may be inherently larger than this number as in your next point:

    (not easy if you are using copper, impossible? with packets of data)
    However we do something similar with a phone conversation so it
    may not be perfect but may be useable to the point of being
    FUNctional!
    yes agreed completely here. but if this is a commercial exercise, then we will
    also have to see how much fun this is compared to a real concert for instance,
    right? or else why would they pay for it?
    Agreed. But with a brother with an electronic drum kit in England , I kid
    standing in New York and me in Michigan and you in India we could test it out!
    In drawing it out I see that each user’s mix for their headphones needs to take
    place in the cloud so that it could be sent to the phone app as a single stream
    of data.

    Your other question in need time to process and answer

    You might also like