The VideoPlayerHelper API can support syncronization, but you'll have to roll your own solution for audio sync across multiple tracks. Video Playback relies on the native player available from the runtime context. So its features derive from those.

Thanks, but that question is talking about playing multiple video files simultaneously.  We don't really need to play multiple video files at the same time, but rather need the ability to play multple different audio tracks either synced with a single video, or address different audio tracks within a single video.

Hello,

All of this should be possible but is beyond the scope of this forum. Our sample uses the build in Android video playback mechanism. Take a look at http://stackoverflow.com/questions/6261576/multiple-video-files-simultaneously-playing-in-android which may be helpful to you. 

Thank you,

-Peter

We would need to be able to play them separately. For instance, imagine you had a quartet of singer's voices, and wanted the user to be able to selectively add singers to the mix.  In our case, we may be able to get away with a pre-determined order (e.g. add bass first, then soprano, then tenor in my made-up example), so if we were able to have multiple tracks, we could premix each.  e.g. we'd have 4 tracks, each one with 1-4 singers mixed together.  So, we wouldn't necessarily need to play the tracks simultaneously (althought that would be most flexible), but we definitely need to at least be able to swap tracks.

Do you need to be able to play the tracks selectively?  If not, can you render both as a single track and add that to the video track?

We are hoping to be able to sync multiple audio tracks with a video.  Has anyone tried this with this video component?  The way I see it, there would be a couple ways to approach it:

1) Don't put audio in the video. In each frame, query for the time in a "master" audio track, the other audio tracks, and the current time in the video, and seek the video and other audio tracks if the get out of sync by X.

2) Encode the video with multiple audio tracks, and play more than one at a time.  I don't know if it would be technically feasible to play multiple audio tracks simultaneously in a single video, or if one would have to swap between them.  In either event, there isn't currently an API exposed in the video component to do anything with the audio track(s) other than change the volume.  Any chance of exposing functionality such as this?

Thanks,

Patrick

Thanks @patch24 -- Using Handbrake with the "iPhone & iPod Touch" preset did the trick!

Thanks for that tip.

If you're still seeing problems after trying that please report back.

@patchedreality -Try using Handbrake exporting as mp4, but change the output file extension to m4v -then Unity won't mess with it.  Keep the .264 compression and AAC audio.  You can play with the rf value to get the file size down.  This was the only export pipeline that got rid of the scrambled image problem for me.

I tried converting the original .mov to a .m4v as well as a .mp4, and neither changed the outcome.  The video is still "striped".  Any ideas?  Is there any particular tool + settings I should be using to convert that video?

I've inquired with one of the lead Video Playback devs on this and he's responded that..

For maximum compatibility across platforms we recommend (on the readme.txt) to use H.264 for video encoding, AAC for audio encoding and that the everything should be packaged on an MPEG-4-like wrapper. We have found that ".m4v" works well on iOS, Android and Unity while ".MP4" often needs to be re-encoded when imported on Unity.

Things that the developers should stay away from: H.263, AVI, WMV, MKV.

I am experience a similar issue with video playing in a distorted fashion.  I am attempting to do something similar to what is described in this thread:

http://forum.unity3d.com/threads/48938-chroma-key-shader?p=771175&viewfull=1#post771175

I was able to get the shader and video referenced in that post to work within a Mac Standalone scene using a MovieTexture.  However, when attempting to play the sample video using the Qualcomm VideoPlaybackBehaviour, I get distored output, even when using the standard Unlit shader.

Here's a link to the original video:

http://www.noomuseum.net/mov/SoizicDoubleAlpha-674.mov

Thanks,

Patrick

What are the original formats of these video files?

And to answer your previous question. Vuforia relies on the player available within its runtime context, whether this is a native OS application or the Unity player.

I'm having an odd problem. I have two different quicktimes with audio that I exported through Quicktime Pro as mp4(MPEG-4) files.  One movie file plays find on the device using the new video playback feature, but the other one looks completely scrambled. -?  The audio plays fine for both too.  I've tried re-exporting, changing Quality settings on the movie files within Unity, but I can't get the second movie to work when built to device.  The movie in question also plays fine in the preview window within Unity.  Anything else I should look into?

Hi, I was wondering what all supported video file formats were?  Also, what limitations on bitrate etc?  Is it entirely up to the hardware to determine playability or is there a vuforia limitation?  Thanks!

If you have Eclipse installed, you can obtain the app's build and run session logs from the LogCat window. Otherwise you can use the ADB tool directly, which can be found in platform-tools within your Android SDK installation. http://developer.android.com/tools/help/adb.html

This command should write your log to a file ..

adb logcat -d > logcat.txt

Hello,

Are there any messages appearing in the logs? I can confirm the video plays on the HTC Sensation XE with Android 2.3.4 I have. If you don't see anything in the logs can you post your entire logs for the application run.

Thank you,

-Peter

I have the same problem.

hi David Beard,

Im running it on HTC Sensation 2.3.3

and

samsung galaxy pop 2.2.1

What i see is a loading hour glass.. but neither the video starts playing on texture or in full screen mode..

The hour glass image stays forever..

Thanks,

Mukundan G

GT-I9000 with Android 2.3.3 and MZ601 with Android 3.2

Which device and OS version are you running?

What are you seeing?

Hey NalinS,

I tried this on Android.. I think im missing something here..

Elixir.Bash

The same problem is also discussed here https://ar.qualcomm.at/content/adding-video-over-marker

Hi elixirbash

It should work on the free version of Unity AFAIK as do the other samples.

Are you on iOS or Android?

N

Hello ppreuss,

I tried the unity version of this Video playback sample..I pressed the play button  and it just shows the hour glass icon forever.. Am i missing something here. Or is it only for pro version (which i don thinik so).

Thank you

Elixir.Bash

Hello ppreuss,

I tried the unity version of this Video playback sample..I pressed the play button  and it just shows the hour glass icon forever.. Am i missing something here. Or is it only for pro version (which i don thinik so).

Thank you

Elixir.Bash

Yesss! Was that!! I remembered 5 secs after posting! Thanks!

Be sure to add the VideoPlaybackController script to your ARCamera - this handles touch events, which activate the various player states.

Hey there! I downloaded the unity version and works pefectly, buy when I try to add it to my current scene called AppuntAR, it doesn't play de video when I touch the play button. I can't understand what is it, because I'm copying everything.  Here you can se an screenshot! http://i.minus.com/iPv72pCSbniHx.jpg

Also its strange because its the same project, but different scene!!!!!!

Any ideas?

Pascual from Argentina

We are pleased to announce the release of the Vuforia Video Playback sample app. This app is available for native Android and in Unity for iOS and Android. The Android sample app can be found here. The Unity sample for iOS and Android can be found here.

Interesting. However grabbing the webcam stream and playing back an encoded movie of your choice is not the same thing. But deep down in pixel-pushing land it may be similar enough!

http://www.youtube.com/watch?v=Y9HMn6bd-v8
at time 2:54

Getting a video texture from within Uniyt3d will be apparently a feature in the upcoming 3.5
From:
http://blogs.unity3d.com/2011/06/16/unity-roadmap-2011/

Quote:

WebCam support

We’re adding support for streaming video from cameras or other input devices into a texture to allow you to develop augmented reality games, or for uploading pictures for integration with social networks or other online services. This was implemented at our last NinjaCamp week.

Hopefully it won't create problems between Unity3d and QCAR as they both try to grab the video stream...

I was looking for this functionality too and I found a guy who writes plugins for Unity and he has one that works on iOS. He is planning to port it to android. The plugin he has written is an augmented reality plugin however it's not exactly as it doesn't do tracking as far as I can tell. But it does include the ability to map the input from the camera or a stored video file to a texture on a 3d object within unity. I have no idea if you use it with QCAR if it will clash. the plugin is $75 though and I haven't bought it yet.

http://prime31.com/unity/

I'm afraid I won't be able to help with this. You may want to ask in the Unity forums, or search around their forums for other people who are trying to play video on mobile platforms. Here's one thread: http://forum.unity3d.com/threads/94132-Alternative-to-MovieTexture-on-iOS

- Kim

thanks kim , I have an idea of assigning a material to a plane then assign that material an image (a frame of a movie) and then change the image of that material in the Update function and build the illusion of the movie playing on that plane , I wanted to know what you think about this , do you think it's possible?
(I don't have much experience in scripting in unity)

None of the QCAR SDKs (Android, iOS, or Unity) provide a video rendering solution. You'll want to research playing video in 3D space, either using OpenGL ES (for native Android/iOS) or using Unity.

- Kim

thanks kim , is this possible at all with QCAR ? I mean can I use qcar android sdk to do that?
thanks

QCAR doesn't provide a solution for video rendering. If you can find a solution for rendering a video with a texture in Unity it should be easy to use it with QCAR.

- Kim

hellloooo :( , no way to do this?