I'm trying to build an AR Android app that uses Vuforia + jPCT-AE.
The jPCT is being used because it makes it easier to use objects exported from Blender, and dramatically reduces the code verbosity (when compared with vuforia stand-alone).
I would like to introduce the possibility to display a video along with different objects (e.g. a banana and a monkey ) that were rendered using jPCT-AE, however I haven't found any clues (documentation) on how to do this so I'm asking for you help and knowledge.
Thanks in advance!
Use of vuforia video playback in this link:
Advanced Topics
The samples below show how to implement sophisticated rendering techniques in Unity and OpenGL ES to enrich your app with creative effects. A project to show you how to work with C++ on Android is also available.
...
Video Playback
Related
Is there any best way to record screen video in Unity? There is an Everyplay plugin/tools, but I found a message on forum that the service will be shutdown in near future (here) . So is there some options to record video from the screen(or unity Camera on scene) to android/ios device? Thanks.
We've built an open-source GIF-recording project: https://github.com/getsocial-im/getsocial-capture. C# examples are in the readme. It records main camera by default.
You can record in 2 modes:
Continuous mode - capture X last frames.
Manual mode - capture frames on your own when needed. For example, record a timelapse of the level.
Here's the recording of a game session from the test app. The recorded GIF preview shows up in the end:
If you want to mimic the social community of Everyplay, you can also check out our social layer tools (Activity Feeds). Disclaimer: I'm from GetSocial.
Did you take a look on the FFmpeg Unity Asset? This should work for Android and iOS: https://assetstore.unity.com/packages/tools/video/ffmpeg-unity-bind-93622
The Asset also has a lot more functions that you'll maybe need, too :-)
(CURRENTLY ONLY FOR ANDROID, WORKING ON THE IOS)
I created a Unity Asset for screen recording which is free to use and easy to integrate with Unity. I am still working on it and hopefully add more features. This plugin will only work on Android(Lolipop or above) devices. I also posted a video tutorial on how to integrate it on your unity project
ASSET DOWNLOAD LINK: https://drive.google.com/open?id=1pIN5q30XOy4RXfUsb3J2rBBF4cqlc-ZR
Tutorial LINK: https://www.youtube.com/watch?v=j3zGzbe9V1o
NOTE: The core plugin was developed by Kim (https://github.com/thanh-nguyen-kim/Unity_Android_Screen_Recorder) which I used to create the .asset file.
Hope it helps.
I have sucesfully implemented face detection in my app using Android's Camera.FaceDetectionListener (following the Android Developers guide), but unfortunatelly some devices does not support this feature. Is there another way to achieve the same result?
I usually work with OpenCV to make image processing algorithms.
http://opencv.org/platforms/android.html
Its algorithms are much better than Android face detection, besides if you download the SDK you have a faceDetection example.
Here are the downloads:
http://opencv.org/downloads.html
The sdk, handles camera api 2, which it works at 30 fps, with a wrapper if you want to process video frames. Besides there are samples where you can mix Java OpenCV code with JNI code, to make so much faster your algorithm.
Unfortunately, these examples are made on Eclipse projects, but they are not difficult to merge into Android studio project.
I hope that these references are useful
Cheers.
I'm trying to decide which library to choose in order to create app that can
filters a video, for example beautify or clarity.
During my search I came across 2 candidates: OpenCv and FFmpeg, and I found a complete framework only for FFmpeg(so +1 for this).
I couldn't found a complete comparision between the two so if someone has tried them and can post the answer it would be really helpful.
Edit:
Another candidate is Marvin framework(Java project) for Android - https://code.google.com/p/android-image-filtering/
OpenCV is a framework for Computer Vision and it's very limited for what you need because it requires you to write most of the cool filters yourself. Nevertheless, it provides a few techniques to blur images, change contrast, convert to grayscale, flip, crop, threshold, erode, dilate, resize, rotate, isolate colors, composite, and few other things. Just so you have an idea of how to implement filters, I recently implemented a Displacement Map Filter using OpenCV.
FFmpeg has a few filters as well, but it's meant to be a cross-platform solution to record, convert and stream audio and video, which means it doesn't really offer many filter effects.
Nevertheless, both APIs can read video (files and stream from camera) on Android and provide access to the video frames so you can execute your custom filters.
I believe the technology that can really help you bring a large collection of filters to your application is ImageMagick. Note that ImageMagick doesn't handle videos, so you can use Android's native API, OpenCV or FFmpeg for this part. Here are a few examples of what you can do with an image using ImageMagick from the command line, a program interface, or script:
there is a very useful OpenGL ES 2.0 library for video processing with many filters for ios
GPUImage for Ios
the android wrapper is here :
GPUImage Wrapper for Android
The GPUImage framework is a BSD-licensed iOS library that lets you apply GPU-accelerated filters and other effects to images, live camera video, and movies. In comparison to Core Image (part of iOS 5.0), GPUImage allows you to write your own custom filters, supports deployment to iOS 4.0, and has a simpler interface. However, it currently lacks some of the more advanced features of Core Image, such as facial detection.
Is there some free and easy to use 3D library for iOS (and Android) that simplifies Open GL ES framework. Just like there is cool WebGL library: ThreeJS for javascript.
So far I saw Unity but it's not free and I would like something simplified.
My usage would be setting the scene, meshes, camera, rotating the camera etc...
For Android you can use AndEngine which supports GL ES1 and GL ES2. For IOS you can use Cocos2D.
I decided to go with Cocos3D because it has all the features I need and is similar to JS libraries. It is free and you don't have to use any special engines with it.
Well, there is Sparrow for iOS, and as for Android you can consider AndEngine
(easier) or LibGDX (faster).
One option I believe is SiO2.. And Oolong too.. I once played with blender and SiO2 and it went well..If you are only interested in 2D games only then Cocos2D is best bet for iphone..
For android AndEngine is good,and I believe SiO2 works for android too..
Ahh, Unity did give away the iOS/Android versions back in March/April this year - maybe if you asked them nicely?
OpenSceneGraph has a large and active following in the Vis/Sim community, and is starting to creep into games, here's a couple iOS/game related topics from their forums:
http://forum.openscenegraph.org/viewtopic.php?t=10291
http://forum.openscenegraph.org/viewtopic.php?t=10308 (p.2 of this thread has links to a couple osg-based games in the iTunes store)
For Leaning very basic of open GL for iOs I would suggest to have a look at this http://antonholmquist.com/blog/opengl-es-2-0-ios-tutorial-getting-started/. This gives the basic idea of vertex and fragment shaders. After going through this a beginner can go through other tutorials which explains the detailed concepts of openGL.
I have gone through so many links but this one explains the basic really well.
I saw this live 3d wallpaper and was wondering how it is made, e.g. what engine should be used to make it? From what I found, Unity3D currently does not support making wallpaper...
If you would like a true 3d live wallpaper, you can check out Rajawali here:
https://github.com/MasDennis/RajawaliWallpaperTemplate
Follow his tutorials and utilize that template and you can make some really amazing live wallpapers. I use it myself and found it very fun and educational.
Check out this live wallpaper made with the Rajawali library:
https://play.google.com/store/apps/details?id=com.PM.AutumnGrove3DFREE
It's not mine but it definitely shows the potential with the Rajawali library.
Hopes this helps you and anyone else looking to make a 3d live wallpaper.
I don't know if you can make 3D wallpapares, but try with
AndEngine
or
Cocos2D
Checkout Unity3D and the Unity2Eclipse plugin, it's the easiest way I've found. Be warned, it's still beta and you have to use Unity 3.4 to get it to work. I see a lot of Unity crashes in my error reports and my retention rate is pitiful
I've got some examples of what you can do if your into Sharks, Neon, Zombies and Birds they are worth checking out http://www.app8ite.com/live-wallpapers/
You can use Uni2LwP (not free) and Unity3D. This new plugin works very well with almost every version of Unity.
Check dev thread for more information : Forum
From analyzing the screenshot you've provided, it seems like a pretty simple scene, with some post-effects added on top of the final image. Unity engine makes it easy to do stuff like that, with its visual editor, good asset import pipeline and post-processing chains. There are others engines that you could use to achieve similar visual quality (Rajawali is a particular good example), but it'd be a much more tedious task.
The negative side of using Unity is that it is somewhat heavy - it's expected to have an APK of around 9 MB in size for an empty scene. This doesn't really matters if you have a resource-heavy live wallpaper, though.
I've recently released uLiveWallpaper - a Unity asset that makes it possible to create live wallpapers for Android using Unity 5. It is well-tested and reliable, creates projects for Android Studio, complete with placeholder code to get you started.
Check it out!
http://forum.unity3d.com/threads/ulivewallpaper-develop-android-live-wallpapers-with-unity-5.375255/