Ingration mobile app with Google Assistant - android

do you guys know if I could make an Ok Google mobile app that reacts for that popular phrase, then send it to Dialogflow or some Google- or self-like platform that processes voice input and then get extracted params and commands included in voice command into the app?
I tried with shortcuts.xml file but it works only in App Actions Test Tool in Android studio. When I tried it with Google Assistant logged in on the same Google account it didn't work. Same after uploading app into Google play (still the same account) as internal tests. Google Assistant didn't recognize my custom intents as all.
I also tried the Google Actions Console project and Dialogflow project but when in first case I can upload it so it is available only for me in the second case I can't access it anywhere.
I try to make Smart Home app so it must handle intents like "Switch light on/off in the kitchen" and similar to it. I must connect Google Assistant voice control with my home app. I already have Java mobile app and C# desktop app (this one controls physical devices).
If you could propose some solutions to that problem I really will be grateful.

Related

How to publish an app which only works if there is a direct connection to our machine via wifi (Google Play Store and App Store

I have developed an app that communicates with our machine via Wi-Fi. You can think of it like an app that is used at car gas stations, such as Shell, Fillibri or the ryd app. This means that the app can only be used when the customer is in front of our machine. If the customer is not directly in front of our machine, the app cannot be used and the customer only sees a message.
My question:
How can I implement an access for the app review in the app stores, since the app only works when the app is connected to or machine via Wi-Fi.
I didn't find something in google.
Had same problem:
Apple: Rejected the app, then we provided them with a video link that show every feature in the app and we explained that it is can not be used without the related hardware. we had to film a user using the app from another phone (not screen recording). make sure the video is clear and not shaky, and provide a full text step-by-step explanation of the cycle.
Google Play: Did not reject the app, but we provided the link to the same video anyway in the "Needed credentials" section
We had a similar product. The solution is not exactly simple. We shipped the machine to Apple / Google so the reviewers can use it to test / validate your releases.

Use Google Assistant to directly talk to my Android app and execute a very simple task

I am working on a project to integrate the Google Assistant with an existing Android app. The requirements are simple. Assuming my app is named TestApp and I want it to just change the background color of the app home page, I want to be able to say,
"Hey Google, Change background to black on TestApp".
I was given links to ActionsSDK, but looking into it, I see that it is only a stand-alone app that extends Google Assistant and has nothing to do with android itself.
The closest API I found that does what I need is the Voice Interactions. This is very similar to what I need done but it only allows preset voice triggers such as "call this person..." or "set alarm at...", but cannot do "change background..." like in in my example. According to this link, custom voice actions aren't allowed.
So my question is, is it possible to directly interact with my app and have it do a very simple task?
Thanks
You may want to connect an Android app property with your Actions project to sell your digital goods in the Play store. Implement digital transactions to sell your Play store items as part of a conversation with your Action.
To connect an Android app with your Actions console project, you will first need to connect a website to your project. Follow the instructions provided above in Connecting a website.
Once you've connected a website, under Android app, click the Connect App button and follow the instructions shown. Once you have completed the instructions over in the Play console, it may take up to 24hrs before the connected Android app is reflected in the Actions console.
Try this in Action on google
Right now there is no way to do communication between Android App and Google Assistant. If your GA is built upon Dialogflow API (specifically not using action-on-google), then you can use Dialogflow Android client in your Android App to communicate with Dialogflow Agent.
I wrote an app for my own use to brighten the screen when I was in bright sunshine and could not see the screen by asking the assistant to launch the app. Then on launch I executed code to make the change. A cheesy work-around I know :-)
you can try using this
[1]: https://docs.slanglabs.in/slang/
This will allow you to perform several actions through voice inside your app. You can use the console to add actions and utterances and there are some sample apps which might help you.
I have used it in a lot of my apps.
Feel free to reach out in case you need help, good luck!

Can the Google Home hardware communicate directly with an app on the users device?

I have been recently looking into the google home hardware and would like to build an assistant app that communicates between the google home hardware and an app on the users device, so far what I have been able to find is that an assistant app can be built that works with a webhook to a backend but not directly to an app on the device which is what I want, is this possible or has this capability not been added as of yet?
Such a feature does not exist, nor is it really likely to exist in the future in the way you describe. Google Home is just one device that supports the Google Assistant, and many of these others have other setup and linking abilities and requirements.
You don't indicate what your use case is, but it sounds like you might want to investigate Account Linking which will let your Action key data (such as commands) against your user's account id. You can then use something like Firebase Database or Firebase Cloud Messaging to update data or trigger an event in your app.

integrate google assistance in android application

i am Totally freshers in integrate google assistance into android app.i have task to integrate google assistance into android application.i am researching from last 3 days.i have some question need to clear first.
Here they are.
I have application that handle one machine via Bluetooth.in application there are four buttons that perform different action.Now here i have to do.
suppose i speak "Ok google,let me talk to [some invocation name]"
then it will redirect to my application and perform some action.
How can i do this ?
Help me for this.
Once Your Assistant app is approved by Actions on Google, then your api.ai agent will be available to anyone through 'Ok google'. So, when you speak "Ok google, let me talk to [some invocation name]" then it will open up your agent. So you have to implement your api.ai agent for your machine controlling thing.
I think you can use webhook option in the api.ai to sent control commands to a 3rd party and you have to use that 3rd party to control your machine. This 3rd party can be your android application and you can use push notification or something(use any communication method with android application) to receive commands from api.api agent and do the controlling of your machine.
And also I don't think google assistant will open up your mobile app when you say "Ok google, let me talk to [some invocation name]". Google assistant only open ups the agents that we registered in 'Actions on Google'.
You can try with 'Google Assistant SDK' and try to implement an android app. But still there is no android documentations or samples for that.
Also I think using Google Assistant gRPC API, you can develop some standalone google assistant solution.
https://api.ai/
you will have to read the documenation of googles new converstion api. There you will find answers for your questions.
This is a very fresh topic since google just released the api a few days ago.

Launch app with parameters with Google Now

It's possible with Google Now (with voice command) to open app with parameters?
Example:
I have an app that can controls an alarm, named "Alarmed"
Can I say:
"OK google , 'command' app" -> Then open app and pass data 'command' to the app "app".
Thanks!
Nope! Thats not available to all developers quite yet.
Google decides what goes in for some reason.
As you can see here from google.
And more recently.

Categories

Resources