I am going to create an app for android that is going to extract data from a website. Like the app is connected to let's say google.com and the user enters a keyword and clicks submit then the search results will be extracted and sent to the app. Any idea how I can do this? I've tried jsoup but I can't seem to connect it. I searched that there are others who are having trouble with .connect(url).get(). I also tried HttpURLConnection. What tool should I use? Thank you
Related
I am trying to figure out if I can scrape an android app in a similar way that I would a website. For example, in scraping a website I might use selenium to control a browser and collect data from the HTML code.
I have downloaded the chrome extension ARC Welder, which as far as I can tell simulates the app. However I cannot figure out how to "control" the app (i.e. press buttons, scroll, collect information such as prices of products).
Can anyone help or point to some useful information? I can't seem to find an answer for this anywhere.
I am trying to interact with a website from an android application. More specifically I am trying to login to my online depot and retrieve different data like balances, profit/loss on current day and so on because I don't want to log on to the webpage manually every time I want to see how my stocks are doing. Unfortunately my bank does not have an android app for those purposes.
What I want is an app that automatically retrieves the information from the website and shows it as an notification. So I need to open the website, login with username, password and cookie and then find specific elements (e.g. by css selector).
So far I only achieved something similar with selenium webdriver on windows. Since selenium does not run on android I have to find another solution.
What I have look into so far:
HTMLUnit (not running on android)
HttpURLConnection + JSoup (not sure if this allows me to simulate clicks on specific buttons...)
Robotium (can it only be used for testing apps or also for my purposes?)
Are there alternatives? Can this be achieved with one of the listed tools?
Any ideas are appreciated. Cheers!
I want to know is there any way to check updates of a website regularly?
I am a student. My exam schedules comes in university web site .I don't wanna miss that. So is there any way I can check this details automatically? I am using android and Ubuntu. Please help me. I don't think that the website have rss feed.
The website http://changemon.com/ is one of many website trackers that will send you an email when a website element is changed.
If you prefer a more diy solution, there is always use a scraping tool such as scrapy (python) http://scrapy.org/ and create your own project.
Hi i new to android development i want to develop an android app for website which does not have JSON or XML API for providing data is it possible to get the data from the website as it updates to my android app please
Help even the slightest hint will be appreciated.i have Googled this but i didn't got proper answer
Yes, it is possible. You will need the following components:
The website won't notify you when something changes. Thus, you have to poll the website frequently to find out if something changed.
Since the website offers no API, you will have to download the HTML and parse it.
Using these keywords in your search, you should find lots of material on StackOverflow, e.g.
Android Polling from a Server periodically
How can I parse webpage content in Android
If you want to make an app for a website, then you will have to get that website and parse it and display the results however you want. A good example for this can be found under the Spring for Android's Github page
If the website you intend to parse is already available in the Spring social package, then the above examples will already provide you with the solution (or with something very close to it). But keep in mind that you can also do the same thing without Spring but you will have to parse the data manually.
Have enabled a function in my app which checks up to 12 serial numbers programatically from an android app built in app inventor.
Recently there has been a change in the website code, which has broken the function.
I am trying to analyse the actions that occur when the 'send' button is clicked on the web site.
Am using wireshark. Have managed to 'see' what occurs when button is pressed.
It appears the _VIEWSTATE variable has changed.
Does anyone know if that would break the app?
web site I am querying http://vppneuapps.volvo.com/ww/PIE/PIE.aspx?lang=en-GB
app I have built http://goo.gl/xZCPO (free download)
Any advice/ help greatly appreciated.
Question answered by myself.
Zip file for app inventor here