We use Firebase as our database on our Android app. We have 2 types of data:
Static data, which changes rarely (less than once a week).
Dynamic/Live data, which keeps on changing on a second-by-second basis.
We have enabled persistence so users can access the static data even when they are offline. However, doing this causes Firebase to cache the dynamic data as well; which means that, whenever any part of dynamic data is queried, and it has been queried before, the user first receives previously cached, stale data and then gets accurate, live data.
We only want persistence for the data under static references, and not for the data under live references. Is it possible to either:
Have persistence enabled only on a particular reference within the database, so that the live data is never cached?
Maintain 2 completely different database instances of Firebase on android, and have persistence enabled on only one of them?
You can use SYNC feature of Firebase. Just turn it off by adding keepSynced(false) and will do the job.
Brief Description:
Firebase synchronizes and stores a local copy of the data for active listeners. In addition, you can keep specific locations in sync.
Copy
Firebase scoresRef = new Firebase("https://dinosaur-facts.firebaseio.com/scores");
scoresRef.keepSynced(true);
The client will automatically download the data at these locations and keep it in sync even if the reference has no active listeners. You can turn synchronization back off with the following line of code.
Copy
scoresRef.keepSynced(false);
By default, 10MB of previously synced data will be cached. This should be enough for most applications. If the cache outgrows its configured size, Firebase will purge data that has been used least recently. Data that is kept in sync, will not be purged from the cache.
Link
Related
It is about Firebase's local cached data in Android.
If the Android user, has 1-2 years data in Firebase,
is there a way to enable, setup, or filter Firebase persistence in local,
so that it only create local cache for the last month ?
So we don't the whole data in local cache, but only the last month.
The Firebase local cache is not designed to be manually populated. It's managed automatically, and you don't have much control over what gets stored in it. It will store data from recent queries, and it will evict data that hasn't been used. You can't choose which data will or will not be cached - it work with everything or nothing at all.
The local cache is meant to be helpful when the user temporarily loses their network connection. It's not meant for full offline support.
If you need a cache for very specific data that you can control, you will need to build that yourself.
We are using firebase realtime database and I was thinking about implementing a cache locally to reduce repeated calls.
So I came up with an algorithm which involves room persistence library.
stream only the latest data from firebase
store in room cache
when requested fetch all data from room cache and return
But then I started thinking about the cache that firebase provides and started realizing that I might be able to avoid room library at all.
stream only the latest data from firebase
when requested call fetch data using a singleValueListener
Since we are using single value listener only the cached data would be fetched from firebase.
What are the drawbacks of using the second approach? I know that firebase cache is limited to 10MB so that might be one
The one big thing you need to know here is that the cache managed by the SDK is almost fully outside your control. You can set the size of the cache, and you could clear it by trying to find the database file it uses, but otherwise, you can't configure it.
If you write code on your own, will have to make every decision about how it works, and it will be a lot of code to get everything right.
Unlike in Cloud Firestore, where offline persistence is enabled by default, in Firebase realtime database to enable offline capabilities you need to use the following line of code:
FirebaseDatabase.getInstance().setPersistenceEnabled(true);
This means that you'll have by default a local copy of your database. So there is no need to add another one. So in this way you'll only get new data, otherwise everyhing is you get is from cache.
I wanted to store the specific path in Firebase database (JSON) in local phone storage, not all data at the realtime-Firebase database. Say I have a news-feed path for each user in my Firebase-database and I want to save only the news-feed which is specified for the user instead of loading whole useless data on the local storage of user's mobile.
I read this paragraph from the official Firabase site which mentioned that
The Firebase Real-time Database synchronizes and stores a local copy of the data for active listeners. In addition, you can keep specific locations in sync.
DatabaseReference scoresRef = FirebaseDatabase.getInstance().getReference("scores");
scoresRef.keepSynced(true);
If this is the solution to my question, then I can use this line directly without writing that line
FirebaseDatabase.getInstance().setPersistenceEnabled(true);
Those two bits of code are not really related. They don't do the same thing.
keepSynced(true) effectively keeps a listener active on the given reference, from the moment it's called, for as long as the app is running, so that the local version of the data is always in sync with the remote version on the server.
setPersistenceEnabled(true) just activates local caching of the data read by the SDK. When persistence is enabled, the app can still query data previously read. It takes effect for all data read by the SDK. While persistence is enabled, you can't control which data is cached - all read data is cached up to 10MB max. When the max is reached the oldest data will be evicted from the cache.
According to me the best way will be to parse the Firebase JSON data and map it into an object and then save only data that you need in a local storage (News-feed in your case), and then access it later whenever you need it.
For this, you can use Paper DB as a local storage to store specific data and use it whenever you need to. It stores data as a key value pair so you can access your data with the same key you inserted it with in the database. (Just like shared preferences work).
It stores data as cache in your local storage and uses Kryo serialization framework which is pretty fast for I/O operations.
Or you can also use Room (a google library) with SQLite to achieve this task.
Haven't tried Room but i think it will suite your purpose.
Here's the official documentation for Room
I am developing a chat app that uses firebase database to store data. The usual approach while developing a chat app is to keep the database nodes synced so that you access the messages offline. So the problem rises when I implement the firebase offline capabilities to keep the data nodes synced. Firebase suggests two required steps for accessing data offline:
Enabling disk persistance
this is enabled according to the documentation by using this line of code (in my case I add it in application class):
FirebaseDatabase.getInstance().setPersistanceEnabled(true);
and
Keeping a node synced
this is enabled by simply adding keepsynced(true) to any databasereference that you wish to keep synced, like this:
ChatNode.keepSynced(true);
What is the difference between the two?
According to the firebase team answers on this site, I deduced that:
1) (Disk persistance) stores the data on the device disk to use them when needed, and data is stored wether you write data or read data.
a) If you write data offline: data is stored on disk and is sent to database when you go online again.
b) If you read data offline: the listener that was read online and was kept in disk and stored, you will be able to read it offline from disk.
2) (keep synced true) will keep a database reference synced in 2 ways:
a) If you are also using (disk persistence) with (keep synced) you will be able to keep data synced on disk ... which seems to be the default behavior of (disk persistence).
b) If you are using (keep synced) alone then you only store to what is known as the app memory.
The problem
I did set both of the methods, but my app is now very laggy and slow and sometimes stops on its own.
The question
If all the things that I said above are true, then would this method of offline capability be a heavy load on my app?
If I kept many listeners synced and set persistence enabled, then would the disk become full of data? Should I clean the data? Is the data on disk cleaned by itself in both methods? Is data cleaned by itself from memory?
I want to avoid the lagging and slow response in my app, thanks for your help.
You are right about your assumptions. If you are using FirebaseDatabase.getInstance().setPersistenceEnabled(true); means that Firebase will create a local copy of your database which also means that every change that is made while you are offline, will be added to a queue. So, as this queue grows, local operations and application startup will slow down. So the speed depends on the dimension of that queue. But rememeber, Firebase is designed as an online database that can work for short to intermediate periods of being disconnected and not as an offline database.
Second, if are using many listeners, don't forget to remove the listener accordingly to the life-cycle of your activity like this:
databaseReference.removeEventListener(valueEventListener);
Is it possible that an application's listview updates the data from Firebase without even opening the application?
I am working on a restaurant application which has to work offline, so the user must NOT open the application to get the new menu, rather it must be updated automatically (whenever the user is connected to internet) even if the application isn't opened. Is it possible to be achieved?
I think you're confusing updating the DATA with updating the MENU. A menu is a rendered object - if you're driving it with a listview, naturally it won't be updated when the app isn't running because there's no reason to draw a listview update if the listview isn't being shown.
But you can absolutely update the data, and we do this in News Rush to give the user access to new data while offline, if they were online earlier. Just make sure persistence is enabled and run the same query that drives your listview. Make sure the path/params are identical. Persistence will remember that data and if the user is offline the new menu will still show correctly the next time the app is started.
You should update it outstide the app, but, you can enable offline capabilities,
Enabling Offline Capabilities on Android
FirebaseDatabase.getInstance().setPersistenceEnabled(true);
Firebase apps work great offline and we have several features to make
the experience even better. Enabling disk persistence allows your app
to keep all of its state even after an app restart. We provide several
tools for monitoring presence and connectivity state.
To keep data fresh:
Keeping Data Fresh
The Firebase Realtime Database synchronizes and stores a local copy of
the data for active listeners. In addition, you can keep specific
locations in sync.
DatabaseReference scoresRef =
FirebaseDatabase.getInstance().getReference("scores");
scoresRef.keepSynced(true);
The client will automatically download the
data at these locations and keep it in sync even if the reference has
no active listeners. You can turn synchronization back off with the
following line of code.
scoresRef.keepSynced(false); By default, 10MB of previously synced
data will be cached. This should be enough for most applications. If
the cache outgrows its configured size, the Firebase Realtime Database
will purge data that has been used least recently. Data that is kept
in sync, will not be purged from the cache.
Read more:
Enabling Offline Capabilities on Android