Dataset Syncing

Randall Berg -

Wondering how data is uploaded into BrightGauge and how often?  Well you’re in the right place. This document talks about all of that and more!

BrightGauge is a hub to connect many different datasources and many different types of data into one place, so it’s important to have a better understanding of how and when this data comes in.  BrightGauge pulls your data in through datasets.  These datasets determine what is pulled in as well as merge different parts of data together.  Want ticket SLA and time entries logged against a ticket in the same area?  No problem, you’ll find that in Ticket Statistics.  Need the machine’s OS information in the same row as disk information?  It’s all there in Disk Statistics.  

The datasets then have some syncing characteristics:

 

 

 

Automatic Syncing Explanation

By default, all datasets sync into BrightGauge once a day, at midnight (0:00 or 12:00 am) your local setting (this is set in your Account Settings portion within BrightGauge).  This ensures that anytime you are in the app, nothing is more than 24 hours old.  There is one EXCEPTION though, if there is a dataset that is not being used (defined by having no gauge built off of it) the dataset will not sync nightly.  This is to ensure we are not syncing and taxing your system (or ours) with unnecessary nightly syncs.

 

 

Dashboard Sync Frequency Explanation

We have faster syncing on the dashboards.  However, this only occurs when gauges are up on a dashboard.  Each gauge that is up on a dashboard is built off of a dataset.  Each reliant dataset on that dashboard then is put on it’s dashboard sync frequency.  Most datasets will sync every 4 hours, however some will sync quicker.   

The default datasets that sync faster are denoted by an asterisk at the start of their name.  These will sync every 5 minutes when up on a dashboard.  If you have an on-premise datasource, you can also set your own custom dashboard sync frequencies, just make sure to select one that is appropriate for the data you are querying (if it only updates once a day, then no need to have it sync faster.  

If it is a larger dataset, a longer sync frequency is required because it will take longer to sync).  No matter what dataset it is, there are a few places where you can determine it’s dashboard sync frequency.

 

 

Determining Sync Frequency

When you’re first creating a gauge:

 When you click on the info button for a gauge on a dashboard:

 When you’re on a dataset’s main page:

 

 

Manual Syncing Option

If you have a dataset that needs refreshing and isn’t on a dashboard, then you can force it to sync.  

Step 1 - Go to the datasets page:

Step 2 - Go to the dataset’s own page:

 

Step 3 - Click on the blue manual Sync button

Please note: the sync button only works once every 30 minutes per dataset, so make sure that your data updates are finalized before initiating the manual sync.

 

 

Reports Syncing

As of November 2015, any Gauge that is on a report that's scheduled will be synced at minimum 1 HOUR prior to the report being generated.  Now, if the gauge is on a dashboard that is syncing more frequently, it will be synced more frequent than the one hour.  

 

 

Alerts for Failed Syncs

As of October 2015, the only way to find out if a sync has failed or is failing overnight is to log in and visit the datasets page.  We will be improving these alerts and also "smart syncs" for retries later in the calendar year and into 2016. There will be incremental improvements ongoing.

 

I hope this information on dataset syncing helps!  If you have any more questions, please let us know at support at support@brightgauge.com.  If you have any issues with your datasets syncing, then have a look at this document.

 

Have more questions? Submit a request

Comments

Powered by Zendesk