Google Firestore Data Source Plugin for Grafana.

Grafana Firestore Data Source Plugin enables integrating data on Firestore on to Grafana dashboards.

It uses FireQL to capture user query that translated to issue queries on Firestore and construct results.

FireQL is a Go library to query Google Firestore database using SQL syntax.

Features

• Use Google Firestore as a data source for Grafana dashboards

• Configure Firestore data source with GCP Project Id and Service Account for authentication

• Store Service Account data source configuration in Grafana encrypted storage Secure JSON Data

• Query Firestore collections and path to collections

• Auto detect data types: string, number, boolean, json, time.Time

• Query selected fields from the collection

• Order query results

• Limit query results

• Query Collection Groups

Firestore data source configuration

Using datasource

It is built on top of the official Google Firestore Client SDK that will allow running queries Cloud Firestore database using SQL syntax.

Usage

FireQL can be used as a Go library or interactive command-line tool.

Go Library

An example of querying collections using SQL syntax:

import (
    "github.com/pgollangi/fireql"
)

func main() {
    fql, err := fireql.New("<GCP_PROJECT_ID>")
    //OR
    fql, err = fireql.New("<GCP_PROJECT_ID>", fireql.OptionServiceAccount("<SERVICE_ACCOUNT_JSON>"))
    if err != nil {
        panic(err)
    }

    // Now, execute SELECT query
    result, err := fql.Execute("SELECT * `users` order by id desc limit 10")
    if err != nil {
        panic(err)
    }
    _ = result
}

Command-Line

fireql [flags]

Example:

$ fireql --project $PROJECT_ID
Welcome! Use SQL to query Firestore.
Use Ctrl+D, type "exit" to exit.
Visit github.com/pgollangi/FireQL for more details.
fireql>select id, name from users limit 2
+------+------------+
|  ID  |    NAME    |
+------+------------+
| 1046 | bob        |
| 1047 | smith      |
+------+------------+
(2 rows)
fireql>

Read the documentation for more information on CLI usage.

Examples

Some cool SELECT queries that are possible with FireQL:

select * from users
select *, id as user_id from users
select id, email as email_address, `address.city` AS city from `users`
select * from users order by 'address.city' desc limit 10
select * from `users` where id > 50
select id, LENGTH(contacts) as total_contacts from `users`

See Wiki for more examples.

Installation

Homebrew

brew install pgollangi/tap/fireql

Updating:

brew upgrade fireql

Scoop (for windows)

scoop bucket add pgollangi-bucket https://github.com/pgollangi/scoop-bucket.git
scoop install fireql

Docker

docker run pgollangi/fireql

Go

go install github.com/pgollangi/fireql@latest

Manual

You can alternately download a suitable binary for your OS at the releases page.

Limitations

All of firestore query limitations are applicable when running queries using FireQL.

In addition to that:

• Only SELECT queries for now. Support for INSERT, UPDATE, and DELETE might come in the future.

• Only AND conditions supported in WHERE clause.

• No support for JOINs.

• LIMIT doesn't accept an OFFSET, only a single number.

• No support of GROUP BY and aggregate function COUNT.

Future scope

• Expand support for all logical conditions in WHERE clause by internally issuing multiple query requests to Firestore and merging results locally before returning.

• GROUP BY support

• Support other DML queries: INSERT, UPDATE, and DELETE

Thanks for the read! Try using this if you are working with Firestore and share feedback.

I have created a site to locate covid19 hospitals in India on map with details like beds availability, contact information and directions to the hospitals.

Idea is to bring all hospitals on the map so that any one quickly search nearby hospitals or search hospitals near to an address. And be able to navigate to it using the directions.

Site: https://covidhospitals.online/ GitHub: https://github.com/covidhospitals/covidhospitals

Features:

• Explore nearby hospitals using current device location
• Search address to look at hospitals around that.
• See hospitals contact details like phone, address along with beds availability
• Get directions to navigate to hospital location

Built With

• Leaflet
• OpenStreetMap
• ReactJS
• MapQuest

Source of Data

Currently hospital location, and beds information is being collected for AP, Delhi and most of the states in India. Feel free to volunteer to contribute the data adhering the JSON format.

Credits

• A big thanks Netlify for hosting the covidhospitals.online
• Thanks to npoint.io for hosting the AP hospital location data.

Please feel to make changes to the site and add more data sources to it. Any contributions are most welcome.

DISCLAIMER: FastGet performance heavily reliant on the network and CPU performance of the client machine. More importantly HTTP(s) endpoint must allow partial requests presenting Accept-Ranges and accepting Range headers.

Features

• Concurrent download of files over HTTP(S) if server supports Accept-Ranges. Otherwise, fallback to single thread download.
• Increase no. of concurrent workers to speed up download. Use flag --workers.
• Add curl like custom headers to authentifacte HTTP(S) requests. Use flag --header.
• Specify output file to write downloads. Default to file name of URL.

  Repo: https://github.com/pgollangi/fastget

  • Star if you find this tool useful.
  • Open an Issue if you come accross any problem using tool.
  • Submit a PR if you would like an improvement

Usage

fastget available as Commnad-Line tool and Go library.

Commnad-Line

fastget [options] <URL_TO_DOWNLOAD>

Examples

$ fastget http://speedtest.tele2.net/10MB.zip
Download started..
3.50 MB / 3.50 MB 100 % [====================================================| 0s ] 267.59 KB/s
3.50 MB / 3.50 MB 100 % [====================================================| 0s ] 165.65 KB/s
3.50 MB / 3.50 MB 100 % [====================================================| 0s ] 116.10 KB/s
Download finished in 3s. File: E:\10MB.zip

For more information on CLI usage, please refer pgollangi.github.io/fastget.

Go Library

Here is a simple example that finds fastest hosts:

fg, err := fastget.NewFastGetter("http://speedtest.tele2.net/10MB.zip")
if err != nil {
    panic(err)
}

result, err := fg.Get()
if err != nil {
    panic(err)
}
file := result.OutputFile
elapsedTime := result.ElapsedTime

For more information on library usage, please refer API documentation on pkg.go.dev.

Installation

Scoop

$ scoop bucket add pgollangi-bucket https://github.com/pgollangi/scoop-bucket.git
$ scoop install fastget

Updating:

$ scoop update fastget

Homebrew

$ brew install pgollangi/tap/fastget

Updating:

$ brew upgrade fastget

Go

$ go get github.com/pgollangi/fastget/cmd/fastget
$ fastget

Manual

1. Download and install binary from the latest release.
2. Recommended: add fastget executable to your $PATH.

Building from source

fastget CLI is written in the Go programming language, so to build the CLI yourself, you first need to have Go installed and configured on your machine.

Install Go

To download and install Go, please refer to the Go documentation. Please download Go 1.14.x or above.

Clone this repository

$ git clone https://gitlab.com/pgollangi/fastget.git
$ cd fastget

Build

$ go build cmd/fastget/main.go
$ fastget

Happy fastget!!