hrbrmstr
/
metis-jars
Mirror von https://git.sr.ht/~hrbrmstr/metis-jars
1
1
Fork 0
Code Issues Releases Wiki Aktivität
Amazon Athena JDBC Driver Wrapper Supporting the 'metis' Package
Du kannst nicht mehr als 25 Themen auswählen Themen müssen entweder mit einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.
1 Commit
1 Branch
0 Tags
376 MiB
 
Struktur: a01ab3351f
Branches Tags
${ item.name }
Tag ${ searchTerm } erstellen
Erstelle Branch ${ searchTerm }
von „a01ab3351f“
${ noResults }
boB Rudis a01ab3351f
initial commit 		vor 7 Jahren
R initial commit vor 7 Jahren
inst initial commit vor 7 Jahren
man initial commit vor 7 Jahren
tests initial commit vor 7 Jahren
.Rbuildignore initial commit vor 7 Jahren
.codecov.yml initial commit vor 7 Jahren
.gitignore initial commit vor 7 Jahren
.travis.yml initial commit vor 7 Jahren
DESCRIPTION initial commit vor 7 Jahren
NAMESPACE initial commit vor 7 Jahren
NEWS.md initial commit vor 7 Jahren
README.Rmd initial commit vor 7 Jahren
README.md initial commit vor 7 Jahren
metis.Rproj initial commit vor 7 Jahren

README.md

metis : Helpers for Accessing and Querying Amazon Athena

Including a lightweight RJDBC shim.

THIS IS SUPER ALPHA QUALITY. NOTHING TO SEE HERE. MOVE ALONG.

The goal will be to get around enough of the "gotchas" that are preventing raw RJDBC Athena connecitons from "just working" with dplyr v0.6.0+ and also get around the fetchSize problem without having to not use dbGetQuery().

It will also support more than the vanilla id/secret auth mechism (it currently support the default basic auth and temp token auth, the latter via environment variables).

See the Usage section for an example.

The following functions are implemented:

  • athena_connect: Make a JDBC connection to Athena (this returns an AthenaConnection object which is a super-class of it's RJDBC vanilla counterpart)
  • Athena: AthenaJDBC`
  • AthenaConnection-class: AthenaJDBC
  • AthenaDriver-class: AthenaJDBC
  • AthenaResult-class: AthenaJDBC
  • dbConnect-method: AthenaJDBC
  • dbGetQuery-method: AthenaJDBC
  • dbSendQuery-method: AthenaJDBC

Installation

devtools::install_github("hrbrmstr/metis")

Usage

library(metis)
library(dplyr)

# current verison
packageVersion("metis")

## [1] '0.1.0'

ath <- athena_connect("your_schema_name")

res <- dbGetQuery(ath, "
SELECT format_datetime(timestamp, 'yyyy-MM-dd HH:00:00') timestamp,
        port as field, count(port) cnt_field FROM your_schema_name.your_table_name
        WHERE CONTAINS(ARRAY['201705'], date)
        AND port IN (445, 139, 3389)
        AND timestamp > date '2017-05-01'
        AND timestamp <= date '2017-05-22'
GROUP BY format_datetime(timestamp, 'yyyy-MM-dd HH:00:00'), port LIMIT 1000000
")