hrbrmstr
/
awsathena
miroir de https://git.sr.ht/~hrbrmstr/awsathena
1
1
Bifurcation 0
Code Tickets Versions Wiki Activité
rJava Interface to AWS Athena SDK
Vous ne pouvez pas sélectionner plus de 25 sujets Les noms de sujets doivent commencer par une lettre ou un nombre, peuvent contenir des tirets ('-') et peuvent comporter jusqu'à 35 caractères.
3 Révisions
1 Branche
0 Tag
44 KiB
 
Branche: master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Créer la branche ${ searchTerm }
de 'master'
${ noResults }
boB Rudis 7ab0acad60
v2 		il y a 4 ans
R v2 il y a 4 ans
man workgroup il y a 4 ans
tests initial commit() il y a 5 ans
.Rbuildignore initial commit() il y a 5 ans
.codecov.yml initial commit() il y a 5 ans
.gitignore initial commit() il y a 5 ans
.travis.yml initial commit() il y a 5 ans
DESCRIPTION v2 il y a 4 ans
LICENSE initial commit() il y a 5 ans
NAMESPACE workgroup il y a 4 ans
NEWS.md v2 il y a 4 ans
README.Rmd workgroup il y a 4 ans
README.md initial commit() il y a 5 ans
awsathena.Rproj initial commit() il y a 5 ans

README.md

awsathena

rJava Interface to AWS Athena SDK

Description

Provides R wrapper methods to core ‘aws-java-sdk-athena’ Java library methods to interrogate and orchestrate Amazon Athena queries.

What’s Inside the Tin?

The following functions are implemented:

  • collect_async: Collect Amazon Athena ‘dplyr’ query results asynchronously
  • download_query_execution_results: Use S3 to download the results of an Athena Query
  • get_query_execution: Get Query Execution
  • list_query_executions: List Query Executions
  • s3_download_file: Download a key from a bucket to a local file
  • start_query_execution: Start Query Execution
  • stop_query_execution: Stop Query Execution

Installation

devtools::install_git("git@git.sr.ht:~hrbrmstr/awsathena")
# OR
devtools::install_gitlab("hrbrmstr/awsathena")
# OR
devtools::install_github("hrbrmstr/awsathena")

Usage

library(rJava)
library(awsathenajars)
library(awsathena)

packageVersion("awsathena")

## [1] '0.1.0'

Basics

qx <- list_query_executions(profile = "personal")

head(qx)

## [1] "d287b857-5801-493e-a647-76b5cacdac71"
## [2] "cbaad9f0-9231-443b-82dc-4cd8c8fad21b"
## [3] "8e5d155f-4eda-44fa-b2a4-2245d71b7f41"
## [4] "fb1d48d3-6875-4681-b01e-c59a5a33377d"
## [5] "cb7d50fb-a2c7-4ada-a4f9-ea35fbbaf764"
## [6] "5ddc2339-1987-4890-a521-1cee09b1e291"

str(get_query_execution(qx[[1]], profile = "personal"), 1)

## List of 10
##  $ workgroup      : chr "primary"
##  $ query          : chr "SELECT \"tsday\", \"host\", \"receivedbytes\", \"requestprocessingtime\", \"proto_version\"\nFROM (SELECT \"tim"| __truncated__
##  $ context        : chr "sampledb"
##  $ statement_type : chr "DML"
##  $ state          : chr "SUCCEEDED"
##  $ started        : chr "19 Feb 2019 19:11:51 GMT"
##  $ completed      : chr "19 Feb 2019 19:11:52 GMT"
##  $ output_location: chr "s3://aws-athena-query-results-569593279821-us-east-1/d287b857-5801-493e-a647-76b5cacdac71.csv"
##  $ data_scanned   : num 351173
##  $ execution_time : num 1142

awsathenajars Metrics

Lang # Files (%) LoC (%) Blank lines (%) # Lines (%)
R 15 0.94 255 0.96 101 0.84 180 0.85
Rmd 1 0.06 11 0.04 19 0.16 33 0.15