| Title: | A Simple Web Scraper |
| Version: | 0.0.1 |
| Description: | A group of functions to scrape data from different websites, for academic purposes. |
| License: | MIT + file LICENSE |
| Encoding: | UTF-8 |
| LazyData: | true |
| RoxygenNote: | 7.1.1 |
| URL: | https://github.com/villegar/scrappy/, https://villegar.github.io/scrappy/ |
| BugReports: | https://github.com/villegar/scrappy/issues/ |
| Language: | en-GB |
| Imports: | magrittr, rvest, xml2 |
| NeedsCompilation: | no |
| Packaged: | 2021-01-07 12:14:03 UTC; roberto.villegas-diaz |
| Author: | Roberto Villegas-Diaz
 [aut, cre] |
| Maintainer: | Roberto Villegas-Diaz <villegas.roberto@hotmail.com> |
| Repository: | CRAN |
| Date/Publication: | 2021-01-09 14:20:02 UTC |
Pipe operator
Description
See magrittr::%>% for details.
Usage
lhs %>% rhs
Value
Result of the rhs expression.
Retrieve data from NEWA at Cornell University
Description
Retrieve Weather data from the Network for Environment and Weather Applications (NEWA) at Cornell University.
Usage
newa_nrcc(
client,
year,
month,
station,
base = "http://newa.nrcc.cornell.edu/newaLister",
interval = "hly",
sleep = 6,
table_id = "#dtable",
path = getwd(),
save_file = TRUE
)
Arguments
client |
|
year |
Numeric value with the year. |
month |
Numeric value with the month. |
station |
String with the station abbreviation. Check the http://newa.cornell.edu/index.php?page=station-pages for a list. |
base |
Base URL (default: http://newa.nrcc.cornell.edu/newaLister). |
interval |
String with data interval (default: hly, hourly). |
sleep |
Numeric value with the number of seconds to wait for the page to load the results (default: 6 seconds). |
table_id |
String with the unique HTML ID assigned to the table
containing the data (default: |
path |
String with path to location where CSV files should be stored
(default: |
save_file |
Boolean flag to indicate whether or not the output should be stored as a CSV file. |
Value
Tibble with the data retrieved from the server.
Examples
## Not run:
# Create RSelenium session
rD <- RSelenium::rsDriver(browser = "firefox", port = 4544L, verbose = FALSE)
# Retrieve data for the Geneva (Bejo) station on 2020/12
scrappy::newa_nrcc(rD$client, 2020, 12, "gbe")
# Stop server
rD$server$stop()
## End(Not run)