Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dates incorrect for ESRI feature service #1666

Closed
bengannon-fc opened this issue Dec 9, 2024 · 1 comment
Closed

Dates incorrect for ESRI feature service #1666

bengannon-fc opened this issue Dec 9, 2024 · 1 comment

Comments

@bengannon-fc
Copy link

bengannon-fc commented Dec 9, 2024

Date fields do not appear to read in correctly for ESRI feature services. The same data is read in correctly by the sf package.

# Read in current fire perimeters from the National Interagency Fire Center
poly_url <- 'https://services3.arcgis.com/T4QMspbfLg3qTGWY/arcgis/rest/services/WFIGS_Interagency_Perimeters_Current/FeatureServer/0/query?where=1=1&returnGeometry=true&outFields=*&f=geojson'

# With sf as reference
library('sf')
service_sf <- st_read(poly_url)

# With terra to illustrate date issue
library('terra')
service_terra <- vect(poly_url)

# sf and terra dates differ - appear to use different origins
summary(service_sf$poly_CreateDate)
summary(service_terra$poly_CreateDate)
plot(service_sf$poly_CreateDate,service_terra$poly_CreateDate,
     xlab='sf date number',ylab='Terra date number')

# sf dates are correct
dates_sf <- as.POSIXct(service_sf$poly_CreateDate/1000,origin='1970-01-01')
dates_sf[1:5]
# [1] "2024-09-16 09:31:07 PDT" "2024-08-01 15:12:03 PDT"
# [3] "2024-07-07 16:52:58 PDT" "2024-07-23 09:22:27 PDT"
# [5] "2024-09-18 05:30:00 PDT"

# terra dates are incorrect
dates_terra <- as.POSIXct(service_terra$poly_CreateDate/1000,origin='1970-01-01')
dates_terra[1:5]
[1] "1969-12-30 19:50:14 PST" "1970-01-03 18:33:57 PST"
[3] "1969-12-09 20:14:52 PST" "1969-12-25 12:44:21 PST"
[5] "1970-01-01 15:49:07 PST"

Terra version information:

packageVersion("terra")
#[1] ‘1.7.46’
terra::gdal(lib="all")
#    gdal     proj     geos 
# "3.6.2"  "9.2.0" "3.11.2"
@rhijmans
Copy link
Member

rhijmans commented Dec 9, 2024

Thank you for reporting that. Fixed:

poly_url <- 'https://services3.arcgis.com/T4QMspbfLg3qTGWY/arcgis/rest/services/WFIGS_Interagency_Perimeters_Current/FeatureServer/0/query?where=1=1&returnGeometry=true&outFields=*&f=geojson'

library('sf')
service_sf <- st_read(poly_url)
library('terra')
service_terra <- vect(poly_url)
dates_sf <- as.POSIXct(service_sf$poly_CreateDate/1000,origin='1970-01-01')
dates_sf[1:5]
#[1] "2024-09-16 09:31:07 PDT" "2024-08-01 15:12:03 PDT" "2024-07-07 16:52:58 PDT" "2024-07-23 09:22:27 PDT" "2024-09-18 05:30:00 PDT"

dates_terra <- as.POSIXct(service_terra$poly_CreateDate/1000,origin='1970-01-01')
dates_terra[1:5]
#[1] "2024-09-16 09:31:07 PDT" "2024-08-01 15:12:03 PDT" "2024-07-07 16:52:58 PDT" "2024-07-23 09:22:27 PDT" "2024-09-18 05:30:00 PDT"

netbsd-srcmastr pushed a commit to NetBSD/pkgsrc that referenced this issue Jan 5, 2025
# version 1.8-5

## bug fixes

- `Spatsample(method='stratified', ext=e)` returned the wrong sampling
  coordinates [#1628](rspatial/terra#1628)
  by Barnabas Harris

- `spatSample(method='stratified')` could fail with small sample sizes
  [#1503](rspatial/terra#1503) by karluf

- transparency (alpha) did not work with RGB
  plotting. [#1642](rspatial/terra#1642) by
  Timothée Giraud

- rasterization failed on very large rasters
  [#1636](rspatial/terra#1636) by Mary
  Fisher, [#1463](rspatial/terra#1463) by
  Nic Spono and [#1281](rspatial/terra#1281)
  by Sebastian Dunnett

- `tmpFiles` only looked in the default temp files folder
  [#1630](rspatial/terra#1630) by
  smckenzie1986

- `where.min` did not work well if there were negative values
  [#1634](rspatial/terra#1634) by Michael
  Sumner

- `plet<SpatRaster>` now works for RGB rasters and rasters with a
  color table [#1596](rspatial/terra#1596)
  by Agustin Lobo

- `vect<MULTIPOINT WKT>` did not work properly
  [#1376](rspatial/terra#1376) by
  silasprincipe

- `compareGeom<SpatVector>` did not work
  [#1654](rspatial/terra#1654) by Jason
  Flower

- `buffer<SpatVector>` is now more accurate buffers for lonlat
  polygons [#1616](rspatial/terra#1616) by
  Roberto Amaral-Santos

- `terra:interpNear` used square windows, not circles, beyond 100
  points [#1509](rspatial/terra#1509) by
  Jean-Luc Dupouey

- `vect` read INT64 fields as integers, sometimes leading to
  overflows. [#1666](rspatial/terra#1666) by
  bengannon-fc

- `plot` showed a legend title even if none was requestd if title
  parameters were specified
  . [#1664](rspatial/terra#1664) by Márcia
  Barbosa



## enhancements

n- improved documentation of `writeVector` overwrite when using
  layers. [#1573](rspatial/terra#1573) by
  Todd West

- improved treatment of (supposedly) flipped rasters by Timothée
  Giraud [#1627](rspatial/terra#1627) and
  fchianucci [#1646](rspatial/terra#1646)

- added `map.pal("random")`
  [#1631](rspatial/terra#1631) by Agustin
  Lobo

- expressions can now be used in legend titles
  [#1626](rspatial/terra#1626) by Noah
  Goodkind

- `app` and `tapp` now emit a warning when factors are coerced to
  numeric [#1566](rspatial/terra#1566) by
  shuysman

- `plet<SpatRaster>` now has argument "stretch" for RGB rasters
  [#1596](rspatial/terra#1596) by Agustin

- `%%` and `%/%` now behave the same for SpatRaster as for (base R)
  numbers [#1661](rspatial/terra#1661) by
  Klaus Huebert

## new

- `patches` with option `valus=TRUE` can now distinguish regions based
  on their cell values (instead of only NA vs not-NA)
  [#495](rspatial/terra#495) by Jakub
  Nowosad and [#1632](rspatial/terra#1632)
  by Agustin Lobo

- `rowSums`, `rowMeans`, `colSums` and `colMeans` for SpatRaster

- `metags` for SpatRasterDataset
  [#1624](rspatial/terra#1624) by Andrea
  Manica

- `metags` for layers (bands) of SpatRaster are now saved to and read
  from GTiff files
  [#1071](rspatial/terra#1071) by Mike
  Koontz

- `global` has new effcient functions "anyNA" and "anynotNA"
  [#1540](rspatial/terra#1540) by Kevin J
  Wolz

- `wrap`, `saveRDS` and `serialize` for
  SpatExtent. [#1430](rspatial/terra#1430)
  by BastienFR

- `vect<SpatGraticule>` method suggested in relation to [tidyterra
  #155](dieghernan/tidyterra#155) by Diego
  Hernangómez

- `toMemory<SpatRaster>` and `<SpatRasterDataset>` methods
  [#1660](rspatial/terra#1660) by Derek Friend
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants