I have a garmin GPS 66st. I would like to use LIDAR data that is available to create an overlay to send to my GPS unit. I would use this similar to the birdseye view overlays. I've searched all over but cant find anything other than on open topography but the walk-through instructions are only for data sets that they have. I found other data i would like to use. thank you so much!
https://support.garmin.com/en-CA/?faq=cVuMqGHWaM7wTFWMkPNLN9
As with most things Garmin, the instructions are not all that clear. It almost sounds like the custom map is generated in google earth, is that correct? And what Garmin software are they referring to, is it Basecamp?
I have been working with LIDAR data for quite some time now, starting back in 2011. These techniques are not likely to be useful for you however
https://forums.gpsfiledepot.com/index.php?topic=2579.0
This map is the end result of many years playing around with similar techniques. It was not easy to make, the result is low resolution and although it works well in Basecamp and Mapsource, it's too complex to work properly on most garmin GPS units.
https://boydsmaps.com/lidar-in-the-pines-sd/
This (and other lidar-based maps on my site) are more like what you want to do:
https://online.boydsmaps.com/#15/39.7929/-74.9632/lidarHD
I have Garmin-compatible, downloadable versions on my other site, for example:
https://boydsmaps.com/lidar-in-the-pines-hd/
I'm currently building a new site for exploring LIDAR in three dimensions using WebGL.... so I'm all about working with LIDAR. :)
But (sorry) none of this really addresses your questions. The link that Red90 posted will allow you to make very small, simplistic maps, and it might be a good place to start, but is not really going to do what you want on a large scale. It is limited to making maps that are only 1024x1024 pixels. The unfortunate truth is, Garmin doesn't want you to make big maps like this, because they could compete with their own products.
What you want is called "raster imagery" - maps that are created from pictures of some sort, such as aerial imagery, scanned paper maps, etc. Here's a related thread that discusses some of the techniques and software.
https://forums.gpsfiledepot.com/index.php?topic=4556.0
Basically, you need some software that can read the LIDAR data and render it in the style you want. I use GlobalMapper, which is rather expensive. But qGIS is free and can do many of the same things. There are some other programs in the thread above that are more user-friendly (although less versatile).
After you have created the raster imagery, it will need to be converted to .kmz map tiles that are no larger than 1024x1024 pixels each. Different Garmin devices have different limits for how many of these you can use. My Montana can use a maximum of 500. There's some confusion about the 66 series since it's new. Was just discussing this with someone who heard that it can only use 100 tiles at a time, but you can have an unlimited number of maps like this. No confirmation as to whether that is true.
But regardless, it's a very limited format that's inferior to Birdseye in many ways. There's software that will allow you to create your own Birdseye imagery however, but it gets complicated. You need to have an active Birdseye subscription for this to work (which I think is already included with your device) and then you need to jump through a bunch of hoops to trick the GPS into thinking your map is "real" Birdseye.
I don't have the time to get into all the details, sorry. But will try to answer specific questions once you get started.
By LIDAR, do you mean the DEM (elevation) data provided by the USGS?
For that, I use GRASS GIS, which is free. If you choose to use that, I'd be happy to try to help.
I'm attaching a sample of a map I made using the DEM data and a topo map. Is the shading what you mean by LIDAR?
Boyd and MojaveMan - I appreciate you both taking the time to reply. Ive read up on most things you've published, Boyd, and its quite impressive. I dont know that my project is worth that much effort but you've created something stellar no doubt!
MojaveMan - attached is a sample of what I have achieved so far by following the instructions linked above. Its not as precise as I would like nor am I able to actually transfer it to the GPS unit. What you attached looks very similar to what I am trying to do, but I believe I am trying to add the DTM (terrain, bare earth).
Yes, I end up with something that looks just like that (I think...). I make a shade file by loading the DEM data into GRASS GIS, and telling it to project the sun in 3 different directions. I then merge the three different shade files to create something like the attached - a shade file for the Solatario in Texas.
That technique was borrowed from this PDF:
https://pubs.usgs.gov/of/2012/1171/pdf/usgs_of2012-1171-Gantenbein_p101-106.pdf
I download that data from the USGS National Map Viewer:
https://viewer.nationalmap.gov/basic/
The data product that I use for GRASS GIS is the "1/3 arc-second DEM" in .img format. If you would like to pick a specific area of interest I'd be happy to walk you through my process...
Quote from: MojaveMan on October 15, 2019, 08:56:48 AMThe data product that I use for GRASS GIS is the "1/3 arc-second DEM" in .img format.
Sorry, that is not LIDAR-based data. This is the very old DEM that (rumor has it) was originally created by painstakingly digitizing contour lines on USGS 24k topo maps. So, it's a "theoretical model" of the terrain, as opposed to LIDAR which is "imagery" that captures actual conditions on the ground. There's a huge difference here.
The USGS NED 1/9 arc-second product is derived from bare-earth LIDAR, and it represents a HUGE increase in the amound of data. For the same area, the 1/9 arc-second data will be 9x more data. I'm not familiar with the software you're using, but would assume it could handle 1/9 arc-second in .img format as well.
The 1/9 arc-second LIDAR has a nominal resolution of ~10 feet (~3 meters) per pixel, but it is now being replaced with very high resolution 1-meter LIDAR. This is the data I work with now myself. Compared to the 1/3 arc-second data you use, a map file of the same area would be about 80x larger! 8)
Anyway, it's all just DEM and the same software should work with it. The problem will be, the Garmin custom map format is so restrictive (due to the tile limit), you'll only be able to cover a tiny area with a map made from high resolution LIDAR data.
Do some quick math - we'll assume your device only supports 100 map tiles. Each tile can be no larger than 1024 x 1024 pixels (this is constant for all Garmin devices). So, let's say you make a map 10 tiles wide x 10 tiles high (total of 100 tiles). That will be a total of 10240 x 10240 pixels. And with 1-meter LIDAR, that's an area roughly 10km x 10km (a little over 6 miles x 6miles).
In the same scenario, using the lower resolution 3-meter (1/9 arc-second) LIDAR, you could cover about 19 miles x 19 miles. The only way around these limits is to create your own Birdseye imagery, which can be done with several programs (although most of them are not free). You might look at section 6 of my tutorial, although it is based on Mobile Atlas Creator. However, the information about tile limits (and getting around them) is applicable regardless of the software that you use.
https://boydsmaps.com/docs/Using-Mobile-Atlas-Creator-with-Boyds-Maps.pdf
According to this page:
https://www.usgs.gov/core-science-systems/ngp/3dep/about-3dep-products-services
the data set I am using is generated using either LIDAR or lsFAR. Unless I am misunderstanding what they are saying. Looking at my shaded topo, you can see many areas with details that are not reflected in the topo data at all - so I highly doubt the shade data was generated from the topo data.
Your math does hold, except for one thing: I can resize the files very easily and cover much larger areas with much smaller data. It really depends on the resolution you require...and as I have pointed out in past posts regaring Custom Maps, you don't have to put every custom map on the Garmin all at once. When I go to Big Bend, I load up my Big Bend maps. When I go to somewhere else, I just load those maps. Its not like I can cover a very large area in one trip....for something like the PCT, I could easily carry multiple microSD cards.
For my purposes, I think the data I use is more then adequate. I am able to massage the data quite a bit and what you see in those images is higher resolution than the original 1/3 arc-second. I have tried the 1/9 arc-second for some maps, but it isn't available everywhere, so I looked at what the 1/3 arc-second was providing me, was happy with that, and made it my standard around which I make my shade. Taking a look at the topo map I posted, I think my own shade is 100 times better than their layer of shade, and provides much more detail. At least, I'm very happy with those results...and I am my own customer :)
But it does beg the question - what form of output are you looking for, syncro? Will a custom map suffice? I have to wonder if there isn't some way of turning this into a format more readily consumable by the Garmin as some sort of transparency layer....
Quote from: MojaveMan on October 15, 2019, 09:30:04 AMYour math does hold, except for one thing: I can resize the files very easily and cover much larger areas with much smaller data.
Not sure what you're saying here.... you can take 1-meter LIDAR and resample it at 100-meters per pixel. Doesn't seem much point in doing that, the whole appeal of LIDAR is the details that it reveals on the ground. If you just want low-resolution shaded terrain, then you're wasting your time with LIDAR, just use the standard 1/3 arc-second stuff.
Didn't read that link carefully, but from what I gathered the isFAR data is only for Alaska. Did not see anything indicating the 1/3 arc-second data is LIDAR-derived. This is an old dataset, available long before LIDAR. AFAIK, they are not updating it anymore (with the exception of Alaska?)
Quote from: Boyd on October 15, 2019, 09:39:50 AM
Did not see anything indicating the 1/3 arc-second data is LIDAR-derived.
The 1/3 arc-second data is discussed in the "Seamless" section, which is part of the "Standard DEMs". If you read the section about the Standard Dems you will see:
"Seamless DEMs are produced by blending only the highest quality project data into a continuous terrain surface for the U.S."
And what is "Project Data"?
" Project-based DEMs are available for the full areal extents of projects when produced from light detection and ranging (lidar), or as one-degree blocks with overedge when produced from IfSAR."
I'm attaching an extreme close-up of the shaded topo I posted above. If the shade was based on the topo data, I don't think the detail that exists in the shade would be there...and when I put this image into google earth, there is, indeed, a knob there in the terrain just as the shade indicates.
By *sheer* coincidence, that shade is about 1 pixel per meter. I pulled it up in Google Earth, and that knob is about 57 meters across - and the pixel count is about 33 across by 47 tall.
Seems like the key to that is the disclaimer "when produced". But, really, I don't know. In the past 1/3 arc-second data was certainly not LIDAR. Maybe they are upgrading it? Regardless, 1/3 arc-second is very low resolution, about 30 feet per pixel. That will only be useful for providing a general idea of terrain at low zoom levels. It will not reveal interesting surface detail when you zoom way in.
But if that suits your needs.... nothing wrong with it. :)
Anyway, back to syncro - do you think a custom map here will meet your needs? Do you think this resolution is too poor?
As I mentioned in an edit to my last post, by sheer coincidence, its about 1 pixel per meter. BUT, its based on 1/3 arc second, and nothing I am doing is really improving on that original resolution beyond a simple resize.
Quote from: MojaveMan on October 15, 2019, 09:44:52 AMI'm attaching an extreme close-up of the shaded topo I posted above.indicates.
FWIW, here is an example of 1-meter LIDAR at full resolution
https://online.boydsmaps.com/#17/39.79034/-74.97244/lidarHD
This view would be equivalent to the resolution of 1/3 arc-second data (although it was created by down-sampling the hi-res imagery)
https://online.boydsmaps.com/#14/39.7904/-74.9724/lidarHD
The 1-meter LIDAR is especially interesting in my flat, coastal area because it reveals things you won't find on topo maps or aerial imagery, such as overgrown cellar-holes of old structures. You can see some examples in the beta version of the new software I'm writing:
https://online.boydsmaps.com/3d/#applePie/shader/94.62/149.70/166.84/13.87/-61.55/-4.27/-526/277/-1069/70/
Can you disclose your source for your 1 meter data, and about how much of the country is covered?
LOL, nothing to "disclose" there, it's available from the National Map, just like other elevation products. If available, you'll see 1-meter DEM listed in a search.
https://catalog.data.gov/dataset/usgs-national-elevation-dataset-ned-1-meter-downloadable-data-collection-from-the-national-map-
FInding coverage areas is frustrating on their site. They often show big polygons of available data, but when you look at the downloads, only a little corner of that area is actually covered.
But I think there are large parts of the US (maybe even the majority of it?) with no high res LIDAR data available at all (neither 1/9 arc-second nor 1-meter). Fortunately, there is very good coverage of my small state of NJ, and it's more than enough to keep me busy making maps. :)
Just catching up and a lot of great discussion, thank you. I dont think I cant respond to all of it but I certainly read all of it and appreciate the input.
I am interested in a custom map with fairly high resolution (able to detect features around 1-3 meters in size). The size of the map would cover maybe a square mile (or a few smaller ones) and the most important feature is the ability to view the map on my handheld GPS. Currently, I use LiDAR to pick points of interest and grab the GPS location of that feature and log it into excel. I then load that spreadsheet into a google map then save that file as a KML that then gets transferred to my device. When I am in the field, I am able to locate the POI just fine, but then have hard copy print outs of the LiDAR for reference...its not all that great bouncing between GPS topo lines and hardcopy LiDAR print outs.
As a response to the first reply in the thread, I was able to play around with google earth pro enough to do a decent overlay. It took a few trys but I was able to line up almost all features with my pins, however, I cannot transfer the overlay to my device.
Why were you not able to transfer it? Connect the GPS to your computer and open the Garmin folder. If necessary, create a folder named CustomMaps. Copy the Google Earth .kmz file to that folder.
You must use .jpg images for the .kmz, it will not work with .png images. Make sure that the image you created is no larger than 1024 x 1024 pixels. Also, only use letters and numbers in the filename. There's an old bug where a file named my_map.kmz would not work but mymap.kmz does work. This may have been fixed though, not sure.
I assume you already know where to find the LIDAR imagery, since you're already using it? If it has 1-meter resolution, then each map tile can be about 1km x 1km (1024m x 1024m). You can use 100 of these tiles at the same time.
For more versatility, you would download the actual DEM files from the USGS, then use some software to render them in whatever style you like. Sounds like MojaveMan has some ideas for this. I use GlobalMapper, which makes all of this trivial, and it can directly create the Garmin custom maps. It is expensive software however.
Again, look at the other thread i linked to: https://forums.gpsfiledepot.com/index.php?topic=4556.0
As discussed there, qGIS and mapc2mapc are useful tools for this. qGIS is free, open source software Mapc2mapc is not free however. g-raster is also mentioned in that thread, and is another tool that is worth a look. Again, it is not free.
https://moagu.com/?page_id=155
I would be happy to walk you through my process, if you would like.
You will need:
GRASS GIS: free open source fully capable GIS
https://grass.osgeo.org/
Imagemagick - open source image manipulation software
https://imagemagick.org/
A DEM from the USGS.
If you would like me to walk you through my process, let me know and I'd be happy to go step by step with you either in these forums or via email. Or, if you would like, just gimme some idea of the geographic area and I will give it a go to show you what an end-product can look like.
If you need help getting your .kml file into your Garmin, I'm happy to help with that, too.
First, did you use a .jpg for the image?
Second, how big is it in terms of pixels? If its larger than 1024x1024 pixels, you have to cut it up into smaller pieces - a process called "tiling" it (cutting it up into square tiles).
In case you don't already know, here's how to find 1-meter LIDAR. Go to the National Map download page
https://viewer.nationalmap.gov/basic/
Drag/zoom the map to the location that interests you
Choose "Elevation Products" (NOT elevation source)
Check the box next to 1-meter DEM
Click Find Products
If any 1-meter LIDAR is available for the area you're viewing, it will be listed
Not sure what happened, but when i was trying to transfer the map is just wouldnt take. i tried dumping it into the custom map folder, it was the right size, all that stuff. just turned on my GPS unit and its there even though it wouldnt acknowledge the transfer before.
I think for now, i have a method that works for me but may need to take up the offer to see your method, MojaveMan. Thanks again everyone!
So, I did a little bit of math to see how much area my maps are covering, and how many tiles they take.
A USGS topo map for the Big Bend area covers about 60 square miles, and takes 4981x5682 pixels (I converted the PDF to a .png at 250 dpi with imagemagick to get these pixel counts). That will be 5x6 tiles of 996x947 pixels each, right? Thats a total of 30 "tiles" of the 500 my Oregon 600 can use. I could fit 16 such maps on my Oregon (really a bit more), for a total of 960 square miles, or an area almost 31x31 miles. That isn't bad.
For the units that allow 100 tiles, that could still take 192 square miles, or an area about 14x14 miles. Still not too shabby, and plenty big for a camping trip.
Note this is NOT the resolution I used for the map I posted above where my measurements indicated about 1 pixel per meter. That is a map at 600 dpi. If I were to use a map at that resolution, they would take about 6 times as much space ("only" about 200 square miles in those 500 tiles the Oregon allows me). But the 250 dpi is really quite adequate for the Garmin's display...the USGS Topo maps are clear at that resolution, and the shade images I generate show nice details not present in the topo map itself...it all comes together quite nicely.
Given I tend to only concentrate my trips in much smaller areas, I can load up several topo maps for many different locations before ever having to worry about running out of space.
Quote from: MojaveMan on October 18, 2019, 12:03:32 PMNote this is NOT the resolution I used for the map I posted above where my measurements indicated about 1 pixel per meter.
FWIW, resolution is usually expressed as [units] per pixel - such as "meters per pixel" and not "pixels per meter". :)