So it was suggested in another thread to split up the work to create a map for the state of Oregon. I figured I'd get this posted up in its own thread and see who is interested. I know that there was at least one volunteer to help, but anyone who is interested is welcome to help. I figure the best way to divide the work is to break it up into the different data types that are needed. I'll start by volunteering to process all of the contour information.
Borders: Oz - Done
Contours: Done
Federal Land: Oz - Done
GNIS/POI: Done
NHD: Done
Transportation: Oz - Done
Trails: Oz - Done
If anyone is interested in helping by processing any of this individual types of data for Oregon post here and I'll add your name next to that type and send you a message with a username and password for a FTP directory where you can upload the processed data. As far as what tools to use, I *think* most of us are suing Global Mapper, but I don't know for certain. If there are lots of others using different software let me know.
If this collaboration goes well maybe we can keep it up on other states.
Edit: Apparently Oz is also working on Oregon, so Still feel free to volunteer, but maybe wait to start anything big until we hear from him what he has and hasn't done so we don't duplicate effort.
Update: I am 1.3rd of the way to having the map done. In about 5 days I expect to be done. :) Will keep you posted.
Trans - done
I'll handle Trails (think they're on my external) and the forest service points
Borders - Oz
So, the question comes down to:
- Who will be compiling all the files together and converting to .img?
That is the part that takes the longest IMHO. I can also create an ftp user that can access a folder of this server (i think) so we can share files.
Well, unless someone else really wants to combine all of the data I can do that. I have more than one machine so losing one for a while to processing isn't really a hardship. As far as sharing files, I have already given dhisum_dhisum connection info for my FTP server. If you want I can give you the same connection info and you can upload the stuff your going to do/done or you can give me/whoever will do the processing a way to download your data. Either way works for me.
I have Borders, Contours, Federal Land, GNIS, NHD, and Transportation data processed for the lower 48 states. The data is compiled and cut on a 1/2 degree grid. My computer has been making the .img files for 3 weeks there are 1,256 done out of 3,524. Starting in the south and going east to west. I have not made a installer but I am up loading the Southeaster USA. The processed date is store in a 200GB PostgreSQL\PostGIS database. How can I help?
Well, if you have the NHD and contour interval data that would be a great help. I was planning on going with a 40 foot interval for the contours. If you have either the raw or processed data for lat and long that covers Oregon I could give you a FTP login to upload it to.
The contours where processed with a 20 foot interval, When I export the data I will only take the 40 foot intervals. Do yoy want one big shape file. I can try but that may be to big. So then it woould be shapefiles one degree square. The Land Contour (medium) is at the 100 foot interval and Land Contour (thick) is at the 400 foot interval. Is this OK? Will PM you may email. NHD data will be shapefiles one degree square.
John, so are you telling me you'll have a topo of the entire US in pretty much 24k quality?
Whoa, sorry guys, I got really busy at work, so I was not able to look here. Looks like stuff has been cooking while I was away. As I said, while people are collaborating, I could get nhd data for oregon and process it. And John says he has the entire lower 48... All I can say is Wow. That must have taken a hell lot of determination and processing. Let us know when/where the data is available. With so much data available, I don't even care about the installer. I would have a ear to ear grin just getting the img files.
Oz, I have raw and processed data lower 48 states. The making the .img files will run for
at least 6 more weeks. A note on processing time the data with out the contours ran in 4 days. The data with contours 2.5 to 3 mounths.
As far as quality please check and let me know. Southeast USA has been up loaded
Oz the what can be done with the data I got from your very good Tutorials. The work processing I use is run by bat files and SQL with some perl, and GDAL.
The data used in the maps
1. Elevation contours - 20ft intervals made from NED30
2. Streets from the 2008 Census Tiger data
3. Hydrography (NHD) from ftp://nhdftp.usgs.gov/SubRegions/High/ as of 12/08/08
4. Federal lands from http://nationalatlas.gov/maplayers.html
5. Indian lands from http://nationalatlas.gov/maplayers.html
6. POI's from NationalFile_20081228.zip
Ah, okay.
I am extracting SE US now; I'll probably play with it this evening.
Very very cool. I downloaded and tried out a few img files. Very very cool. Truly 20ft contours. Kudos to you John M. This is a spectacular feat. I will hold my breath for you and wait for the next 6 weeks to elapse pretty fast so I can have the entire lower 48.
John: I can't get mapsettoolkit to create the files so I can load it into Mapsource; have you tried this yet?
With that said: in 30 minutes you can download the transportation data: http://www.gpsfiledepot.com/oregon-transportation.zip its compressed to 174mb.
Ok, I'm going to start downloading the data and grabbing what is left. Thanks to everyone who has thrown in their data. As soon as I get it together I'll let everyone know.
I can do federal land if no one else wants to; i'll cut it to the state border as well.
I have uploaded borders, forest service trails, and forest service misc points: http://www.gpsfiledepot.com/oregon-data-2.zip (6mb)
No message yet so the federal lands have been cut and uploaded: http://www.gpsfiledepot.com/oregon-fed-lands.zip
Sorry for being slow, have been busy. I have downloaded the above data and also sent you the FTP connection info in case you need it in the future.
Today put in the request for the nhd data. Should probably arrive by monday and after processing, it should probably be uploaded by next weekend.
Quote from: John_M on January 31, 2009, 01:40:51 AM
3. Hydrography (NHD) from ftp://nhdftp.usgs.gov/SubRegions/High/ as of 12/08/08
I see you gave the above link for getting NHD data. I have been waiting for one little sub-basin for several weeks. I have re-requested it several times. I got tired of waiting, so I followed the above link to try to get it. When I downloaded the zip file, it gave me an access database. How did you use that to get the shapefiles you needed?
Ok, I didn't update the data assignment in the post. I have all the data, and have am about 1/3rd of the way to maphood. I'm probably about 2-3 days away from creating all of the img files, and about 4-5 days away from having the installable exe. When I'm done I'll make sure that all of the combined data gets posted somewhere public on my server so anyone who wants it can download it and tweak their own, as well as upload the installable exe.
Tsnake,
The "access database" is ESRI's geodatabase format. I have access to the ESRI ArcGIS software to convert the data to shape files. Tell me what you need and some place to upload it and I can probably get it to you. Or if some one has 15 GB of file space I can post the all the files.
John_M
I am looking specifically at NHDN1024. I do not know where to upload it unless OZ will let us load it here.
I did notice that Global Mapper will open the flowline database. I can then export a shapefile from that. When I tried to open the area and waterbody, Global Mapper told me no data was available.
Quote from: Tsnake on February 07, 2009, 06:32:24 AM
John_M
I did notice that Global Mapper will open the flowline database. I can then export a shapefile from that. When I tried to open the area and waterbody, Global Mapper told me no data was available.
I noticed this when I tried GM10 in December. Thanks to the NHD people (GM keep saying it was an NHD problem) checking out there end and sending screen shots to me and GM; GM fixed the problem:
Mark/Terry,
I dug into this and found that the missing features in the files were using a shape type code that I have never seen before and seemed to be a duplicate of codes that were supported in the library that we use for loading the MDB files from ESRI.
Luckily I was able to determine what they were pretty easily and get support added. I have placed a new build at http://www.globalmapper.com/global_mapper10.zip with the change for you to try. Simply download that file and extract the contents into your existing v10.xx installation folder to give it a try. This fix will also be included in the next Global Mapper release.
Let me know if I can be of further assistance.
Thanks
Mike
Global Mapper Support
[email protected]I tested it and it is OK now. Interesting that the 10 Beta version had been available for about 6 months and this was not found.
Try it with the latest version of GM.
mps4gps,
That did the trick. Thanks for the help.
OZ,
This might be worth a rewrite on the Water section of the tutorial. It is a lot more convenient than waiting for NHD to send a query. I simply opened the NHDArea, NHDFlowline, and NHDWaterbody MDB seperately. I then export each shapefile from GM10. NHDArea and NHDWaterbody as Areas and NHDFlowline as lines.
Tsnake
I'm having problems right now with ftp (being blocked on my computer). But once I have that I'll investigate this. Last time I tried I could figure out how to get just the areas I needed. Is there a list of subbasin ids to match it to?
Any updates on this krellor? Is there something I can help with wrt computing?
Hey, krellor; I"m working with florida but don't know how to add in the ocean. I have a coastline line file; but am not sure how to turn it into land. With hawaii I had an area shape for the islands which was easy; just draw an ocean and cut it out. I really need to include it because I have depth data for florida.
Some high resolution data is here: http://www.blm.gov/or/gis/data.php
especally transportation and federal lands
krellor,
I just want to thank you in advance for taking the initiative to do this. I live in Portland, and created a local biking map from USGS data, but it would be awesome to have the whole state! Had I known about this site and this project earlier, I would have offered to help.
kirkaptain
I'm interested in the Oregon maps - and I've a bit of computing power I can throw into the pool as well.
Anything I can do to help ?
What is the current status of this project?
I don't know what happened. Krellor just hasn't been seen here in a while. However, the oregon state is available as part of the NorthWest topo that John released here. It is pretty good with 20ft contours etc etc.:
http://www.gpsfiledepot.com/maps/view/134 (http://www.gpsfiledepot.com/maps/view/134)
will a macintosh version of the NW topo eventually be posted?
i am aware that i can convert it myself, but it will be a while before i have access to a windows machine
by the way, thanks again for all the hard work on this
hopefully allory will have a conversion soon that I can add
I don't think a lot of the Forest Service Points have names (sadly). But I can check.
Wasn't krellor the one that provided the contour data?
I may have done the nhd but can't remember... I'll look around
Just an FYI. The ownership data is quite a bit off at least in Central Oregon - it's seemingly very generalized. I would not trust it for establishing private verses public lands. The public lands ownership is far better in the US Planimetric - North West Map dataset: http://www.gpsfiledepot.com/maps/view/259/