• Which the release of FS2020 we see an explosition of activity on the forun and of course we are very happy to see this. But having all questions about FS2020 in one forum becomes a bit messy. So therefore we would like to ask you all to use the following guidelines when posting your questions:

    • Tag FS2020 specific questions with the MSFS2020 tag.
    • Questions about making 3D assets can be posted in the 3D asset design forum. Either post them in the subforum of the modelling tool you use or in the general forum if they are general.
    • Questions about aircraft design can be posted in the Aircraft design forum
    • Questions about airport design can be posted in the FS2020 airport design forum. Once airport development tools have been updated for FS2020 you can post tool speciifc questions in the subforums of those tools as well of course.
    • Questions about terrain design can be posted in the FS2020 terrain design forum.
    • Questions about SimConnect can be posted in the SimConnect forum.

    Any other question that is not specific to an aspect of development or tool can be posted in the General chat forum.

    By following these guidelines we make sure that the forums remain easy to read for everybody and also that the right people can find your post to answer it.

P3D v5 create accurate water polys using scenProc?

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Hi,

To be honest the weeks since I have returned from vacation have been very busy with both work and family things, so I have not been able to sit down and work on this new feature a lot. I have some good imagery with NIR channel laying around that I can use for testing so that should not be the challenge.
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Hi,

Motivated by this reminder (and sorry for the other users who's bug now has to wait a little longer :D), I had another look at my progress with water detection tonight.

Let me explain you what I am doing. I am adding additional steps to the texture filter so that you can implement different water detection strategies. One of them in the Normalized Difference Water Index (NDWI) and the other is the Two Step Urban Water Index (TSUWI). The NDWI is slightly simpler to use, but the downside is that it sometimes detects areas with lots of shadows or flat roofs as water as well. The TSUWI seems to perform better for that, if you can get the right thresholds tuned for the imagery of your area.

Below are some screenshots of test images that show the differences. As you can see they vary in how much water got detected, how many false detections there are, etc. I don't know what you want to use the detected water for in your scenery, is it to make the watermask? In that case it is probably better to miss a little water than to have a lot of false detections.

Sample imageNDWI detected waterTSUWI detected water
1663011073658.png
1663011097286.png

1663011120614.png
1663011147085.png
1663011167967.png
1663011188139.png
1663011210655.png

1663011230520.png

1663011248910.png
 
Messages
1,248
Country
unitedstates
That looks very promising. :p It will be interesting to see how it handles areas of different water colors, areas that have light reflections, or white water like rapids or just fast moving water.

DifferentWaterColors.jpg
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
I'll see if I can find some samples with different water colors, although you already see in the samples above that the sea and the inland wetlands have different colors and are detected.

Both indices that I use here not only use the RGB channels of the image, but also the NIR channel. So it is not purely color that is used to find the water.

How are you planning to use the water output? For your watermask or as polygons in other processing?
 
Messages
1,248
Country
unitedstates
I plan to use it for both.

Right now, using my above screenshot, both the USGS and OSM show this lake water covering over the sandy beach shoreline... not real bad but as the water moves into those little inlets it gets worse. So with your new process, I would not only get accurate edgelines for the waterpoly I would also create exact matching watermasking polys to rid of vegetation. Right now I am creating those in a different method and then I add the water masking shapefiles into the scenProc script. If they both can be created at the same time that would be a huge time savor. Currently I am also using a buffer to expand the watermask a little to ensure it keeps vegetation from showing up on the water.

Maybe that could be an option in the step... just thinkin' out loud here. And an option to export as an image (b&W), geo-referenced tiffs would be nice, and as shp files.
 
Messages
1,248
Country
unitedstates
So I am starting to test the new water detection. I see in your announcement that you can create a watermask (exactly what I seek), however I cannot export one? I can export polygons nicely to review its outcome. I am sure it is something simple I am missing.

my script:

ImportGDAL|B:\CHICO\Section_162\Images\CHICO_AA26.tif|*|AUTODETECT

DetectFeatures|FTYPE="RASTER"|B:\simwestCAL\scenPROC 3 Texture Filter Editor\Water Detection\WaterDetect-UWI.tfc|String;Type|water|NONE|DONTPROCESSHOLES

ExportOGR|Type="water"|ESRI Shapefile|B:\CHICO\Section_162\CHICO_AA26\Water\UWI\CHICO_AA26_WATER.shp|water


(I've tried three different steps below to export a b&w watermask type tiff)

ExportGDAL|FTYPE="RASTER"|GTiff|CHICO_AA26_WATER|B:\CHICO\Section_162\Images Water|NONE <--- gave me a copy of my original color image
ExportGDAL|FTYPE="POLYGON"|GTiff|CHICO_AA26_WATER|B:\CHICO\Section_162\Images Water|NONE <--- gave me no output
ExportGDAL|Type="water"|GTiff|CHICO_AA26_WATER|B:\CHICO\Section_162\Images Water|NONE <--- gave me no output
 
Last edited:
Messages
1,248
Country
unitedstates
Couple of other questions:

In order to use UWI method I need a 4-band image. Currently I see I can only download NAIP imagery in 3-band color and Infrared images, but not a 4-band (contacting USGS about this).

1. Can the Texture Filter Editor use both separate color samples and IR samples to configure or must be a 4-band to work properly?
2. If it needs a 4-band, will the scenProc step ExportGDALCombined combine the two types of images into a 4-band?
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Hi,

I'll reply about the script when I'm behind my pc again (too hard to typ a script on my phone).

A texture filter has only one input image, so it can not merge different files. But the ExportGDALCombined step can indeed do that.

In the past I have downloaded 4 band USGS images via wms. But not sure if that's available for each state.
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Hi,

The script should be like this:

Code:
ImportGDAL|B:\CHICO\Section_162\Images\CHICO_AA26.tif|*|AUTODETECT
ExportGDAL|FTYPE="RASTER"|GTiff|CHICO_AA26_WATER|B:\CHICO\Section_162\Images Water|NONE|B:\simwestCAL\scenPROC 3 Texture Filter Editor\Water Detection\WaterDetect-UWI.tfc

The DetectFeatures step is to make vector features, but if you apply the texture configuration file directly in the ExportGDAL step the output will be the modified raster.

I guess I could also add another step that allows you to load a second raster file in the texture filter. But in general your texture filter is flexible and not linked to a specific file. So would it work to use a filter like FROMFILE="*_CIR.tif" to load a colored infrared as second image? For the primary image you would then for example use FROMFILE="*_RGB.tif". Something like that would only work if you only load a limited number of raster input files per tile. But it saves you an extra step to write the combined image to disk first.
 
Messages
1,248
Country
unitedstates
Thanks Arno for the example. I will try that but first I need to combine my two rasters (RGB +IR) into one which I use the following:

ImportGDAL|B:\CHICO\Section_162\Images\CHICO_AA26.tif|*|AUTODETECT
ImportGDAL|B:\CHICO\Section_162\Images Infrared Butte\CHICO_AA26_IR.tif|*|AUTODETECT
ExportGDALCombined|FROMFILE="CHICO_AA26.tif"|FROMFILE="CHICO_AA26_IR.tif"|A1;A2;A3;B0|GTiff|CHICO_AA26_4BAND|B:\CHICO\Section_162\Images Infrared Butte|NONE


Pretty straight forward but no results. I have tried a multiple of combinations with the 'A1;A2;A3;B0' but scenProc crashes. Actually, it just closes without any error message? So I have to reopen it to run again?

Question 1) - As you see, trying to create a single 4-band image to use in the TFE. Why does the step parameters in ExportGDALCombined point to the path of a folder and not export to a single image? Am I to expect a lot of LOD images that I would need to combine? When I did try adding SplitGrid|LOD13|* then scenProc does crash with the following "system argument out of range exception"
 
Messages
1,248
Country
unitedstates
As a follow-up to my above response -

In order to take full advantage of the TFE steps of UWI or NDWI water detection I will need a 4-band image. So far from my research, the USGS only offers (as of 2018) only 3 band natural color or NIR as separate downloads. (what is "wms"?). I have even just emailed our contact at the USGS about 4-band availability. In the meantime I thought I would try combining the bands so I could fully test the water methods. I also re-read what you said here:

"I guess I could also add another step that allows you to load a second raster file in the texture filter. But in general your texture filter is flexible and not linked to a specific file. So would it work to use a filter like FROMFILE="*_CIR.tif" to load a colored infrared as second image? For the primary image you would then for example use FROMFILE="*_RGB.tif". Something like that would only work if you only load a limited number of raster input files per tile. But it saves you an extra step to write the combined image to disk first."

Yes, I understand the flexibility of the filter. FYI - for my processing, I am spanning across approximately a 105 square kilometer area per one '.tfz' file for every 25 of my image files , so I need to create a wide-ranging filter to handle the variety of water types/colors that could be found in that size of an area. This has worked quite well for vegetation detection. Hopefully I can achieve similar results with water.

Your idea of adding another step to input a 2nd raster seems like that would save a lot of work of having to combine bands. One step for a natural color image and the 2nd for NIR. And again, both of these would include separate "sample.bmps"? Maybe 10 or so for natural color and 10 for NIR? Would that be feasible? If it worked as I imagine I could then see the results inside the TFE in real time as I make adjustments to the steps.
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
I'm not behind my pc now, so I'm not sure if the export combined step starts counting bands at 0 or 1. I'll check that later.

As for two images in the texture filter editor, I did not plan to have multiple samples, but you are right that might be an issue. Let me think what would work there.
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
I did some more thinking, its probably better to add a step that merges in memory instead of directly exporting with gdal. Then you can merge the two files and directly feed the result into the texture filter. I'll try to add something.
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Hi,

In the step that merges the raster features the bands start counting at 0. So most likely A3 above is not valid if you loaded a 3 band RGB image.

I have also started implemented the step that does the merge in memory without saving it to disk.
 
Messages
1,248
Country
unitedstates
Yea, I was just trying any of the bands to see if I could get any output. I do that sometimes when I am experimenting with a new step I have not used before to get an understanding of what I am working with. Such as your mentioning of "merging in memory". I take it that saves processing time/space or something? You know best. I'll try whatever you decide with. ;)
 

arno

Administrator
Staff member
FSDevConf team
Resource contributor
Messages
31,418
Country
netherlands
Did you check the manual as well? It usually contains examples of how to use a step :D

To do the merge in memory saves you the need to first save the merge image to disk and then load it again to use it in a texture filter. So I think it will optimize your workflow. The new step has been added to the latest development release btw.
 
Messages
1,248
Country
unitedstates
Oh wow, I will hit this first thing Monday morning (actually probably tomorrow as I am eager to test!). Yes, I check the manual deeply as part of my ritual.
 
Top