Taxing the sun?. Yes, in Spain this seems to be possible.

2015/04/09

Absolutely ashamed by my government’s insane policies on this regards, Spain is now (…) attempting to scale back the use of solar panels – the use of which they have encouraged and subsidized over the last decade – by imposing a tax on those who use the panels. The intention is clearly to scare taxpayers into connecting to the grid in order to be taxed. The tax, however, will make it economically unfeasible for residents to produce their own energy: it will be cheaper to keep buying energy from current providers. And that is exactly the point. (…)

OneRoof-Energy11

Source: http://www.forbes.com/sites/kellyphillipserb/2013/08/19/out-of-ideas-and-in-debt-spain-sets-sights-on-taxing-the-sun/

While we see anywhere else in the world this is being encouraged we don’t, we do exactly the opposite… but if you wonder why this could happen in a allegedly developed country like mine i herewith let you know the reason why… not to compete with other energies or more exactly other big companies providing that energy. A shame or even more than that, a fu***** shame.

So you encourage sustainability and now you discourage it?. In a country like Spain with such an incredible unemployment rate, which slowly reduces this figures at the expense of lower wages, winning competitiveness but losing anywhere else!!! (Mostly if we have cities with +3000 hours of sunshine a year!)

Anyway, trying not to get too upset after writing this words and also trying to make this makes sense in a GIS blog i will try to show you how Lon Angeles county in the US is encouraging the installation of solar panels, ranking all 2010 parcels according to wattHours per square meter. Isn’t it a politically and technically state of the art approach? Yes in my opinion it is, indeed.

solar-mapping-data-20150409

http://egis3.lacounty.gov/dataportal/2015/04/07/solar-data-summarized-to-2010-parcels/

solar-mapping-data-20150409-03

Important Note.  The shapefile includes 4 fields that are summaries of the solar potential:

  1. Rank 1 – Square feet of roof receiving excellent solar input (> 1.4 million wattHours per square meter)
  2. Rank 2 – square feet of roof receiving good solar input (1.15 – 1.4 million wH/meter squared)
  3. Rank 3 – square feet of roof receiving poor solar input (950,000 – 1.15 million wH/meter squared)
  4. Rank 4 – square feet of roof receiving negligible solar input (< 950,000 million wH/meter squared)

Hope you like this post, if so, share it.

Kind Regards,

Alberto C.L.
MSc GIS and worried about “government insanity”.

DTM validation using Google Earth (and RMSE extraction)

2015/03/10

Hi guys,

Surfing the internet is great when you need to figure out something. I needed to validate some DTM from unknown sources against an also unknown source (but at least a kind of reliable one, Google Earth).

All we need is

  • Google Earth
  • TCX converter
  • ARcGIS
  • Excel

This is the procedure i have followed:

  1. First of all we draw a path over our AOI using Google Earth, we save this as KML,
  2. This KML is opened by TCX converter, added heights and exported as CSV,
  3. CSV is imported by ArcGIS,
  4. We use the tool ‘extract multi values to points‘ to get in the same table the values of our DTM and the values from Google Earth,
  5. We use Excel to calculate the RMSE and get a quantitative result,

These are the values in our DTM

dtm-validation-02

This is the path we have to draw in Google Earth

dtm-validation-03

Using TCX converter we get the heights out of Google Earth’s DTM

dtm-validation-01

Using the tool ‘extract multi values to points‘ we get the heights out of our DTM

dtm-validation-04

We measure the differences and extract the RMSE.
Are we within our acceptance threshold or expected level of accuracy?.

You guys have to figure this out for yourselves!!!

Lost regarding RMSE calculation?. Think you have to take a look at this other post.

dtm-validation-05

dtm-validation-06

Hope you guys have enjoyed this post, if so, don’t forget sharing it.

Alberto Concejal
MSc GIS and QCQA expert (well this is my post and i say what i want :-))

Pearson correlation and GIS

2014/11/28


pearson-01
Do these two variables have a correlation?. To answer this important question first of all we have to know that only if it’s a linear relationship and there are no outliers we can take advantage of Mr Pearson’s correlation statiscal tool.

If i love chocolate, does this mean i have tendency of being chuby? or on the other hand there’s no relationship at all. Let’s figure it out.

For this particular occasion, input data XY are two DTM heights, my guess is the following: if correlation is too big, i may deduce they’re not independent products and one might been created from the other, in other words, we might have tried to cheat and we are using a different source that the one we have stated… In GIS sometimes things are not exactly as expected and there’s need to be assertive and making a plan for discovering this minor issues.

 

 

 

Let’s start from the beginning, if source 1 is the same as source 2, the correlation would be perfect, is this correct?. The answer is yes. r (Person correlation) would be = 1. So yes, if this was asking about chocolate and fleshiness this would be 100% right but this hardly or never happens in real life (direct and no other explanation or variable interaction… why is always so0o complicated?).

pearson-formula

pearson-04

With real data, you would not expect to get values of r of exactly -1, 0, or 1. For example, the data for spousal ages (white couples) has an r of 0.97. Don’t ask me where i got this weird source (well, just in case: http://onlinestatbook.com/2/describing_bivariate_data/intro.html)

age_scatterplot

If i fill source 2 with a random number, the correlation would be almost none accordingly (in this case r=0.17)

pearson-06

Now if we see the diagram of the first two sources and we get the Pearson correlation coefficient (r=0.24) which means the correlation is very weak.

pearson-03

But that was only a very small part of the table (only 30 iterations), so if i do the same calculation out of the +13,000 iterations i really need, i get these figures (by the way, theres no need to use such a complicated formula above, you can use this one in EXCEL: =PEARSON(A1:An;B1:Bn))

pearson-07

So the correlation now its moderate, which makes me deduct at least the sources seem different and i’d need more clues to think my customer might have tried to actually cheat me using the same source for both datasets.

Summarizing:

r=1, correlation is PERFECT

0.75<r<1, correlation is STRONG

0.5<r<0.75, correlation is MODERATE

0.25<r<0.5, correlation is WEAK

<0.25, almost NO correlation, both variables are hardy related

I hope you guys have found this post interesting,
looking forward to hear where could you use it and/or your feedback,

Regards,

Alberto Concejal
MSc GIS

Comparing France Meteo and Spain Meteo from the visualization point of view

2014/11/24

After living in France for four years i have to tell i am always aware of Meteo information on TV (well, i live in Brittany, i guess this makes sense!). It was the same in Spain or anywhere else in the world where i had lived and the reason why is i have always loved Meteo and statistiques, mostly after working as an aerial surveying photographer in the late nineties… but that’s another history.

Weather forecast its quantitative data that distributes spatially, meaning every single spot will have a different figure, even if it’s separated no more than 1 mm, at least in theory. So the question is: as its impossible showing predictions for every single square mm of the area of interest, we need to estimate them using different models. Still if we point anywhere at the map we should know if the icon or figure applies or not to the spot i want to know about.

Let’s make it easier to understand, lets use images!!!

First of all, i know its difficult but it’s important, please don’t have into account Meteo news are presented (in this particular case) by Anaïs BAYDEMIR, which is a beautiful TV journalist at France 2… Let’s not focus on this (but if you happen to want to know more about her i hereby copy a couple of links to both wikipedia and youtube:

http://fr.wikipedia.org/wiki/Ana%C3%AFs_Baydemir

spain-meteo

Having said that, le’s take a look the way this is shown in Spain (TVE 2014). Well, again let’s not focus on the guy’s grey suit but…

 

 

 

 

 

spain-meteo-02

Information it’s kind of OK but what happens if we want to know about a spot in the middle of two icons?. Is the partly cloud icon which applies to my place or it’s the ‘sun and flies’ one?. How can i be sure of the forecast if i live in this this big region in the SW of Spain?…

 

 

 

 

france-meteo

On the other hand let’s focus on Anaïs_Baydemir, ops, meaning let’s focus on the way France 2 shows this information:

france-meteo-02

Every single square mm is perfectly defined, if we want to know the forecast in a particular place we know the icon that corresponds to the spot and we don’t have to guess…

france-meteo-03

I know it’s kind of nothing too important, mostly if introduced this saucy way but think about it, wouldn’t you prefer to read Meteo this way? (again i’m not asking if you prefer the way the french beauty is showing the info compared to the way the spanish guy does, that’s completely irrelevant… right?)

Regards,
Alberto CONCEJAL
MSc GIS and Meteo fan

Remote Sensing, Photogrammetry, Lidar and Landuse IGN Spain

2014/11/18

teledeteccion-fotogrametria-lidar-usos-del-suelo-ign-20141118b

A few more lines for leting you know again that i passed this other course just now in Instituto Geográfico of Spain (IGN).

Remote Sensing, Photogrammetry, Lidar and Landuse, a comprehensive 40h update on relevant information i need tu use on a daily basis. This ‘update’ helps me to better understand what i am working with and this way, being able to properly describe it for my daily analysis,

Advanced Thematic Cartography IGN Spain

2014/11/14

cartografia-tematica-avanzada-20141118b

A few lines for leting you know i passed this course last year 2013 in Instituto Geográfico of Spain (IGN). Spatial analysis, Spatial stats, proper simbolization, data mining and geovisualization. A very interesting 40h online course that helps me on a daily basis to be able to show geodata in a more professional way.

Because we normally need to deepen our geodata without making too complex to understand the result of our analysis.

HTML High resolution DTM visualization using Quantum GIS (Qgis)

2014/11/03

This QGIS Plugin, Qgis2threejs, exports terrain data, map canvas image and vector data to your web browser!!

3dvisualizatio-DTM-QGIS-20141103

All you have to do is opening the DTM in Qgis (2.4.0 Chugiak), go to plugins library and install Qgis2threejs.

3dvisualizatio-DTM-QGIS-20141103-03

Once its installed you will see this icon on screen iconand you will need to clic on it.

3dvisualizatio-DTM-QGIS-20141103-04

Then choosing the parameters of the visualization and voilá!!

I have used a 5m DTM which source was LIDAR so the quality is very good

3dvisualizatio-DTM-QGIS-20141103-05

Hope you guys like it. Feedback would be greatly appreciated.

Alberto Concejal
MSc GIS and Quality Control
albertoconcejal [at] gmail.com

DTM from SRTM? Let’s compare sources using RMSE (Root Mean Square Error) and a gaussian kernell density map

2014/10/29

I guess we all can make a DTM out of many sources but SRTM is one of the most common ones, right?. Then let’s learn from this very simple approach how close we are from the SRTM raw data.

  1. Selecting a not very big representative area to be able to handle it,
  2. exporting raster to polygon (from SRTM 3 arcsec/90m) dataset 1
  3. exporting raster to polygon 30m (our DTM dataset) dataset 2
  4. exporting to POIs 30m (our DTM dataset) dataset 2b
  5. Spatial join POIs dataset 2b vs dataset 1
  6. RMSE
  7. visualizing delta using a density map/gaussian kernell +appropriate symbolization

In yellow we see theres a full correspondence between SRTM and our DTM dataset and in blue there’s a ‘hole’ and in red there’s a ‘mountain’, this means it’s in here where the shift is more important.

This way we can highlight if sources are OK.

It’s simple but it works. How do you like it?. Please feel free to send some feedbak.
(Software used: ArcGIS 10.1, Global Mapper 13.2)

Cheers,
Alberto Concejal
MSc GIS, QC

DENSITY-MAP-V1-VS-SRTM-20141021

density maps parameters

rmse-sierra-leone-20141008-02

Spatial join between both DTM datasets

blog-20141029

Density map for highlighting differences between both datasets (ours and SRTM’s)

blog-20141029-03

RMSE. It’s not too big so there’s need to visualize to find potential bizarre spots

blog-20141029-02

bizarre DTM heights

La geografía española (con minúsculas)

2014/08/26

Aquí la ‘convesación’ via twitter con el presentador de TVE Jacob Petrus. Me quejé de que se mencionara dentro de una frase, como tantas veces hemos oído, en radio y televisión, la expresión ‘La geografía española…’ refiriéndose a España en general. Lo que me indignó fue que Jacob Petrus es Geógrafo además de presentador generalista (y meteorólogo según pone en su CV) y como tal, según mi punto de vista, ha de ser precavido con la semántica y el significado de las cosas.

Allá por el año 1993, en la primera clase del primer día de carrera mis profesores Fernando Molinero y Maite Ortega (cada uno de ellos, en clases diferentes) mencionaron el hecho de que a menudo se usa la frase hecha ‘la geografía española…’ para hablar de La península o España, es decir, un lugar, sin embargo a ellos no les parecía correcto el uso dado que la Geografía (con mayúsculas) es una ciencia y como tal debe entenderse.

De acuerdo con sus palabras la RAE (Real Academia de la Lengua Española) dice:

twitter-alberto-20140826-02

(Territorio, paisaje. Usado también en sentido figurado). Pero si lo que se pretente es hacer una analogía, en este caso no sería a mi juicio correcto dado que la misma palabra tiene un significado quantitativa (ordinal) y qualitativamente (ciencia vs lugar) superior. En todo caso, queda a la interpretación particular.

Otros Geógrafos, también presentadores de televisión y meteorólogos como Florenci Rey jamás osaron utilizar tal expresión.

Claramente es una frase usada con ninguna maldad, con ganas de describir algo se dice ‘en toda la geografía española ocurre tal o tal fenómeno’ pero el efecto secundario de esas palabras es que se puede pensar que el todo LA GEOGRAFÍA es la parte EL LUGAR y de tal manera algo grande se convierte en algo pequeño.

La Geografía ya es de por sí una ciencia algo denostada por otras como la Arquitectura, la Biología, la meterología, la Topografía, el Urbanismo, la Física, y tantas otras. A lo largo de los años me he dado cuenta que no se comprendía claramente qué es ser un Geógrafo y qué es la Geografía, que éramos los que hacíamos de todo sin estar especializados en nada, de hecho cuando empecé a estudiar no había otro destino que la enseñanza o las oposiciones pero afortunadamente ahora, con la aparición del GIS y todo lo asciado a la geolocalización, eso ha cambiado notablemente.

La Geografía según yo la entendí era la ciencia de la interrelación de el hombre con el medio y hace falta la figura de un profesional que comprenda de manera global todas esas interacciones, es ahí donde llegamos los Geógrafos.

Más de 20 años han pasado desde ese día y he visto casi a diario cómo se ha usado la expresión por gente que no sabía y no tenía por qué saber la importancia de una simple frase, pero llegada la oportunidad de manifestarse usando Twitter y hablando directamente con la persona referida (Jacob Petrus) he creído conveniente hacerlo.

No obstante he de agradecer que al menos me haya contestado, cosa que habla bién de él.

 twitter-alberto-20140826

Actualización: No sólo me ha contestado sino me ha asegurado que tendrá en cuenta mi anotación.

twitter-alberto-20140826-04

Me pone contento este grado de interactividad y rapidez de feedback. De nuevo Gracias Jacob!

twitter-alberto-20140826-03

‘Reality Checks’, also called ‘Ground Truth Tests’

2014/08/19

Comparing all kind of Geodata (i.e 3D Buildings, DTM, DHM, DSM, Land Use, vectors,…) to background sources as Google Earth/ Bing, available sources from the country we are working on or WMS available sources, etc.

reality-checks

Figuring out if the data requested and we want to deliver is consistent enough compared to the so called “Truth”. Some of these checks are visual/manual, some others are more automated/analytic, Preparing ad-hoc reports using Photoshop macros to explain/flag/highlight etc. also videos, PPTs, specific ‘White Papers’ and any other way of facilitating the comprehension of the potential issues.


Follow

Get every new post delivered to your Inbox.