{"id":475,"date":"2020-10-09T17:13:54","date_gmt":"2020-10-09T17:13:54","guid":{"rendered":"https:\/\/blog.get-map.org\/?p=475"},"modified":"2020-10-09T17:14:59","modified_gmt":"2020-10-09T17:14:59","slug":"130k-status-updates","status":"publish","type":"post","link":"https:\/\/blog.get-map.org\/index.php\/2020\/10\/09\/130k-status-updates\/","title":{"rendered":"130K &#8211; Status updates"},"content":{"rendered":"<hr \/>\n<h2><a name=\"_130000_maps_rendered\"><\/a>130000+ maps rendered<\/h2>\n<p>Some day in September my MapOSMatic instance crossed the line of 130K maps rendered, since it started in May 2016. At this rate it will get to 150K even before it\u2019s fourth anniversary \ud83d\ude42<\/p>\n<hr \/>\n<h2><a name=\"_database_reimport\"><\/a>Database reimport<\/h2>\n<p>I had to do a database re-import recently as it had turned out that some data was missing, probably due to recent general problems with minutely changesets on the OSM side. At that point I also took the opportunity to upgrade osm2pgsql and the import style, so that the database is now ready for v5 releases of the OpenStreetMap Carto style. Older styles should continue to work as before with this.<\/p>\n<hr \/>\n<h2><a name=\"_email_setup\"><\/a>Email setup<\/h2>\n<p>So far the MapOSMatic setup used my GMail account for sending out error notifications to me, and &#8220;your map is ready&#8221; notifications.<\/p>\n<p>I now switched to running my own mail server instead, so reducing the number of external dependencies and increasing privacy a little bit.<\/p>\n<p>During this I discovered something embarrassing: looks as if for years, ever since I introduced the feature, &#8220;your map is ready&#8221; notifications were actually never sent to the notification address given by users, but to the server administrators address (so mine) only. I never really noticed as I used my own address for testing anyway \u2026 this is now fixed, too.<\/p>\n<hr \/>\n<h2><a name=\"_style_updates\"><\/a>Style updates<\/h2>\n<p>I have been a bit sloppy with style upgrades in recent month, but I\u2019m going to catch up with this again. For a start I\u2019m now going over the style installation scripts in my <a href=\"https:\/\/github.com\/hholzgra\/maposmatic-vagrant\">MapOSMatic Vagrant<\/a> test project, once that\u2019s finished and all tests pass I will upgrade styles on the public instance, too. This will affect:<\/p>\n<ul>\n<li>The OpenStreetMap Carto style<\/li>\n<li>The Humanitarian style<\/li>\n<li>The Belgian style<\/li>\n<li>The OpenArdenne style<\/li>\n<\/ul>\n<p>and probably a few others, too.<\/p>\n<p>I\u2019m also still on the hunt for more open source MapnikXML and CartoOSS styles to support, so if you know of any that I\u2019m missing that is based on the <code>osm2pgsql<\/code> schema, please let me know.<\/p>\n<p>Styles that use <code>imposm<\/code> instead of <code>osm2pgsql<\/code> may also be supported in the future, but right now this is not possible due to disk space constraint on the current server.<\/p>\n<hr \/>\n<h2><a name=\"_what_8217_s_next\"><\/a>What\u2019s next?<\/h2>\n<p>Once I\u2019m done with bringing all styles up to date I plan to gradually increase the maximum area size that can be rendered. Currently this is limited to 20x20km\u00b2, but there\u2019s no real technical reason for this. The limit is just there to put a limit to rendering time.<\/p>\n<p>As all render requests are processed by a single queue one by one so far, this was meant to keep the total queue waiting time low, together with a hard 60 minute limit after which render jobs are killed.<\/p>\n<p>My plan is to set up at least two separate rendering queues for the future, a &#8220;quick&#8221; and a &#8220;slow&#8221; queue. Based on area covered, base and overlay style choices, and single vs. multi page layout, the system will try to predict whether a requested render job will be fast or slow, and will put it in the quick or slow queue accordingly.<\/p>\n<p>This way the typical quick requests that only take a few minutes or less to render will no longer have to wait for e.g. multi page requests with many pages, and the one hour limit can be lifted a bit for the slow queue. At the same time I can lower the time limit for the quick queue, so that in cases where the render time estimate turns out to be wrong a request can be canceled early, and be moved to he slow queue for re-rendering.<\/p>\n<p>Once that\u2019s done I will then probably focus on the paper size dialog once more, finally making it possible to choose a specific map scale there, so that things like &#8220;I want a 1:10,000 map on DinA2 paper&#8221; will finally become possible.<\/p>\n<p>Another thing I\u2019m working on on the side is to try to create\u2009\u2014\u2009or extend one of the existing\u2009\u2014\u2009Mapnik symbolizers for rendering arcs. This would allow for rendering things like the camera viewing angles in the &#8220;Surveillance under Surveillance&#8221; overlay\u2009\u2014\u2009which right now uses the Python Cairo Bindings directly instead of Mapnik\u2009\u2014\u2009or like the nautical navigational light visibility arcs on OpenSeaMap\u2009\u2014\u2009which uses its own custom renderer implementation for this.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>130000+ maps rendered Some day in September my MapOSMatic instance crossed the line of 130K maps rendered, since it started in May 2016. At this rate it will get to 150K even before it\u2019s fourth anniversary \ud83d\ude42 Database reimport I had to do a database re-import recently as it had turned out that some data &hellip; <a href=\"https:\/\/blog.get-map.org\/index.php\/2020\/10\/09\/130k-status-updates\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;130K &#8211; Status updates&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[8],"_links":{"self":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/475"}],"collection":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/comments?post=475"}],"version-history":[{"count":3,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/475\/revisions"}],"predecessor-version":[{"id":479,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/475\/revisions\/479"}],"wp:attachment":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/media?parent=475"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/categories?post=475"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/tags?post=475"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}