{"id":138,"date":"2017-05-16T09:35:31","date_gmt":"2017-05-16T09:35:31","guid":{"rendered":"https:\/\/blog.get-map.org\/?p=138"},"modified":"2017-05-16T11:23:57","modified_gmt":"2017-05-16T11:23:57","slug":"yet-another-database-re-import","status":"publish","type":"post","link":"https:\/\/blog.get-map.org\/index.php\/2017\/05\/16\/yet-another-database-re-import\/","title":{"rendered":"Yet another database re-import"},"content":{"rendered":"<p><a name=\"preamble\"><\/a><\/p>\n<p>TL;DR: there have been some database and rendering daemon hickups over the weekend which should now be resolved. Main database is up to date again, &#8220;Waymarked Trails&#8221; route overlay database is still catching up \u2026<\/p>\n<p><!--more--><\/p>\n<p>In February I had to reimport the OSM planet database completely as I had originally imported with &#8220;hstore-match-only&#8221;, which ignores objects that do not match any of the tags\/columns explicitly specified in the osm2pgsql import stylefile. This filtered out a lot of objects only used in the &#8220;extra&#8221; style sheets and overlays.<\/p>\n<p>Unfortunately I removed &#8220;hstore-match-only&#8221; from the initial import script, but not from the script that applies minutely diffs to keep the database up to date.<\/p>\n<p>So objects added only after the initial import were still filtered out, and I had to start over with yet another fresh import. I did this import on another machine and had planned to copy over the database directory, then quickly swap files to minimize downtime.<\/p>\n<p>Unfortunately the process didn\u2019t went as smooth as expected, and I also didn\u2019t notice that I killed the render daemon at some point along the way.<\/p>\n<p>Everything is restored just fine though now, and I verified that objects are no longer filtered out when importing minutely diffs.<\/p>\n<p>Hopefully this was the last full re-import for quite a while now \u2026<\/p>\n","protected":false},"excerpt":{"rendered":"<p>TL;DR: there have been some database and rendering daemon hickups over the weekend which should now be resolved. Main database is up to date again, &#8220;Waymarked Trails&#8221; route overlay database is still catching up \u2026<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/138"}],"collection":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/comments?post=138"}],"version-history":[{"count":2,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/138\/revisions"}],"predecessor-version":[{"id":140,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/posts\/138\/revisions\/140"}],"wp:attachment":[{"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/media?parent=138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/categories?post=138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.get-map.org\/index.php\/wp-json\/wp\/v2\/tags?post=138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}